Commits · master · dlab-indecol / web_trawler · GitLab

Sep 21, 2017
- remove some readme spelling · fcb69ccb
  Konstantin Stadler authored Sep 21, 2017
  
  fcb69ccb
Jul 13, 2017
- added y/n changes to readme · 72f83556
  Gorm Roedder authored Jul 13, 2017
  
  72f83556
- implemented y/n solution to issue #2 · 5b569856
  Gorm Roedder authored Jul 13, 2017
  
  5b569856
Jun 30, 2017
- removed invalid target test; not vital · 00daa747
  Gorm Roedder authored Jun 30, 2017
  
  00daa747
- fixed test for invalid path · 68761de6
  Gorm Roedder authored Jun 30, 2017
  
  68761de6
- added yaml for gitlab ci · 344eb5a8
  Gorm Roedder authored Jun 30, 2017
  
  344eb5a8
- made single-line docstrings follow standards · f161987a
  Gorm Roedder authored Jun 30, 2017
  
  f161987a
- changes from review · f4534c4e
  Gorm Roedder authored Jun 30, 2017
  
  f4534c4e
Jun 28, 2017
- removed lxml and cssselect dependencies · e6e8ebbd
  Gorm Roedder authored Jun 28, 2017
  
  e6e8ebbd
Jun 27, 2017
- improved readme · 1024ac77
  Gorm Roedder authored Jun 27, 2017
  
  1024ac77
Jun 22, 2017
- added matlab example to readme, and readme to pypi long_description · 8769f592
  Gorm Roedder authored Jun 22, 2017
  
  8769f592
Jun 21, 2017
- added changelog entry and upped the version to upload to pypi · ec6ea58b
  Gorm Roedder authored Jun 21, 2017
  
  ec6ea58b
- undid the unsubpackaging thing, realised there was a reason for it · f7f935b6
  Gorm Roedder authored Jun 21, 2017
  
  f7f935b6
- added license and changelog; fixed dependency error · 09f2df81
  Gorm Roedder authored Jun 21, 2017
  
  09f2df81
- moved everything from the subpackage to the root package directory · 193678e5
  Gorm Roedder authored Jun 21, 2017
  
  193678e5
- replaced cmd line arg verbose with quiet, because it makes more sense for default to be verbose · 99bc2364
  Gorm Roedder authored Jun 21, 2017
  
  99bc2364
Jun 20, 2017
- deleted config json and added all config options as command line arguments,... · af97ea82
  Gorm Roedder authored Jun 20, 2017
  af97ea82
- pypi registration and readme section on installing with pip · a294c64b
  Gorm Roedder authored Jun 20, 2017
  
  a294c64b
- getting closer to Win compatibility · a75d9cd5
  Gorm Roedder authored Jun 20, 2017
  
  a75d9cd5
- trying to get package to work on Win · fd0524a0
  Gorm Roedder authored Jun 20, 2017
  
  fd0524a0
Jun 19, 2017
- refactoring and readme writing · cc48c4c8
  Gorm Roedder authored Jun 19, 2017
  
  cc48c4c8
- Merge branch 'master' of gitlab.com:dlab-indecol/web_trawler · fb47d36e
  Gorm Roedder authored Jun 19, 2017
  
  fb47d36e
- fixed problem with unavailable addresses · 30b906e1
  Gorm Roedder authored Jun 19, 2017
  
  30b906e1
- new trawl function stub - todo · 3b2cae27
  Konstantin Stadler authored Jun 19, 2017
  
  3b2cae27
- created source dist for testing · 225d398e
  Gorm Roedder authored Jun 19, 2017
  
  225d398e
- added test for whitelist and blacklist · b7f2075e
  Gorm Roedder authored Jun 19, 2017
  
  b7f2075e
- added whitelist and blacklist functionality · 7fbaf5b0
  Gorm Roedder authored Jun 19, 2017
  
  7fbaf5b0
- switched to higher level api for web server background threading · 87f55f30
  Gorm Roedder authored Jun 19, 2017
  
  87f55f30
- finished writing first draft of tests · 72f5327e
  Gorm Roedder authored Jun 19, 2017
  
  72f5327e
Jun 18, 2017
- fixed the threading and multiprocessing combo · 89d3370c
  Gorm Roedder authored Jun 19, 2017
  
  89d3370c
- added threading per process for a challenge (recursive call is still sequential) · 5ad33446
  Gorm Roedder authored Jun 18, 2017
  
  5ad33446
Jun 16, 2017
- testing and edge case ironing outing · 45040a6e
  Gorm Roedder authored Jun 16, 2017
  
  45040a6e
- package now works from anywhere, using 'python -m web_trawler' · 31227644
  Gorm Roedder authored Jun 16, 2017
  
  31227644
Jun 15, 2017
- switched to pytest, met a wall with __init__.py, need to sleep on it · 62ec2ce2
  Gorm Roedder authored Jun 15, 2017
  
  62ec2ce2
- packaged; minor fixes · da39ddeb
  Gorm Roedder authored Jun 15, 2017
  
  da39ddeb
- added logging; multiprocessing of http requests and downloads · a2b22b83
  Gorm Roedder authored Jun 15, 2017
  
  a2b22b83
Jun 14, 2017
- added docstrings · 8eafa2d8
  Gorm Roedder authored Jun 14, 2017
  
  8eafa2d8
- refactored - there's an error, but I'll have to fix tomorrow · a4431fe6
  Gorm Roedder authored Jun 14, 2017
  
  a4431fe6
- cleaned up a bit, only barely started writing docstrings · 3d7c6cd8
  Gorm Roedder authored Jun 14, 2017
  
  3d7c6cd8
- added config and some filtering (only follow domain links for the one-step recursive option) · 23991783
  Gorm Roedder authored Jun 14, 2017
  
  23991783