| Age | Commit message (Collapse) | Author | |
|---|---|---|---|
| 8 days | refactor: move html document creation to getBatch | demo | |
| Also, if there are errors, I log them and simply return a nil slice. | |||
| 9 days | fix: make select statement block unless communication takes place | demo | |
| 9 days | feat: configure maxDepth from the command line | demo | |
| Similar to maxURLs, a maxDepth of zero means no limit. | |||
| 9 days | wip: prototype a max-depth limitation | demo | |
| It's just bolted on with a constant right now though. | |||
| 9 days | feat: update the classic crawler to track depth via packets | demo | |
| 10 days | fix: release semaphore at the proper time | demo | |
| 10 days | feat: implement maxConcurrency using a buffered channel 'sema' | demo | |
| 10 days | feat: add cancellation feature | demo | |
| 10 days | feat: hit 'em with the classic web crawler | demo | |
 |
index : urls | |
| Web crawler in Go. | Brandon Irizarry |
| summaryrefslogtreecommitdiff |
path: root/classic.go