| Age | Commit message (Collapse) | Author | |
|---|---|---|---|
| 2026-05-30 | feat: add code to handle maxDepth | demo | |
| 2026-05-30 | feat: add maxDepth argument to workers version | demo | |
| It's currently unused though. | |||
| 2026-05-27 | refactor: move packet definitions to their own file | demo | |
| I also decided to make the packet datatype package private. | |||
| 2026-05-27 | refactor: move "packet conversion" into a separate function | demo | |
| 2026-05-26 | docs: add extensive comments | demo | |
| 2026-05-26 | feat: measure the depth where each URL is found | demo | |
| 2026-05-26 | feat: add some prints to prove we need to select on Done() | demo | |
| 2026-05-26 | refactor: eliminate redundant select statement | demo | |
| 2026-05-26 | fix: make sure all workers terminate by the end | demo | |
| 2026-05-26 | feat: add early termination condition based on maxURLs | demo | |
| 2026-05-26 | feat: add break condition from worklist loop | demo | |
| 2026-05-26 | feat: add the worker-pool-based crawer from TGPL | demo | |
 |
index : urls | |
| Web crawler in Go. | Brandon Irizarry |
| summaryrefslogtreecommitdiff |
path: root/workers.go