urls - Web crawler in Go.

Age	Commit message (Expand)	Author
9 days	refactor: move packet definitions to their own file	demo
9 days	refactor: move "packet conversion" into a separate function	demo
10 days	docs: add extensive comments	demo
10 days	feat: measure the depth where each URL is found	demo
10 days	feat: add some prints to prove we need to select on Done()	demo
10 days	refactor: eliminate redundant select statement	demo
10 days	fix: make sure all workers terminate by the end	demo
10 days	feat: add early termination condition based on maxURLs	demo
10 days	feat: add break condition from worklist loop	demo
10 days	feat: add the worker-pool-based crawer from TGPL	demo