index
:
urls
master
Web crawler in Go.
Brandon Irizarry
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
main.go
Age
Commit message (
Collapse
)
Author
10 days
feat: restore original "print 45 and hang" behavior
demo
10 days
feat: change all channel payloads to pointer types
demo
10 days
feat: reveal bug in the channel linkage topology
demo
10 days
feat: add some code to cancel
demo
However, currently this never gets reached.
10 days
refactor: use SplitSeq instead of Split
demo
10 days
feat: add gouroutine-leak profiling
demo
10 days
feat: design worker-pool webcrawler
demo
10 days
docs: remove comment
demo
13 days
refactor: move main logic into separate function
demo
13 days
feat: avoid sending empty URL slices to the worklist
demo
13 days
feat: add diagnostics to prove code is buggy
demo
14 days
docs: add package godoc
demo
14 days
docs: expound help string for -max argument
demo
14 days
fix: check *maxURLs > 0 case
demo
14 days
feat: add maxURLs CLI flag
demo
I've also added some more input sanitization.
14 days
feat: implement cancellation
demo
I've also added 1., 2., etc. to the printed list of URLs.
14 days
feat: add semaphore to throttle concurrent GET requests
demo
14 days
refactor: remove intermediate variable
demo
14 days
docs: add comment for clarity
demo
14 days
feat: implement simple BFS webcrawler
demo
14 days
feat: create empty main.go
demo