index
:
urls
master
Web crawler in Go.
Brandon Irizarry
summary
refs
log
tree
commit
diff
log msg
author
committer
range
Age
Commit message (
Collapse
)
Author
10 days
feat: add gouroutine-leak profiling
demo
10 days
feat: design worker-pool webcrawler
demo
10 days
docs: remove comment
demo
13 days
refactor: move main logic into separate function
demo
13 days
feat: avoid sending empty URL slices to the worklist
demo
13 days
feat: add diagnostics to prove code is buggy
demo
13 days
docs: add package godoc
demo
14 days
docs: expound help string for -max argument
demo
14 days
fix: check *maxURLs > 0 case
demo
14 days
feat: add maxURLs CLI flag
demo
I've also added some more input sanitization.
14 days
feat: implement cancellation
demo
I've also added 1., 2., etc. to the printed list of URLs.
14 days
feat: add semaphore to throttle concurrent GET requests
demo
14 days
refactor: remove intermediate variable
demo
14 days
docs: add comment for clarity
demo
14 days
feat: implement simple BFS webcrawler
demo
14 days
feat: create empty main.go
demo
2026-05-21
chore: add existing code to project
demo
I also ran go mod tidy since the new files refer to packages I've recently installed (locally.)
2026-05-21
chore: add html package
demo
2026-05-21
chore: initialize project
demo