summaryrefslogtreecommitdiff
path: root/main.go
AgeCommit message (Collapse)Author
2026-06-11feat: switch off of which flag is being useddemo
2026-06-11feat: introduce --shortcode and --url as mutually exclusive flagsdemo
2026-06-11feat: make stubs for subcommandsdemo
2026-06-11feat: check that GOEXPERIMENT=goroutineleakprofile is setdemo
2026-05-30feat: upgrade hamlet and use newer stuff from theredemo
2026-05-30feat: use hamlet package to simplify command-line argumentsdemo
2026-05-28feat: specify whether URL sources are both missing or both presentdemo
2026-05-28feat: implement shortcode featuredemo
2026-05-28refactor: move initial URL parsing into function 'convertToURL'demo
2026-05-28docs: add some commentsdemo
2026-05-28feat: check for missing https://demo
This isn't as easy as modifying the parsed URL after the fact. This Stack Overflow post has some hints: https://stackoverflow.com/q/46719948/4570292
2026-05-28docs: add comment explaining purpose of log.Lshortfiledemo
2026-05-28chore: include shortfile printout in log invocationsdemo
2026-05-27feat: configure maxDepth from the command linedemo
Similar to maxURLs, a maxDepth of zero means no limit.
2026-05-27wip: prototype a max-depth limitationdemo
It's just bolted on with a constant right now though.
2026-05-27feat: update the classic crawler to track depth via packetsdemo
2026-05-26feat: add the worker-pool-based crawer from TGPLdemo
2026-05-26feat: hit 'em with the classic web crawlerdemo
2026-05-26refactor: make deduplication part of main goroutinedemo
2026-05-26feat: restore original "print 45 and hang" behaviordemo
2026-05-26feat: change all channel payloads to pointer typesdemo
2026-05-26feat: reveal bug in the channel linkage topologydemo
2026-05-26feat: add some code to canceldemo
However, currently this never gets reached.
2026-05-26refactor: use SplitSeq instead of Splitdemo
2026-05-26feat: add gouroutine-leak profilingdemo
2026-05-26feat: design worker-pool webcrawlerdemo
2026-05-26docs: remove commentdemo
2026-05-24refactor: move main logic into separate functiondemo
2026-05-23feat: avoid sending empty URL slices to the worklistdemo
2026-05-23feat: add diagnostics to prove code is buggydemo
2026-05-23docs: add package godocdemo
2026-05-23docs: expound help string for -max argumentdemo
2026-05-23fix: check *maxURLs > 0 casedemo
2026-05-23feat: add maxURLs CLI flagdemo
I've also added some more input sanitization.
2026-05-23feat: implement cancellationdemo
I've also added 1., 2., etc. to the printed list of URLs.
2026-05-23feat: add semaphore to throttle concurrent GET requestsdemo
2026-05-23refactor: remove intermediate variabledemo
2026-05-23docs: add comment for claritydemo
2026-05-23feat: implement simple BFS webcrawlerdemo
2026-05-23feat: create empty main.godemo