urls/xml.go, branch masterWeb crawler in Go.
https://git.brandonirizarry.xyz/urls/atom?h=master2026-05-28T17:32:59Zfeat: add "total entries" as part of XML comment2026-05-28T17:32:59Zdemodemo@antix12026-05-28T17:31:49Zurn:sha1:138d431695c22927f1b5ab76486390960f5cbb3c
This is useful mostly in the context of maxURLs=∞, but perhaps it
could also help catch some error cases.
feat: prettify stats when figure was passed in as 02026-05-28T17:25:42Zdemodemo@antix12026-05-28T17:25:42Zurn:sha1:eae74f26ada313c15057013a1df6b81b50d94a90
The code understands 0 as "no limit", but I want to convey the
no-limit concept to readers of the file who don't have a notion of how
the program works. So I convert 0 to ∞ in the string output here.
feat: place comment before URL listing2026-05-28T17:21:31Zdemodemo@antix12026-05-28T17:21:31Zurn:sha1:c679e48964a6fa2bc2bc54fa6541c113e41ca672
There could be a lot of URLs, so this should be more user-friendly.
feat: add comment logging maxDepth and maxURLs inside xml output2026-05-28T17:20:30Zdemodemo@antix12026-05-28T17:20:30Zurn:sha1:6b39b2b04e037b809537ec2b6209b62b114dceaffeat: add header to xml output2026-05-28T16:35:35Zdemodemo@antix12026-05-28T16:35:35Zurn:sha1:c2f1c9a6eb8230e8fffd633d1f85cde80764c5b3wip: generate rough draft of sitemap2026-05-28T16:33:41Zdemodemo@antix12026-05-28T16:33:41Zurn:sha1:10ddae559ad28e21c7e1db99d29312907ce2c70f