urls/main.go, branch master Web crawler in Go. https://git.brandonirizarry.xyz/urls/atom?h=master 2026-05-31T03:04:48Z feat: upgrade hamlet and use newer stuff from there 2026-05-31T03:04:48Z demo demo@antix1 2026-05-31T03:04:48Z urn:sha1:462ca98bd6751ab91a8967a99f98f9553c48e7fd feat: use hamlet package to simplify command-line arguments 2026-05-31T02:43:19Z demo demo@antix1 2026-05-31T02:43:19Z urn:sha1:4f7d3203e44fca492aadb075d03b8b90b99c66c8 feat: specify whether URL sources are both missing or both present 2026-05-28T21:32:07Z demo demo@antix1 2026-05-28T21:32:07Z urn:sha1:73f0ff9f11ff5f75a92adc5cd59f87b6fb019150 feat: implement shortcode feature 2026-05-28T21:28:59Z demo demo@antix1 2026-05-28T21:28:59Z urn:sha1:848481fd1a738225664fa398275fcd1afd61c4ff refactor: move initial URL parsing into function 'convertToURL' 2026-05-28T20:58:21Z demo demo@antix1 2026-05-28T20:58:21Z urn:sha1:0d7056446009f38ea44249f2f74ab70b05410cfb docs: add some comments 2026-05-28T20:41:53Z demo demo@antix1 2026-05-28T20:41:53Z urn:sha1:0d4e903fef12b5ed7d79cc097f3b18d2869ada29 feat: check for missing https:// 2026-05-28T17:09:06Z demo demo@antix1 2026-05-28T17:09:06Z urn:sha1:0a4d96a5e9c49241bac81b20f5ceb91a2f8d1537 This isn't as easy as modifying the parsed URL after the fact. This Stack Overflow post has some hints: https://stackoverflow.com/q/46719948/4570292 docs: add comment explaining purpose of log.Lshortfile 2026-05-28T15:53:07Z demo demo@antix1 2026-05-28T15:53:07Z urn:sha1:8d3bf78303a42fdf7289c6e1896e3d3f7e9b1cb7 chore: include shortfile printout in log invocations 2026-05-28T15:35:25Z demo demo@antix1 2026-05-28T15:35:25Z urn:sha1:6867410a6b30ec4a3d96f2438b202add8519c959 feat: configure maxDepth from the command line 2026-05-27T16:18:56Z demo demo@antix1 2026-05-27T16:18:56Z urn:sha1:a939f6c8ea4e7d493aa282403e1f39a12604484d Similar to maxURLs, a maxDepth of zero means no limit.