index
:
crawler
main
Asynchronous webcrawler in Python.
Brandon Irizarry
summary
refs
log
tree
commit
diff
log msg
author
committer
range
Age
Commit message (
Expand
)
Author
2026-04-17
refactor: wrap the fetching-task with the semaphore
HEAD
main
Brandon C. Irizarry
2026-04-16
chore: untrack description
Brandon C. Irizarry
2026-04-16
chore: add description for cgit
Brandon C. Irizarry
2026-04-16
feat: configure max_concurrency from the command line
Brandon C. Irizarry
2026-04-16
docs: add docstring to 'fetch'
Brandon C. Irizarry
2026-04-16
feat: use a semaphore to limit how many tasks make requests
Brandon C. Irizarry
2026-04-16
feat: use taskgroup + flush printing of '.' + catch timeouterror
Brandon C. Irizarry
2026-04-16
feat: use full concurrency (no semaphores)
Brandon C. Irizarry
2026-04-16
feat: add a timeout for sites that don't respond
Brandon C. Irizarry
2026-04-16
feat: ping sites sequentially and measure how long it takes
Brandon C. Irizarry
2026-04-16
docs: improve docstring
Brandon C. Irizarry
2026-04-16
chore: install aiohttp
Brandon C. Irizarry
2026-04-16
feat: read N URLs via command-line parameter from CSV file
Brandon C. Irizarry
2026-04-16
chore: start project
Brandon C. Irizarry