| Branch | Commit message | Author | Age | |
|---|---|---|---|---|
| main | refactor: wrap the fetching-task with the semaphore | Brandon C. Irizarry | 7 weeks | |
| Age | Commit message | Author | ||
| 2026-04-17 | refactor: wrap the fetching-task with the semaphoreHEADmain | Brandon C. Irizarry | ||
| 2026-04-16 | chore: untrack description | Brandon C. Irizarry | ||
| 2026-04-16 | chore: add description for cgit | Brandon C. Irizarry | ||
| 2026-04-16 | feat: configure max_concurrency from the command line | Brandon C. Irizarry | ||
| 2026-04-16 | docs: add docstring to 'fetch' | Brandon C. Irizarry | ||
| 2026-04-16 | feat: use a semaphore to limit how many tasks make requests | Brandon C. Irizarry | ||
| 2026-04-16 | feat: use taskgroup + flush printing of '.' + catch timeouterror | Brandon C. Irizarry | ||
| 2026-04-16 | feat: use full concurrency (no semaphores) | Brandon C. Irizarry | ||
| 2026-04-16 | feat: add a timeout for sites that don't respond | Brandon C. Irizarry | ||
| 2026-04-16 | feat: ping sites sequentially and measure how long it takes | Brandon C. Irizarry | ||
| [...] | ||||
| Clone | ||||
| https://git.brandonirizarry.xyz/crawler | ||||
 |
index : crawler | |
| Asynchronous webcrawler in Python. | Brandon Irizarry |
| summaryrefslogtreecommitdiff |