| Branch | Commit message | Author | Age | |
|---|---|---|---|---|
| main | refactor: wrap the fetching-task with the semaphore | Brandon C. Irizarry | 36 hours | |
| Age | Commit message | Author | ||
| 36 hours | refactor: wrap the fetching-task with the semaphoreHEADmain | Brandon C. Irizarry | ||
| 3 days | chore: untrack description | Brandon C. Irizarry | ||
| 3 days | chore: add description for cgit | Brandon C. Irizarry | ||
| 3 days | feat: configure max_concurrency from the command line | Brandon C. Irizarry | ||
| 3 days | docs: add docstring to 'fetch' | Brandon C. Irizarry | ||
| 3 days | feat: use a semaphore to limit how many tasks make requests | Brandon C. Irizarry | ||
| 3 days | feat: use taskgroup + flush printing of '.' + catch timeouterror | Brandon C. Irizarry | ||
| 3 days | feat: use full concurrency (no semaphores) | Brandon C. Irizarry | ||
| 3 days | feat: add a timeout for sites that don't respond | Brandon C. Irizarry | ||
| 3 days | feat: ping sites sequentially and measure how long it takes | Brandon C. Irizarry | ||
| [...] | ||||
| Clone | ||||
| https://git.brandonirizarry.xyz/crawler | ||||
 |
index : crawler | |
| Asynchronous webcrawler in Python. | Brandon Irizarry |
| summaryrefslogtreecommitdiff |