gitea/geziyor
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Request delays support added

Browse Source
This commit is contained in:
Musab Gültekin
2019-06-09 14:24:53 +03:00
parent 2263108838
commit b973c1c064
4 changed files with 32 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -8,7 +8,8 @@ Geziyor is a blazing fast web crawling and web scraping framework, used to crawl
- 1.000+ Requests/Sec
- Caching (Memory/Disk)
- Automatic Data Exporting
- Limit Concurrency Global/Per Domain
- Limit Concurrency (Global/Per Domain)
- Request Delays (Constant/Randomized)
- Automatic response decoding to UTF-8