gitea/geziyor
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Multiple Exporters and custom Exporters support added.

Browse Source
This commit is contained in:
Musab Gültekin
2019-06-11 16:10:49 +03:00
parent e4e8723426
commit 3790295658
5 changed files with 61 additions and 33 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -7,9 +7,9 @@ Geziyor is a blazing fast web crawling and web scraping framework, used to crawl
## Features
- 1.000+ Requests/Sec
- Caching (Memory/Disk)
- Automatic Data Exporting
- Automatic Data Exporting (JSON)
- Limit Concurrency (Global/Per Domain)
- Request Delays (Constant/Randomized)
- Request Delays (Constant/Randomized)
- Automatic response decoding to UTF-8
See scraper [Options](https://godoc.org/github.com/geziyor/geziyor#Options) for customization.