Added response joinURL test and updated chromedp.

This commit is contained in:
Musab Gültekin
2019-09-13 14:34:29 +03:00
parent 3264057679
commit 9b8a3837bd
5 changed files with 24 additions and 13 deletions

View File

@@ -162,14 +162,3 @@ BenchmarkRequests-8 200000 108710 ns/op
PASS
ok github.com/geziyor/geziyor 22.861s
```
## Roadmap
If you're interested in helping this project, please consider these features:
- Command line tool for: pausing and resuming scraper etc. (like [this](https://docs.scrapy.org/en/latest/topics/commands.html))
- ~~Automatically exporting extracted data to multiple places (AWS, FTP, DB, JSON, CSV etc)~~
- Downloading media (Images, Videos etc) (like [this](https://docs.scrapy.org/en/latest/topics/media-pipeline.html))
- ~~Realtime metrics (Prometheus etc.)~~