Middlewares refactored to multiple files in middleware package.

Extractors removed as they introduce complexity to scraper. Both in learning and developing.
2019-07-04 21:04:29 +03:00
parent 9adff75509
commit 2cab68d2ce
19 changed files with 202 additions and 304 deletions
--- a/export/export.go
+++ b/export/export.go
@@ -1,7 +1,6 @@
 package export

 // Exporter interface is for extracting data to external resources.
-// Geziyor calls every extractors Export functions before any scraping starts.
 // Export functions should wait for new data from exports chan.
 type Exporter interface {
 	Export(exports chan interface{})