88f37ecc2d
备份
2024-09-05 18:16:17 +08:00
688c516c9f
初始化
2024-09-04 16:48:42 +08:00
229b8ca83a
Merge pull request #76 from melroy89/update_deps
...
Update go mods/sum + add mod test json files to ignore list
2024-08-12 09:15:56 +03:00
3a0e16934e
Update go mods/sum add mod test json files to ignore list
2024-08-11 21:43:29 +02:00
a242b58aaa
Merge pull request #64 from geziyor/dependabot/go_modules/golang.org/x/text-0.3.8
...
Bump golang.org/x/text from 0.3.7 to 0.3.8
2023-03-15 16:51:10 +03:00
00c8fa909c
Merge pull request #66 from Gnoale/header
...
fix header nil map assignment used in GetRendered
2023-03-15 16:50:19 +03:00
89c5699cfa
fix header nil map assignment
2023-03-15 11:07:23 +01:00
6b9a390735
Bump golang.org/x/text from 0.3.7 to 0.3.8
...
Bumps [golang.org/x/text](https://github.com/golang/text ) from 0.3.7 to 0.3.8.
- [Release notes](https://github.com/golang/text/releases )
- [Commits](https://github.com/golang/text/compare/v0.3.7...v0.3.8 )
---
updated-dependencies:
- dependency-name: golang.org/x/text
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
2023-02-23 09:30:35 +00:00
555cdee597
Merge pull request #62 from cristoper/patch-1
...
PrettyPrint should conform to Exporter interface
2023-02-20 13:14:02 -05:00
9a6a7617b4
PrettyPrint should conform to Exporter interface
...
`(*PrettyPrint) Export()` needs to return error in order to conform to the `Exporter` interface and be used as an exporter. Without this change, trying to use the PrettyPrint exporter results in this compile error:
cannot use &export.PrettyPrint{} (value of type *export.PrettyPrint) as type export.Exporter in array or slice literal:
*export.PrettyPrint does not implement export.Exporter (wrong type for Export method)
have Export(exports chan interface{})
want Export(exports chan interface{}) error
2023-02-18 13:02:57 -07:00
7349b81754
Merge pull request #58 from glaslos/fix_test
...
More DeepSource fixes
2022-12-23 19:32:47 +03:00
d9ac07754f
more fixes
2022-12-23 16:00:48 +01:00
6d8cc07ce8
Merge pull request #57 from glaslos/fix_test
...
fix test/code validation issues
2022-12-23 17:58:09 +03:00
85d73be641
fix test/code validation issues
2022-12-23 15:51:54 +01:00
738852f932
Add custom actions for rendered requests & Fix not closing bug
2022-04-29 03:05:31 +03:00
34d17a2d3d
Merge pull request #44 from harnnless/patch-1
...
Fix HTTP2 support fix #43
2021-12-11 14:04:10 +03:00
b0fd08c670
Fix HTTP2 support
2021-12-11 18:05:17 +08:00
369b42cbc6
Merge pull request #39 from Walker088/wrap_post_method_support
...
Feature: Implement Geziyor.Post which wraps the httpClient (POST)
2021-10-21 22:19:25 +03:00
88238010b2
fix: DeepSource, Unused parameter detected in function
2021-10-21 09:40:09 -03:00
b1e4683037
Feature: Implement Geziyor.Post which wraps the httpClient(POST)
...
1. Implement Geziyor.Post by the same style of Geziyor.Head
2. Add two examples in geziyor_test (TestPostJson, TestPostFormUrlEncoded)
issue #38
2021-10-21 09:06:34 -03:00
6415a775f4
Fix exporter bug
2021-10-14 21:54:46 +03:00
b8bda36f92
JoinURL deprecated
2021-10-05 22:13:00 +03:00
019fe62883
Merge pull request #37 from geziyor/proxy-support
...
Proxy Support
2021-10-05 21:59:10 +03:00
97ecb7f118
Proxy support
2021-09-24 16:15:20 +03:00
110394a753
Add .deepsource.toml
2021-08-30 18:29:32 +00:00
242b025c9a
Set cookie test
2021-08-08 22:08:47 +03:00
53a91d63d6
Merge pull request #29 from albertbronsky/fix-remote-allocator
...
fixed empty context in call to NewRemoteAllocator
2021-08-08 21:56:27 +03:00
fc67cec165
Update chromedp
2021-08-08 21:29:08 +03:00
f73f83e493
fixed empty context in call to NewRemoteAllocator
2021-08-08 14:07:08 +03:00
d3bdaf6240
Added documentation and tests for request.Meta
2021-05-30 10:43:54 +03:00
a2a91b7b2e
Default allocator options are used on rendered scraping. It can be changed using custom Client or changing client options after scraper creation.
2021-05-23 23:48:55 +03:00
5aa2c2540e
Default client function moved to client_test.go as its only used there.
2021-05-23 23:47:43 +03:00
f35d34bc02
chromedp library updated.
2021-05-23 23:14:47 +03:00
16265e524d
Response.JoinURL simplified.
2021-05-18 13:31:23 +03:00
3c9a3849e2
Start command now waits for synchronized requests too. This fixes if requests are made using different goroutines with synchronized requests.
...
It doesn't cause any issues on concurrent requests because we already wait for them.
2021-04-19 12:58:47 +03:00
d28beca57a
Fix race condition on hosts semaphore
2021-04-17 14:46:45 +03:00
c527d0b885
SIGINT (interrupt) signal receiving refactored and fixed working on some conditions
2021-04-17 14:11:17 +03:00
6a23efd175
JoinURL now returns *url.URL and error
2021-04-17 11:12:22 +03:00
9ea67b3554
Use fmt.Errorf instead of errors package. This is good convention after go 1.13
2021-04-17 11:11:29 +03:00
fbee722a38
Rate limiting per second implemented
2021-04-16 15:31:31 +03:00
d8252092f7
Add duplicate_requests_test.go
2021-04-16 14:43:42 +03:00
be4d13c0ef
Retry checking refactored using util function.
2021-04-14 09:32:42 +03:00
46c4db6b1a
Exporters now need to return error. This is done because of simple error logging.
2021-04-14 09:30:17 +03:00
e3d79e2574
Added custom logger. Right now, not configurable.
2021-04-13 23:36:42 +03:00
129402d754
Updated chromedp
2021-01-28 20:50:25 +03:00
9b266b6cce
Allocator options added
2021-01-28 20:49:01 +03:00
29c29235ae
Fixed response error if retrying disabled
2020-09-05 17:24:22 +03:00
7a76a9b95e
Allocators seperated for transparency. Updated chrome library.
2020-09-05 16:14:41 +03:00
cfb16fe1ee
Call ErrorFunc on errors. Unexport DoRequestClient and DoRequestChrome
2019-12-13 00:03:44 +03:00
7d2fe57bab
Added error logging for HTML parser.
2019-12-11 13:55:38 +03:00
