fix(deps): update module github.com/gocolly/colly/v2 to v2.2.0
#102
Merged
group_2759636_bot_1c34751f7eccad09e089ac15ee7bd902
merged 1 commits from renovate/github.com-gocolly-colly-v2-2.x into master2025-03-27 16:12:39 +00:00
This MR contains the following updates:
| Package | Type | Update | Change |
|---|---|---|---|
| [github.com/gocolly/colly/v2](https://github.com/gocolly/colly) | require | minor | `v2.1.0` -> `v2.2.0` |
---
### Release Notes
<details>
<summary>gocolly/colly (github.com/gocolly/colly/v2)</summary>
### [`v2.2.0`](https://github.com/gocolly/colly/releases/tag/v2.2.0)
[Compare Source](https://github.com/gocolly/colly/compare/v2.1.0...v2.2.0)
Tons of bug fixes & little improvements & updated dependencies
#### What's Changed
- Added new project that uses Colly by [@​twiny](https://github.com/twiny) in https://github.com/gocolly/colly/pull/525
- adding docker-slim to the list of open source projects using Colly by [@​kcq](https://github.com/kcq) in https://github.com/gocolly/colly/pull/526
- update coursera example by [@​ysung6](https://github.com/ysung6) in https://github.com/gocolly/colly/pull/537
- Update openedx_courses.go by [@​lingt-xyz](https://github.com/lingt-xyz) in https://github.com/gocolly/colly/pull/539
- feat: support Stop() in queue by [@​PalanQu](https://github.com/PalanQu) in https://github.com/gocolly/colly/pull/531
- Fix invalid base URL assignment by [@​dasshield](https://github.com/dasshield) in https://github.com/gocolly/colly/pull/549
- Add context.Context support by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/548
- Fix handling of redirected URLs in OnResponseHeaders by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/561
- Fix race on count fields of Collector type by [@​shubham14bajpai](https://github.com/shubham14bajpai) in https://github.com/gocolly/colly/pull/563
- SetProxyFunc: fix proxies rotation by [@​wowinter13](https://github.com/wowinter13) in https://github.com/gocolly/colly/pull/567
- Update xkcd_store.go by [@​BigManing](https://github.com/BigManing) in https://github.com/gocolly/colly/pull/570
- Updated xmlquery to close a known security vulnerability by [@​ijomeli](https://github.com/ijomeli) in https://github.com/gocolly/colly/pull/582
- Fix default User-Agent when using custom headers by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/592
- Update openedx_courses.go by [@​BigManing](https://github.com/BigManing) in https://github.com/gocolly/colly/pull/576
- Add httpBackend cache response callback by [@​slashapp](https://github.com/slashapp) in https://github.com/gocolly/colly/pull/574
- Update README.md by [@​seversky](https://github.com/seversky) in https://github.com/gocolly/colly/pull/595
- Change the type assersion for Attr by [@​moritamori](https://github.com/moritamori) in https://github.com/gocolly/colly/pull/588
- Update User-Agent strings for Desktop by [@​guessi](https://github.com/guessi) in https://github.com/gocolly/colly/pull/605
- add quote crawler using colly by [@​eval-exec](https://github.com/eval-exec) in https://github.com/gocolly/colly/pull/603
- Fix golint issues by [@​waltton](https://github.com/waltton) in https://github.com/gocolly/colly/pull/620
- Replace Travis with GitHub Actions by [@​alexhraber](https://github.com/alexhraber) in https://github.com/gocolly/colly/pull/669
- Use github.com/nlnwa/whatwg-url for URL parsing by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/673
- Fix Async ignoring its arguments by [@​ljbink](https://github.com/ljbink) in https://github.com/gocolly/colly/pull/652
- fix: generated code has compile error by [@​darjun](https://github.com/darjun) in https://github.com/gocolly/colly/pull/629
- moving filterings to one function (checkFilters) and use it in case of redirect too by [@​joelazar](https://github.com/joelazar) in https://github.com/gocolly/colly/pull/638
- Fix Contributing.md link by [@​SaladinoBelisario](https://github.com/SaladinoBelisario) in https://github.com/gocolly/colly/pull/641
- Work around invalid URL encoding in path by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/675
- Host & Custom Header Support by [@​ErikOwen](https://github.com/ErikOwen) in https://github.com/gocolly/colly/pull/691
- Code cleanup by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/678
- Add GitHub issue templates and nudge questions to Stack Overflow by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/702
- Fix redirects ignoring AllowURLRevisit=false by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/681
- Bump whatwg-url version by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/713
- fix some typos by [@​cuishuang](https://github.com/cuishuang) in https://github.com/gocolly/colly/pull/736
- feat: Add MaxRequests paramete by [@​guilhem](https://github.com/guilhem) in https://github.com/gocolly/colly/pull/722
- Update CI configuration by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/749
- upgrade Cascadia version by [@​kinoute](https://github.com/kinoute) in https://github.com/gocolly/colly/pull/650
- Bump golang.org/x/net from 0.0.0-20220114011407-0dd24b26b47d to 0.7.0 by [@​dependabot](https://github.com/dependabot) in https://github.com/gocolly/colly/pull/756
- Support websites redirecting to the same page when AllowURLRevisit is disabled by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/763
- Update User-Agent strings for 2023 by [@​guessi](https://github.com/guessi) in https://github.com/gocolly/colly/pull/765
- Fix data races by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/771
- Replaced deprecated io/ioutil package with proper implementations of … by [@​zachary-walters](https://github.com/zachary-walters) in https://github.com/gocolly/colly/pull/785
- Bump golang.org/x/net from 0.7.0 to 0.17.0 by [@​dependabot](https://github.com/dependabot) in https://github.com/gocolly/colly/pull/789
- put accept header before OnRequest by [@​k4lizen](https://github.com/k4lizen) in https://github.com/gocolly/colly/pull/786
- Fix Bug: retry scrape will lost POST requestData by [@​Shinku-Chen](https://github.com/Shinku-Chen) in https://github.com/gocolly/colly/pull/794
- scrapper -> scraper Update README.md by [@​ideabrian](https://github.com/ideabrian) in https://github.com/gocolly/colly/pull/809
- Test on Go 1.22, drop old versions by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/810
- Bump google.golang.org/protobuf from 1.24.0 to 1.33.0 by [@​dependabot](https://github.com/dependabot) in https://github.com/gocolly/colly/pull/807
- Implement content sniffing for HTML parsing by [@​WGH-](https://github.com/WGH-) in https://github.com/gocolly/colly/pull/808
- Add headers/ua to robots.txt request by [@​makew0rld](https://github.com/makew0rld) in https://github.com/gocolly/colly/pull/838
- doc: mention that OnScraped executes after OnHTML and OnXML by [@​aladmit](https://github.com/aladmit) in https://github.com/gocolly/colly/pull/832
#### New Contributors
- [@​twiny](https://github.com/twiny) made their first contribution in https://github.com/gocolly/colly/pull/525
- [@​kcq](https://github.com/kcq) made their first contribution in https://github.com/gocolly/colly/pull/526
- [@​ysung6](https://github.com/ysung6) made their first contribution in https://github.com/gocolly/colly/pull/537
- [@​lingt-xyz](https://github.com/lingt-xyz) made their first contribution in https://github.com/gocolly/colly/pull/539
- [@​PalanQu](https://github.com/PalanQu) made their first contribution in https://github.com/gocolly/colly/pull/531
- [@​dasshield](https://github.com/dasshield) made their first contribution in https://github.com/gocolly/colly/pull/549
- [@​shubham14bajpai](https://github.com/shubham14bajpai) made their first contribution in https://github.com/gocolly/colly/pull/563
- [@​wowinter13](https://github.com/wowinter13) made their first contribution in https://github.com/gocolly/colly/pull/567
- [@​BigManing](https://github.com/BigManing) made their first contribution in https://github.com/gocolly/colly/pull/570
- [@​ijomeli](https://github.com/ijomeli) made their first contribution in https://github.com/gocolly/colly/pull/582
- [@​slashapp](https://github.com/slashapp) made their first contribution in https://github.com/gocolly/colly/pull/574
- [@​seversky](https://github.com/seversky) made their first contribution in https://github.com/gocolly/colly/pull/595
- [@​moritamori](https://github.com/moritamori) made their first contribution in https://github.com/gocolly/colly/pull/588
- [@​guessi](https://github.com/guessi) made their first contribution in https://github.com/gocolly/colly/pull/605
- [@​eval-exec](https://github.com/eval-exec) made their first contribution in https://github.com/gocolly/colly/pull/603
- [@​waltton](https://github.com/waltton) made their first contribution in https://github.com/gocolly/colly/pull/620
- [@​alexhraber](https://github.com/alexhraber) made their first contribution in https://github.com/gocolly/colly/pull/669
- [@​ljbink](https://github.com/ljbink) made their first contribution in https://github.com/gocolly/colly/pull/652
- [@​darjun](https://github.com/darjun) made their first contribution in https://github.com/gocolly/colly/pull/629
- [@​joelazar](https://github.com/joelazar) made their first contribution in https://github.com/gocolly/colly/pull/638
- [@​SaladinoBelisario](https://github.com/SaladinoBelisario) made their first contribution in https://github.com/gocolly/colly/pull/641
- [@​ErikOwen](https://github.com/ErikOwen) made their first contribution in https://github.com/gocolly/colly/pull/691
- [@​cuishuang](https://github.com/cuishuang) made their first contribution in https://github.com/gocolly/colly/pull/736
- [@​guilhem](https://github.com/guilhem) made their first contribution in https://github.com/gocolly/colly/pull/722
- [@​kinoute](https://github.com/kinoute) made their first contribution in https://github.com/gocolly/colly/pull/650
- [@​dependabot](https://github.com/dependabot) made their first contribution in https://github.com/gocolly/colly/pull/756
- [@​zachary-walters](https://github.com/zachary-walters) made their first contribution in https://github.com/gocolly/colly/pull/785
- [@​k4lizen](https://github.com/k4lizen) made their first contribution in https://github.com/gocolly/colly/pull/786
- [@​Shinku-Chen](https://github.com/Shinku-Chen) made their first contribution in https://github.com/gocolly/colly/pull/794
- [@​ideabrian](https://github.com/ideabrian) made their first contribution in https://github.com/gocolly/colly/pull/809
- [@​makew0rld](https://github.com/makew0rld) made their first contribution in https://github.com/gocolly/colly/pull/838
- [@​aladmit](https://github.com/aladmit) made their first contribution in https://github.com/gocolly/colly/pull/832
**Full Changelog**: https://github.com/gocolly/colly/compare/v2.1.0...v2.2.0
</details>
---
### Configuration
📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied.
♻ **Rebasing**: Whenever MR is behind base branch, or you tick the rebase/retry checkbox.
🔕 **Ignore**: Close this MR and you won't be reminded about this update again.
---
- [ ] <!-- rebase-check -->If you want to rebase/retry this MR, check this box
---
This MR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOS4yMTkuMSIsInVwZGF0ZWRJblZlciI6IjM5LjIxOS4xIiwidGFyZ2V0QnJhbmNoIjoibWFzdGVyIiwibGFiZWxzIjpbXX0=-->
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
This MR contains the following updates:
v2.1.0->v2.2.0Release Notes
gocolly/colly (github.com/gocolly/colly/v2)
v2.2.0Compare Source
Tons of bug fixes & little improvements & updated dependencies
What's Changed
New Contributors
Full Changelog: https://github.com/gocolly/colly/compare/v2.1.0...v2.2.0
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever MR is behind base branch, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this MR and you won't be reminded about this update again.
This MR has been generated by Renovate Bot.
ℹ Artifact update notice
File name: go.mod
In order to perform the update(s) described in the table above, Renovate ran the
go getcommand, which resulted in the following additional change(s):godirective was updated for compatibility reasonsDetails:
go1.20->1.24.1github.com/PuerkitoBio/goqueryv1.5.1->v1.10.2github.com/andybalholm/cascadiav1.2.0->v1.3.3github.com/antchfx/htmlqueryv1.2.3->v1.3.4github.com/antchfx/xmlqueryv1.3.1->v1.4.4github.com/antchfx/xpathv1.1.10->v1.3.3github.com/golang/groupcachev0.0.0-20200121045136-8c9f03a8e57e->v0.0.0-20241129210726-2c02b8208cf8github.com/golang/protobufv1.4.2->v1.5.4github.com/saintfish/chardetv0.0.0-20120816061221-3af4cd4741ca->v0.0.0-20230101081208-5e3ef4b5456dgithub.com/temoto/robotstxtv1.1.1->v1.1.2golang.org/x/netv0.17.0->v0.37.0golang.org/x/textv0.13.0->v0.23.0google.golang.org/appenginev1.6.6->v1.6.8google.golang.org/protobufv1.24.0->v1.36.6mentioned in issue #3