Skip to content

Pull requests: webrecorder/browsertrix-crawler

New pull request New
9 Open 487 Closed
9 Open 487 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: Skip proxy for seed file downloads in Self-Hosting environments
#907 opened Nov 5, 2025 by Percivalll Loading…
Dedup Initial Implementation
#889 opened Oct 1, 2025 by ikreymer • Draft
1
5
Add option to respect robots.txt disallows
#888 opened Sep 30, 2025 by tw4l Loading…
1
feat: add extraChromeArgs support for passing custom Chrome flags
#877 opened Aug 13, 2025 by aponb Loading…
6
Check page URLs for extension before direct fetch attempt
#830 opened May 6, 2025 by ikreymer Loading…
1
3
Improved handling of SSO-based crawling
#828 opened May 5, 2025 by ikreymer Loading…
replace minio client with aws sdk
#547 opened Apr 16, 2024 by mguella Loading…
2
Add cookie popup blocking via adblock-rs
#187 opened Nov 16, 2022 by tw4l • Draft
Integrate Mozilla's Readibility.js
#42 opened Apr 14, 2021 by sebastian-nagel Loading…
7
ProTip! What’s not been updated in a month: updated:<2025-10-05.