Skip to content

Pull requests: scrapy/scrapy

New pull request New
213 Open 4,313 Closed
213 Open 4,313 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Offer an unhandled exception to each process_spider_exception method only once
#7996 opened Aug 13, 2026 by AdrianAtZyte Contributor • Draft
2
Add a schemes parameter to LinkExtractor, and extract data: and s3: links by default
#7994 opened Aug 13, 2026 by AdrianAtZyte Contributor • Draft
1
1
Run errback output through the spider middlewares on download errors
#7992 opened Aug 12, 2026 by AdrianAtZyte Contributor Loading…
1
2
Report crawl errors in scrapy check
#7991 opened Aug 12, 2026 by AdrianAtZyte Contributor Loading…
1
2
Complete coverage for H2DownloadHandler
#7990 opened Aug 12, 2026 by AdrianAtZyte Contributor Loading…
1
2
Handle data loss in HTTP/2 responses
#7989 opened Aug 12, 2026 by AdrianAtZyte Contributor Loading…
1
2
Allow downloading response bodies into files
#7987 opened Aug 12, 2026 by AdrianAtZyte Contributor Loading…
1
2
Add sessions
#7984 opened Aug 12, 2026 by AdrianAtZyte Contributor Loading…
1
2
Document how to prioritize the body-declared encoding
#7977 opened Aug 10, 2026 by AdrianAtZyte Contributor Loading…
1
1
Use the json selector type for JsonResponse
#7972 opened Aug 10, 2026 by AdrianAtZyte Contributor Loading… Scrapy 2.18
1
2
Scrapy 2.18
#7969 opened Aug 10, 2026 by AdrianAtZyte Contributor • Draft Scrapy 2.18
5
Type spider-related test modules
#7968 opened Aug 10, 2026 by AdrianAtZyte Contributor Loading…
3
Do not fail to disable a component with an unimportable path
#7967 opened Aug 10, 2026 by mhassan824 Loading…
1
3
Add HTTPCACHE_SCOPE to allow sharing the HTTP cache across spiders
#7964 opened Aug 9, 2026 by AdrianAtZyte Contributor Loading…
1
2
Start item-processing workers on demand instead of one per CONCURRENT_ITEMS
#7959 opened Aug 9, 2026 by AdrianAtZyte Contributor Loading…
1
2
Do not run item pipelines or feed exports on scrapy check
#7957 opened Aug 9, 2026 by AdrianAtZyte Contributor Loading…
1
2
Document @inthread (#6552)
#7956 opened Aug 8, 2026 by kelly-su Loading…
1
3
Add DiskDupeFilter, a disk-backed duplicate request filter
#7952 opened Aug 8, 2026 by AdrianAtZyte Contributor • Draft
1
2
Make the media pipeline checksum algorithm configurable
#7951 opened Aug 8, 2026 by AdrianAtZyte Contributor Loading…
2
Add ChecksumMiddleware to verify response bodies against expected checksums
#7950 opened Aug 8, 2026 by AdrianAtZyte Contributor Loading…
1
2
Add a cookie domain scenario matrix
#7949 opened Aug 8, 2026 by AdrianAtZyte Contributor Loading…
1
Add SSLKEYLOGFILE support
#7948 opened Aug 8, 2026 by AdrianAtZyte Contributor Loading… Scrapy 2.18
1
2
Honor user-set Content-Length request headers on HTTP/2
#7944 opened Aug 8, 2026 by AdrianAtZyte Contributor Loading…
1
2
Store bytes request fingerprints in RFPDupeFilter
#7943 opened Aug 8, 2026 by AdrianAtZyte Contributor Loading…
1
2
Replace PyDispatcher with blinker
#7942 opened Aug 8, 2026 by AdrianAtZyte Contributor Loading…
2
2
ProTip! Mix and match filters to narrow down what you’re looking for.