fix(scrapy): stop silently dropping in-flight requests and redirects - #1097

Merged

vdusek merged 18 commits into

worktree-fix-b5-b6

Aug 25, 2026

Commits on Aug 21, 2026

Commits on Aug 25, 2026

docs(scrapy): apply review wording suggestion for migration section
vdusek
committed
95c03e0
Merge remote-tracking branch 'origin/master' into worktree-fix-b5-b6
vdusek
committed
3eb6ba2
fix(scrapy): stop same-URL derived requests from inheriting the parent's unique key
vdusek
committed
4ec5892
fix(scrapy): recover in-flight requests whose queue update fails after dispatch
vdusek
committed
7cd79e0
test(scrapy): guard every async thread test's close with try/finally
vdusek
committed
098d656
refactor(scrapy): use the RQ abbreviation and tighten the comments this PR added
vdusek
committed
ee0f86e
refactor(scrapy): alias the in-flight tuple and mock the async thread with Mock
vdusek
committed
5623562
test(scrapy): add E2E tests for redirects and in-flight requests
vdusek
committed
cc7c7c5
test(scrapy): replace the dead start_requests overrides with start in the E2E spiders
vdusek
committed
ee4eabc
test(scrapy): drop the deprecated spider argument from the E2E downloader middleware
vdusek
committed
62fbe9f
refactor(scrapy): replace casts in the request conversion with a checked HTTP method narrowing
vdusek
committed
4a61562
refactor(scrapy): validate Scrapy headers through HttpHeaders instead of a cast
vdusek
committed
bd76a7a
docs(scrapy): describe when the close() reclaim branch runs and generalize the prune comment
vdusek
committed
fb6a4ad