Scrapy: Arbitrary Module Import via Referrer-Policy Header in RefererMiddleware
scrapy
Affected versions
| Product | Affected | Fixed in |
|---|---|---|
| scrapy PyPI |
|
|
Original description
Scrapy is a high-level web crawling and scraping framework for Python. From 1.4.0 until 2.14.2, RefererMiddleware in scrapy/spidermiddlewares/referer.py treated a Referrer-Policy response-header value that resembled a Python import path as a referrer policy class, imported the referenced object, and called it. A malicious website could supply a callable such as sys.exit and terminate a crawler processing the response. This issue is fixed in version 2.14.2.
From the CVE record · GitHub_M