You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For Zyte API requests with httpResponseHeader=True, some websites would return headers like Content-Encoding: gzip.
In the current setup, all of the headers in the httpResponseHeader from Zyte API response is used to create the Response in the Download Handler.
Now, when the response containing the Content-Encoding: gzip header is processed by the Downloader Middlewares, the scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware errors out since it's attempting to decompress the gzipped response.
This is not the case since Zyte API already decompressed the contents.