How to launch a large-scale web scraping project? Find out how LexisNexis did it. Join the webinar on 29th March.Register now
Start a new topic
Answered

Spider returns page with unreadable source code.

When i scrape this URL locally - it works all fine.

When i scrape it from SH - it returns unreadable source code.

How do I fix it?

image



Best Answer

It's gzipped content. I can't reproduce it. If it works locally, make sure that your environment matches the one you deploy on Scrapy Cloud via stacks.

1 Comment

Answer

It's gzipped content. I can't reproduce it. If it works locally, make sure that your environment matches the one you deploy on Scrapy Cloud via stacks.

Login to post a comment