When i scrape this URL locally - it works all fine.
When i scrape it from SH - it returns unreadable source code.
How do I fix it?
Best Answer
n
nestor
said
about 4 years ago
It's gzipped content. I can't reproduce it. If it works locally, make sure that your environment matches the one you deploy on Scrapy Cloud via stacks.
1 Comment
nestor
said
about 4 years ago
Answer
It's gzipped content. I can't reproduce it. If it works locally, make sure that your environment matches the one you deploy on Scrapy Cloud via stacks.
Billy John
When i scrape this URL locally - it works all fine.
When i scrape it from SH - it returns unreadable source code.
How do I fix it?
It's gzipped content. I can't reproduce it. If it works locally, make sure that your environment matches the one you deploy on Scrapy Cloud via stacks.
nestor
It's gzipped content. I can't reproduce it. If it works locally, make sure that your environment matches the one you deploy on Scrapy Cloud via stacks.
-
Unable to select Scrapy project in GitHub
-
ScrapyCloud can't call spider?
-
Unhandled error in Deferred
-
Item API - Filtering
-
newbie to web scraping but need data from zillow
-
ValueError: Invalid control character
-
Cancelling account
-
Best Practices
-
Beautifulsoup with ScrapingHub
-
Delete a project in ScrapingHub
See all 434 topics