Scrapy Cloud FAQ

Why do I get "Rejected message because it was too big" error?
There's a limit of 1MB for serialised items in Scrapy Cloud (this includes log and request entries). Data pre-processing/normalising is recommended befo...
Wed, 3 Feb, 2021 at 8:28 AM
I clicked on STOP button but spider not stopped.
You can cancel a Running job by selecting the job and clicking on STOP button. It may take about 5 minutes to stop the job completely so as that all the req...
Wed, 3 Feb, 2021 at 8:31 AM
Can I run the same spider in parallel?
You can, provided that you have more than one Scrapy Cloud unit and the spider's arguments differ (entered, for instance, through Arguments section of t...
Wed, 3 Feb, 2021 at 8:31 AM
Lack of advanced features when exporting items data in CSV format.
You can download scraped items data from Scrapy Cloud in various formats like JSON, JSON Lines, CSV and XML. Despite CSV format is pretty old and limited, ...
Wed, 3 Feb, 2021 at 8:31 AM
How to reactivate deleted account?
Use the forgot password to reactivate deleted account, an email will be sent to that address if an account is already registered against that email address....
Wed, 3 Feb, 2021 at 8:32 AM
Can I connect to a GitHub account that has a different email?
Unfortunately, you can't. Your Zyte and GitHub accounts should use the same email address in order to be connected.
Wed, 3 Feb, 2021 at 8:32 AM
Spider not updating from Github
The issue happens because of build folder is committed to Github, along with some other redundant files, which worked as a cache system on the deploy step. ...
Wed, 3 Feb, 2021 at 8:32 AM
Why do I still see jobs older than a day after setting the project's data retention period to one day?
The job data remains available to ensure it can be restored if needed. The jobs will be marked as deleted, but not removed immediately for this very reason ...
Wed, 3 Feb, 2021 at 8:33 AM
Is it possible to schedule jobs to run sequentially?
It can be implemented by combining Scrapy Signals with a job scheduling API call (see Jobs API and Scrapinghub's Python client). The idea is to catch th...
Wed, 3 Feb, 2021 at 8:34 AM
How to change password of Zyte Account
If you have forgotten your password for Zyte Account and you do not have access to your account; then you need to go to https://app.zyte.com/account/login/ ...
Thu, 11 Feb, 2021 at 10:23 PM