Zyte Support Center

The environment where your spiders run on Scrapy Cloud brings a set of pre-installed packages. However, sometimes you'll need some extra packages that m...

Since March 2020 all new projects on Scrapy Cloud will use a Scrapy Stack that runs on top of Python 3 by default. If you existing project is still runn...

You need to declare the files in the package_data  section of your setup.py  file. For example, if your Scrapy project has the following structure: ...

You can select the runtime environment for your spiders from a list of pre-defined stacks. Each stack is a runtime environment containing certain versions o...

In addition to Scrapy spiders, you can also run custom, standalone python scripts on Scrapy Cloud. They need to be declared in the scripts section of your p...

In order to store your items in an S3 account provided by AWS, you need to enable certain Scrapy settings in Scrapy Cloud. First, go to your Spider sett...

If you need to provide data to a spider within a given project, you can use the API, or the python-scrapinghub library to store the data in collections. ...

The Scrapy Cloud API (often also referred as the Zyte API) is a HTTP API that you can use to control your spiders and consume the scraped data, among other ...

To get the scraped items, you can use the Items API. In some cases, it's convenient to have a static URL that points to the last job, in a specific for...

The job outcome indicates whether the job succeeded or failed. By default, it contains the value of the spider close reason from Scrapy. It’s available in t...