Zyte Support Center

Note: Portia is no longer available for new users. It has been disabled for all the new organisations from August 20, 2018 onward. You’ve gone through the...

⚠ Note: this is an advanced feature in beta stage. Use with care. Scrapy Cloud runs your spiders in Docker containers and allows you to build custom images...

While deploying custom Docker images to Scrapy Cloud there're some known issues. We are actively working on getting it resolved, but until it's comp...

With the job console you can open a Unix shell directly into the container where your job is running. Once in the console, you can perform tasks such as: ...

This article presents some approaches on how to use private dependencies in your Scrapy Cloud project. Using requirements.txt Let's assume your ...

In the Job page you will find the Fields box, which is also available in the items browser (but hidden by default). It looks like this: The Fields ...

Shub assigns a version number to your project every time you make a deploy to  Zyte Developer Tool Scrapy Cloud. The version assigned depends on whether you...

In some occasions you may experience errors using DeltaFetch due the interactions with files in S3. Your output may show errors like this: DBRunReco...

Make use of Scrapy's standard HttpProxyMiddleware by specifying proxy meta value and the autherization header in a Scrapy Request, for example: impo...

NOT TO BE CONFUSED WITH THE DELTAFETCH AND DOTSCRAPY PERSISTENCE ADDONS The purpose of this is to avoid requesting pages that have already scraped items...