Controlling your spiders via the command line client

Modified on Wed, 3 Feb, 2021 at 6:31 AM

The Scrapy Cloud command line client is called shub . It allows you to deploy projects (and dependencies), run spiders, retrieve scraped data and watch logs, all without leaving the command line.


If you have pip installed on your system, you can install shub from the Python Package Index by simply running:


pip install shub


We also supply standalone binaries for Windows, MacOS and Linux. You can find them in our latest GitHub release.


The full documentation is available here: https://shub.readthedocs.io/en/latest/

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article