The Scrapy Cloud command line client is called shub . It allows you to deploy projects (and dependencies), run spiders, retrieve scraped data and watch logs, all without leaving the command line.


If you have pip installed on your system, you can install shub from the Python Package Index by simply running:


pip install shub


We also supply standalone binaries for Windows, MacOS and Linux. You can find them in our latest GitHub release.


The full documentation is available here: https://shub.readthedocs.io/en/latest/