Start a new topic

Deploying with python packages in local folders

I am trying to deploy to scrapinghub with python packages in local folders. My folder structure is like so:
| scrapinghub.yml
| requirements.txt
| myscraper
| dependencies
| - mydependency
| - - setup.py
| - - requirements.txt
| - mydependency2
| - - setup.py
| - - requirements.txt


My requirements.txt looks like so:

  

pyyaml==5.1.2
-e dependencies/mydependency
-e dependencies/mydependency2
google-api-python-client==1.7.11
sqlalchemy==1.3.10
scrapy==1.7.3 

  I receive the following error when deploying:
"ERROR: dependencies/mydependency should either be a path to a local project or a VCS url"


As far as I can tell, all the folders are in the correct places. Is this a known issue when deploying with shub?

Login to post a comment