Start a new topic

Deploying Private Dependencies to Scrapy Cloud.

I am deploying my app to scrapy cloud using docker. In my docker file, I asked it to install from the requirements.txt file.

On the requirements.txt file, I have appended it with --index-url https://pypi.org/simple/ and --extra-index-url https://user:pass@gitlab.com/api/v4/projects/project_id/packages/pypi/simple

at the beginning of the file. When I removed the private dependencies, and the extra-index-url, everything seems fine.

I read this article where there is a link to deploying private dependencies, but the link referenced in it is dead.

https://support.zyte.com/support/solutions/articles/22000200400-deploying-project-dependencies-into-scrapy-cloud


I got the error 

Error The command '/bin/sh -c pip install --no-cache-dir -r requirements.txt' returned a non-zero code: 1: {'code': 1, 'message': "The command '/bin/sh -c pip install --no-cache-dir -r requirements.txt' returned a non-zero code: 1"}


I have used the private dependencies in other projects without issues.


Login to post a comment