Dependency issue "requirement.txt" with "package_data" in setup.py

Posted about 7 years ago by Arnau Pont Vílchez

Post a topic

Answered

Arnau Pont Vílchez

I want to deploy a non-code file located at "myproject/resources/FILE.txt" folder. It works perfectly setting up the "setup.py" file, considering following link instructions:
"https://support.scrapinghub.com/support/solutions/articles/22000200416-deploying-non-code-files".

The problem appears when I also want to deploy Python dependencies following this link: https://support.scrapinghub.com/support/solutions/articles/22000200400-deploying-python-dependencies-for-your-projects-in-scrapy-cloud

When new Python dependencies are deployed, "myproject/resources/FILE.txt" is not detected, whereas the contrary is true when Python dependencies are not included. How is it possible? Should I update the "requirements" or "setup" file?

Please, let me know!

0 Votes

Arnau Pont Vílchez posted about 7 years ago Best Answer

Finally, I included the "FILE.txt" information inside the spider source file as a dictionary. That's how I fixed it!

0 Votes

3 Comments

Arnau Pont Vílchez posted about 7 years ago Answer

Finally, I included the "FILE.txt" information inside the spider source file as a dictionary. That's how I fixed it!

0 Votes

nestor posted about 7 years ago Admin

I can see you deployed successfully so I assume you figured this out.

0 Votes

nestor posted about 7 years ago Admin

Please post the contents of your setup.py, your scrapinghub.yml and requirements.txt files

0 Votes