Hi,
when I run my spider locally it runs without any problems. But on the scrapycloud I got the following error Message:
ImportError: No module named scrapy_user_agents.middlewares
Any idea what I have to change in my settings or code?
thanks.
Hi, You would need to add the library to your requirements.txt as shown here: https://support.scrapinghub.com/support/solutions/articles/22000200400-deploying-python-dependencies-for-your-projects-in-scrapy-cloud
I have the exact same issue, how did you end up solving this? I'm not sure what to add to my requirements.txt :(
kp046
Hi,
when I run my spider locally it runs without any problems. But on the scrapycloud I got the following error Message:
Any idea what I have to change in my settings or code?
thanks.
Hi, You would need to add the library to your requirements.txt as shown here: https://support.scrapinghub.com/support/solutions/articles/22000200400-deploying-python-dependencies-for-your-projects-in-scrapy-cloud
- Oldest First
- Popular
- Newest First
Sorted by Oldest Firstnestor
Hi, You would need to add the library to your requirements.txt as shown here: https://support.scrapinghub.com/support/solutions/articles/22000200400-deploying-python-dependencies-for-your-projects-in-scrapy-cloud
Test Test
I have the exact same issue, how did you end up solving this? I'm not sure what to add to my requirements.txt :(
-
Unable to select Scrapy project in GitHub
-
ScrapyCloud can't call spider?
-
Unhandled error in Deferred
-
Item API - Filtering
-
newbie to web scraping but need data from zillow
-
ValueError: Invalid control character
-
Cancelling account
-
Best Practices
-
Beautifulsoup with ScrapingHub
-
Delete a project in ScrapingHub
See all 445 topics