I am trying to understand where do Scrapy Cloud servers operate from. I am logging into a website with my spider but the use of this website is restricted to some countries. How can I know that the spider is logging in from a valid country?
Thanks,
Jorge.
Best Answer
n
nestor
said
over 5 years ago
Currently our servers are located in Germany. If you want to request the website from a different location, you'll need a proxy service like Crawlera.
1 Comment
nestor
said
over 5 years ago
Answer
Currently our servers are located in Germany. If you want to request the website from a different location, you'll need a proxy service like Crawlera.
picard7
Hello!
I am trying to understand where do Scrapy Cloud servers operate from. I am logging into a website with my spider but the use of this website is restricted to some countries. How can I know that the spider is logging in from a valid country?
Thanks,
Jorge.
Currently our servers are located in Germany. If you want to request the website from a different location, you'll need a proxy service like Crawlera.
nestor
Currently our servers are located in Germany. If you want to request the website from a different location, you'll need a proxy service like Crawlera.
-
Unable to select Scrapy project in GitHub
-
ScrapyCloud can't call spider?
-
Unhandled error in Deferred
-
Item API - Filtering
-
newbie to web scraping but need data from zillow
-
ValueError: Invalid control character
-
Cancelling account
-
Best Practices
-
Beautifulsoup with ScrapingHub
-
Delete a project in ScrapingHub
See all 453 topics