I am getting a 451 error when trying to request websites from a specific company. This only occurs when I try to deploy the spider via Scrapinghub, as the spider works just fine when initialized from my computer.
Any ideas on what might cause the difference in performance?
0 Votes
nestor posted
over 6 years ago
AdminBest Answer
Our servers are in Germany, that website can only be accessed from the US it seems. You'll need a proxy service with US IPs.
0 Votes
1 Comments
nestorposted
over 6 years ago
AdminAnswer
Our servers are in Germany, that website can only be accessed from the US it seems. You'll need a proxy service with US IPs.
I am getting a 451 error when trying to request websites from a specific company. This only occurs when I try to deploy the spider via Scrapinghub, as the spider works just fine when initialized from my computer.
Any ideas on what might cause the difference in performance?
0 Votes
nestor posted over 6 years ago Admin Best Answer
Our servers are in Germany, that website can only be accessed from the US it seems. You'll need a proxy service with US IPs.
0 Votes
1 Comments
nestor posted over 6 years ago Admin Answer
Our servers are in Germany, that website can only be accessed from the US it seems. You'll need a proxy service with US IPs.
0 Votes
Login to post a comment