What can I do to fix this? Does the Crawlera service need several hours to begin working?
Thanks in advance
Graham
0 Votes
nestor posted
over 7 years ago
AdminBest Answer
Hi Graham,
You're using the incorrect API Key, I've responded to your ticket instructing you on where to find the API Key.
0 Votes
4 Comments
Sorted by
nestorposted
over 7 years ago
AdminAnswer
Hi Graham,
You're using the incorrect API Key, I've responded to your ticket instructing you on where to find the API Key.
0 Votes
G
Graham Andersonposted
over 7 years ago
Thanks :)
0 Votes
A
Austin Rayposted
over 5 years ago
I'm having the same problem @nestor. Just subscribed to Crawlera (C10), but the only part of the entire ScrapingHub site that acknowledges my subscription is the Billing page. All other pages tell me I should subscribe to Crawlera. And when I try to use Crawlera as a proxy via command line, I get a 407 back. I tried changing my API key on https://app.scrapinghub.com/account/apikey -- still got the same errors via command line. My output is attached.
I am scraping facebook, suppose 100 times the proxy server is called in the request, but along the way random requests fail.
HTTPSConnectionPool(host='www.facebook.com', port=443): Max retries exceeded with url: /ads/library/async/search_ads/..... (Caused by ProxyError('Unable to connect to proxy', OSError('Tunnel connection failed: 407 Proxy Authentication Required')))
Using the provided curl example, I'm getting 407 Bad Proxy errors.
curl -vx proxy.crawlera.com:8010 -U <my authentication code>: http://httpbin.org/ip
I also tried adding a --cacert to the curl
curl -vx proxy.crawlera.com:8010 -U <my authentication code>: http://httpbin.org/ip --cacert /my/path/to/crawlera-ca.crt
What can I do to fix this? Does the Crawlera service need several hours to begin working?
Thanks in advance
Graham
0 Votes
nestor posted over 7 years ago Admin Best Answer
Hi Graham,
You're using the incorrect API Key, I've responded to your ticket instructing you on where to find the API Key.
0 Votes
4 Comments
nestor posted over 7 years ago Admin Answer
Hi Graham,
You're using the incorrect API Key, I've responded to your ticket instructing you on where to find the API Key.
0 Votes
Graham Anderson posted over 7 years ago
Thanks :)
0 Votes
Austin Ray posted over 5 years ago
I'm having the same problem @nestor. Just subscribed to Crawlera (C10), but the only part of the entire ScrapingHub site that acknowledges my subscription is the Billing page. All other pages tell me I should subscribe to Crawlera. And when I try to use Crawlera as a proxy via command line, I get a 407 back. I tried changing my API key on https://app.scrapinghub.com/account/apikey -- still got the same errors via command line. My output is attached.
Attachments (1)
output.txt
2.21 KB
0 Votes
Rusiru Fernando posted 7 months ago
I am scraping facebook, suppose 100 times the proxy server is called in the request, but along the way random requests fail.
0 Votes
Login to post a comment