videocamWeb Data Extraction Summit - September 30th, 2021.
Join some of the greatest minds in web scraping to educate, inspire, and innovate.
Register for free!
Start a new topic
Answered

Failed request with https

 import requests

response = requests.get(
    "https://httpbin.org/ip",
    proxies={
        'http': 'http://<mytoken>:@proxy.crawlera.com:8010/',
        'https': 'https://<mytoken>:@proxy.crawlera.com:8010/'
    },
    verify='./crawlera-ca.crt',
    # headers={'x-crawlera-use-https':'1'}
)
print(response.text)


got


requests.exceptions.ProxyError: HTTPSConnectionPool(host='httpbin.org', port=443): Max retries exceeded with url: /ip (Caused by ProxyError('Cannot connect to proxy.', error(54, 'Connection reset by peer')))


Best Answer

Sounds like you have a firewall that might be blocking connection to Crawlera. Make sure port 8010 is open.


Answer

Sounds like you have a firewall that might be blocking connection to Crawlera. Make sure port 8010 is open.

Hmm, maybe the GFW

Big brother is watching Crawlera

Login to post a comment