videocamWeb Data Extraction Summit - September 30th, 2021.
Join some of the greatest minds in web scraping to educate, inspire, and innovate.
Register for free!
Start a new topic

Using crawlera with python requests on MacOS

I installed the crawlera certificate and it shows up in my Keychain Access app under the system keychain as a trusted certificate. I can't access any https-site with my code which worked perfectly fine a year ago.


For example:

url = "https://www.scrapinghub.com"

proxy_port = "8010"

proxy_host = "proxy.crawlera.com"

proxy_auth = "<MY API KEY>:" # Make sure to include ':' at the end

proxies = {"https": "https://{}@{}:{}/".format(proxy_auth, proxy_host, proxy_port),

"http": "http://{}@{}:{}/".format(proxy_auth, proxy_host, proxy_port)}


r = requests.get(url, proxies=proxies, verify=False)

r.text


Throws an error:

ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:833)



1 person has this question
Login to post a comment