How to fetch HTTPS pages using phantomjs + selenium + Python
s
stonevo
started a topic
almost 6 years ago
Hi everyone,
I tried to use the proxy.crawlera.com:8010 and fetched the normal HTTP page and it worked fine (using phantomjs + selenium + python) but when i tried to fetch the HTTPS the blank page returned.
I already got advice "To fetch HTTPS pages you will need to download and install the following certificate in your HTTP client or disable SSL certificate verification:" but dont know how to disable the SSL certificate verification.
So does anyone have the same issue like me.
1 Comment
thriveni
said
over 5 years ago
HI Stonevo,
It seems you can ignore SSL errors as service_args=['--ignore-ssl-errors=true']). Found similar question in SO https://stackoverflow.com/questions/23581291/python-selenium-with-phantomjs-empty-page-source .
stonevo
Hi everyone,
I tried to use the proxy.crawlera.com:8010 and fetched the normal HTTP page and it worked fine (using phantomjs + selenium + python) but when i tried to fetch the HTTPS the blank page returned.
I already got advice "To fetch HTTPS pages you will need to download and install the following certificate in your HTTP client or disable SSL certificate verification:" but dont know how to disable the SSL certificate verification.
So does anyone have the same issue like me.