def firefox_crawlera():
profile = webdriver.FirefoxProfile()
profile.set_preference("network.proxy.type", 1)
profile.set_preference("network.proxy.http", "CRAWLERA_APIKEY@proxy.crawlera.com")
profile.set_preference("network.proxy.http_port", 8010)
profile.update_preferences()
driver = webdriver.Firefox(firefox_profile=profile, executable_path=r'c:\dropbox\py\webdriver\geckodriver.exe')
return driver
Proxy doesn't work.
Try using Crawlera-headless-proxy as an alternative to Polipo:
https://github.com/scrapinghub/crawlera-headless-proxy
Jiwon Kwon
def firefox_crawlera():
profile = webdriver.FirefoxProfile()
profile.set_preference("network.proxy.type", 1)
profile.set_preference("network.proxy.http", "CRAWLERA_APIKEY@proxy.crawlera.com")
profile.set_preference("network.proxy.http_port", 8010)
profile.update_preferences()
driver = webdriver.Firefox(firefox_profile=profile, executable_path=r'c:\dropbox\py\webdriver\geckodriver.exe')
return driver
Proxy doesn't work.
Try using Crawlera-headless-proxy as an alternative to Polipo:
https://github.com/scrapinghub/crawlera-headless-proxy
nestor
Try using Crawlera-headless-proxy as an alternative to Polipo:
https://github.com/scrapinghub/crawlera-headless-proxy
-
Crawlera 503 Ban
-
Amazon scraping speed
-
Website redirects
-
Error Code 429 Too Many Requests
-
Bing
-
Subscribed to Crawlera but saying Not Subscribed
-
Selenium with c#
-
Using Crawlera with browsermob
-
CRAWLERA_PRESERVE_DELAY leads to error
-
How to connect Selenium PhantomJS to Crawlera?
See all 399 topics