I am using products like SEOToolsforExcel or Screaming Frog for scrapping data. These are desktop products. How can I like Crawlera with these desktop products? Basically where do I enter the API key in these or any similar products?
Best Answer
n
nestor
said
almost 6 years ago
From: http://seotoolsforexcel.com/httpsettings/ it says you can add an address which would be proxy.crawlera.com:8010, under user you would put your Crawlera API Key and password can be anything or left blank.
From: http://seotoolsforexcel.com/httpsettings/ it says you can add an address which would be proxy.crawlera.com:8010, under user you would put your Crawlera API Key and password can be anything or left blank.
Prasad Kulkarni
I am using products like SEOToolsforExcel or Screaming Frog for scrapping data. These are desktop products. How can I like Crawlera with these desktop products? Basically where do I enter the API key in these or any similar products?
From: http://seotoolsforexcel.com/httpsettings/ it says you can add an address which would be proxy.crawlera.com:8010, under user you would put your Crawlera API Key and password can be anything or left blank.
From: https://www.screamingfrog.co.uk/seo-spider/user-guide/configuration/#proxy there's no screenshot, however it seems you can add a proxy server which would be proxy.crawlera.com:8010 and then you'll be prompted for username and password.
I'm not sure if these apps support setting a proxy API as opposed to setting an IP:Port, you might want to contact their support for this as there's no mention of it on their website. You could also try Crawlera: https://support.scrapinghub.com/support/solutions/articles/22000188405-can-i-try-crawlera-with-a-trial-account-
Keep in mind that for HTTPS, Crawlera requires installation of a root certificate authority (CA): https://support.scrapinghub.com/support/solutions/articles/22000188407-fetching-https-pages-with-crawlera although I'm not sure how if installing this is enough for these 2 apps, I haven't tried them.
nestor
From: http://seotoolsforexcel.com/httpsettings/ it says you can add an address which would be proxy.crawlera.com:8010, under user you would put your Crawlera API Key and password can be anything or left blank.
From: https://www.screamingfrog.co.uk/seo-spider/user-guide/configuration/#proxy there's no screenshot, however it seems you can add a proxy server which would be proxy.crawlera.com:8010 and then you'll be prompted for username and password.
I'm not sure if these apps support setting a proxy API as opposed to setting an IP:Port, you might want to contact their support for this as there's no mention of it on their website. You could also try Crawlera: https://support.scrapinghub.com/support/solutions/articles/22000188405-can-i-try-crawlera-with-a-trial-account-
Keep in mind that for HTTPS, Crawlera requires installation of a root certificate authority (CA): https://support.scrapinghub.com/support/solutions/articles/22000188407-fetching-https-pages-with-crawlera although I'm not sure how if installing this is enough for these 2 apps, I haven't tried them.
-
Crawlera 503 Ban
-
Amazon scraping speed
-
Website redirects
-
Error Code 429 Too Many Requests
-
Bing
-
Subscribed to Crawlera but saying Not Subscribed
-
Selenium with c#
-
Using Crawlera with browsermob
-
CRAWLERA_PRESERVE_DELAY leads to error
-
How to connect Selenium PhantomJS to Crawlera?
See all 395 topics