I am using products like SEOToolsforExcel or Screaming Frog for scrapping data. These are desktop products. How can I like Crawlera with these desktop products? Basically where do I enter the API key in these or any similar products?
0 Votes
nestor posted
over 6 years ago
AdminBest Answer
From: http://seotoolsforexcel.com/httpsettings/ it says you can add an address which would be proxy.crawlera.com:8010, under user you would put your Crawlera API Key and password can be anything or left blank.
From: http://seotoolsforexcel.com/httpsettings/ it says you can add an address which would be proxy.crawlera.com:8010, under user you would put your Crawlera API Key and password can be anything or left blank.
I am using products like SEOToolsforExcel or Screaming Frog for scrapping data. These are desktop products. How can I like Crawlera with these desktop products? Basically where do I enter the API key in these or any similar products?
0 Votes
nestor posted over 6 years ago Admin Best Answer
From: http://seotoolsforexcel.com/httpsettings/ it says you can add an address which would be proxy.crawlera.com:8010, under user you would put your Crawlera API Key and password can be anything or left blank.
From: https://www.screamingfrog.co.uk/seo-spider/user-guide/configuration/#proxy there's no screenshot, however it seems you can add a proxy server which would be proxy.crawlera.com:8010 and then you'll be prompted for username and password.
I'm not sure if these apps support setting a proxy API as opposed to setting an IP:Port, you might want to contact their support for this as there's no mention of it on their website. You could also try Crawlera: https://support.scrapinghub.com/support/solutions/articles/22000188405-can-i-try-crawlera-with-a-trial-account-
Keep in mind that for HTTPS, Crawlera requires installation of a root certificate authority (CA): https://support.scrapinghub.com/support/solutions/articles/22000188407-fetching-https-pages-with-crawlera although I'm not sure how if installing this is enough for these 2 apps, I haven't tried them.
0 Votes
1 Comments
nestor posted over 6 years ago Admin Answer
From: http://seotoolsforexcel.com/httpsettings/ it says you can add an address which would be proxy.crawlera.com:8010, under user you would put your Crawlera API Key and password can be anything or left blank.
From: https://www.screamingfrog.co.uk/seo-spider/user-guide/configuration/#proxy there's no screenshot, however it seems you can add a proxy server which would be proxy.crawlera.com:8010 and then you'll be prompted for username and password.
I'm not sure if these apps support setting a proxy API as opposed to setting an IP:Port, you might want to contact their support for this as there's no mention of it on their website. You could also try Crawlera: https://support.scrapinghub.com/support/solutions/articles/22000188405-can-i-try-crawlera-with-a-trial-account-
Keep in mind that for HTTPS, Crawlera requires installation of a root certificate authority (CA): https://support.scrapinghub.com/support/solutions/articles/22000188407-fetching-https-pages-with-crawlera although I'm not sure how if installing this is enough for these 2 apps, I haven't tried them.
0 Votes
Login to post a comment