Are IP addresses assigned in a random way or is it somehow possible to control which IP address is used for specific requests?
They're selected based on a delay algorithm and it is not possible to control which IP is used for the request. You can, however, re-use the IP for subsequent requests by creating a Crawlera Session: https://support.scrapinghub.com/support/solutions/articles/22000188402-using-crawlera-sessions-to-make-multiple-requests-from-the-same-ip
systemaddict
Are IP addresses assigned in a random way or is it somehow possible to control which IP address is used for specific requests?
They're selected based on a delay algorithm and it is not possible to control which IP is used for the request. You can, however, re-use the IP for subsequent requests by creating a Crawlera Session: https://support.scrapinghub.com/support/solutions/articles/22000188402-using-crawlera-sessions-to-make-multiple-requests-from-the-same-ip
nestor
They're selected based on a delay algorithm and it is not possible to control which IP is used for the request. You can, however, re-use the IP for subsequent requests by creating a Crawlera Session: https://support.scrapinghub.com/support/solutions/articles/22000188402-using-crawlera-sessions-to-make-multiple-requests-from-the-same-ip
-
Crawlera 503 Ban
-
Amazon scraping speed
-
Website redirects
-
Error Code 429 Too Many Requests
-
Bing
-
Subscribed to Crawlera but saying Not Subscribed
-
Selenium with c#
-
Using Crawlera with browsermob
-
CRAWLERA_PRESERVE_DELAY leads to error
-
How to connect Selenium PhantomJS to Crawlera?
See all 395 topics