For example, today I get a random IP address from Crawlera and save it in DB. Next week I came back to the same page and need to use the same IP to visit to be consistent. Is there any way to achieve that?
Thanks!
Best Answer
n
nestor
said
over 6 years ago
Crawlera Sessions can be used to make requests with the same IP (https://doc.scrapinghub.com/crawlera.html#sessions) but they will expire if not used for 30 minutes. So you can do this as long as you keep the Crawlera Session active.
1 Comment
nestor
said
over 6 years ago
Answer
Crawlera Sessions can be used to make requests with the same IP (https://doc.scrapinghub.com/crawlera.html#sessions) but they will expire if not used for 30 minutes. So you can do this as long as you keep the Crawlera Session active.
kezjo
For example, today I get a random IP address from Crawlera and save it in DB. Next week I came back to the same page and need to use the same IP to visit to be consistent. Is there any way to achieve that?
Thanks!
Crawlera Sessions can be used to make requests with the same IP (https://doc.scrapinghub.com/crawlera.html#sessions) but they will expire if not used for 30 minutes. So you can do this as long as you keep the Crawlera Session active.
nestor
Crawlera Sessions can be used to make requests with the same IP (https://doc.scrapinghub.com/crawlera.html#sessions) but they will expire if not used for 30 minutes. So you can do this as long as you keep the Crawlera Session active.
-
Crawlera 503 Ban
-
Amazon scraping speed
-
Website redirects
-
Error Code 429 Too Many Requests
-
Bing
-
Subscribed to Crawlera but saying Not Subscribed
-
Selenium with c#
-
Using Crawlera with browsermob
-
CRAWLERA_PRESERVE_DELAY leads to error
-
How to connect Selenium PhantomJS to Crawlera?
See all 395 topics