Start a new topic
Answered

India based IPs available in crawlera?

The site we want to crawl only accepts India based IPs. Is India based IP option available in crawlera? I need to confirm this before going for the 7-day trial.


Best Answer

We do have proxies from India. You can signup to a Crawlera plan and use this guide https://support.scrapinghub.com/support/solutions/articles/22000188398-restricting-crawlera-ips-to-a-specific-region to create an account with just proxies from India.


Answer

We do have proxies from India. You can signup to a Crawlera plan and use this guide https://support.scrapinghub.com/support/solutions/articles/22000188398-restricting-crawlera-ips-to-a-specific-region to create an account with just proxies from India.


1 person likes this

Thanks for the reply. Our use case is very specific. We are crawling only one site and serving to lots of users offering them an API. I have read in other forums that delays are introduced between requests. This seems to suggest it will affect concurrency and user experience for our use case. Do you have any such service?

Delays don't affect concurrency, concurrency is limited by your plan, e.g C10 has a limit of 10 concurrent request, C50 has 50, etc.


Do you have any such service? - Sorry, I don't understand your question here, could you elaborate further? What service are you referring to?


1 person likes this

At scale, we are looking at  ~ 1000 concurrent requests under a minute, all serving 1000 different users from the site. All this on a single site. Assuming crawlera doesn't have 1000 different proxy servers, it means the same proxy would be used again under a minute. Will crawlera be able to handle such scale?

Yeah, that should be possible. Just note the plan you subscribe, because maximum the number of concurrent requests depends on the plan.


1 person likes this
Login to post a comment