videocamWeb Data Extraction Summit - September 30th, 2021.
Join some of the greatest minds in web scraping to educate, inspire, and innovate.
Register for free!
Start a new topic
Answered

How to mark a crawlera request as failed due to ban?

I am scraping a site that returns 200 HTTP status code when it has banned my IP address. I can tell it's a ban because to response text says "Too many bookings from your computer. Please try again later".


How can I tell Crawlera that this request failed, despite the "200" HTTP code?


Best Answer

Open a ticket via Help > Contact Support and include HTML of the response (attach as a file) + Response headers. Please don't forget to include the domain for which you get this response. It can be added as a ban rule on Crawlera's backend.

1 Comment

Answer

Open a ticket via Help > Contact Support and include HTML of the response (attach as a file) + Response headers. Please don't forget to include the domain for which you get this response. It can be added as a ban rule on Crawlera's backend.

Login to post a comment