I am scraping a site that returns 200 HTTP status code when it has banned my IP address. I can tell it's a ban because to response text says "Too many bookings from your computer. Please try again later".
How can I tell Crawlera that this request failed, despite the "200" HTTP code?
0 Votes
nestor posted
almost 6 years ago
AdminBest Answer
Open a ticket via Help > Contact Support and include HTML of the response (attach as a file) + Response headers. Please don't forget to include the domain for which you get this response. It can be added as a ban rule on Crawlera's backend.
0 Votes
1 Comments
nestorposted
almost 6 years ago
AdminAnswer
Open a ticket via Help > Contact Support and include HTML of the response (attach as a file) + Response headers. Please don't forget to include the domain for which you get this response. It can be added as a ban rule on Crawlera's backend.
I am scraping a site that returns 200 HTTP status code when it has banned my IP address. I can tell it's a ban because to response text says "Too many bookings from your computer. Please try again later".
How can I tell Crawlera that this request failed, despite the "200" HTTP code?
0 Votes
nestor posted almost 6 years ago Admin Best Answer
Open a ticket via Help > Contact Support and include HTML of the response (attach as a file) + Response headers. Please don't forget to include the domain for which you get this response. It can be added as a ban rule on Crawlera's backend.
0 Votes
1 Comments
nestor posted almost 6 years ago Admin Answer
Open a ticket via Help > Contact Support and include HTML of the response (attach as a file) + Response headers. Please don't forget to include the domain for which you get this response. It can be added as a ban rule on Crawlera's backend.
0 Votes
Login to post a comment