How to mark a crawlera request as failed due to ban?
M
Marcell Ortutay
started a topic
about 5 years ago
I am scraping a site that returns 200 HTTP status code when it has banned my IP address. I can tell it's a ban because to response text says "Too many bookings from your computer. Please try again later".
How can I tell Crawlera that this request failed, despite the "200" HTTP code?
Best Answer
n
nestor
said
about 5 years ago
Open a ticket via Help > Contact Support and include HTML of the response (attach as a file) + Response headers. Please don't forget to include the domain for which you get this response. It can be added as a ban rule on Crawlera's backend.
1 Comment
nestor
said
about 5 years ago
Answer
Open a ticket via Help > Contact Support and include HTML of the response (attach as a file) + Response headers. Please don't forget to include the domain for which you get this response. It can be added as a ban rule on Crawlera's backend.
Marcell Ortutay
I am scraping a site that returns 200 HTTP status code when it has banned my IP address. I can tell it's a ban because to response text says "Too many bookings from your computer. Please try again later".
How can I tell Crawlera that this request failed, despite the "200" HTTP code?
Open a ticket via Help > Contact Support and include HTML of the response (attach as a file) + Response headers. Please don't forget to include the domain for which you get this response. It can be added as a ban rule on Crawlera's backend.
nestor
Open a ticket via Help > Contact Support and include HTML of the response (attach as a file) + Response headers. Please don't forget to include the domain for which you get this response. It can be added as a ban rule on Crawlera's backend.
-
Crawlera 503 Ban
-
Amazon scraping speed
-
Website redirects
-
Error Code 429 Too Many Requests
-
Bing
-
Subscribed to Crawlera but saying Not Subscribed
-
Selenium with c#
-
Using Crawlera with browsermob
-
CRAWLERA_PRESERVE_DELAY leads to error
-
How to connect Selenium PhantomJS to Crawlera?
See all 395 topics