Zyte Support Center

I'm using crawlera's c50 to crawl a bunch of websites and most of them are fine with it, except there are some websites which return captcha in response with 200 response code. In simple words the websites know that this is not a user but a crawler scraping data.

These websites are using fun captcha.

I am facing this issue with the following websites:

• PriceFalls
• Faucet

How am I supposed to bypass this situation?

Crawlera should be able to handle this on its own right?

How the websites are detecting that I am using a crawler to scrap data when I have different proxy on each request and with a valid user agent from crawlera?

As far as I know that websites can detect bots based on:

• IP
• User Agent
• Access Frequency

To take a part in the kroger feedback 50 fuel points survey at the official website of krogerfeedback, We Invite you for seeing the www kroger com/feeback along with your purchased receipts. Select your preferable language ( en español or english) to catch the survey. Keep your 26 digit printed survey code ready to obtain www krogerfeedback com 50 fuel points free of cost. If you find yourself without survey code printed receipt in your hand, Enter into the Korger Survey at kroger com/feedback/ by logging into survey portal. The Survey at krogerfeedback website showed on www kroger com/feebdack. surveys to Acquire free bonus fuel points available near you at kroger. Then Offer validation code is generates that can be used to redeem the offer to obtain www krogerfeedback com fuel points post survey participation at Fry Foods, Inc, Pick 'n Save, Ralphs, King Soopers, Kroger Co.

https://www-krogerfeedback.com/