Constantly getting incapsula response with scrapy and zyte auto extract

Posted about 2 months ago by Roman K

Post a topic

Un Answered

Roman K

Hi

constantly getting incapsula request

have used the following settings

DOWNLOAD_HANDLERS = {
    "http": "scrapy_zyte_api.ScrapyZyteAPIDownloadHandler",
    "https": "scrapy_zyte_api.ScrapyZyteAPIDownloadHandler",
}

REQUEST_FINGERPRINTER_CLASS = "scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter"
ZYTE_API_KEY = "API"
ZYTE_API_TRANSPARENT_MODE = True

this is an example of request:

yield Request(
            url=f'https://www.smythstoys.com/de/de-de/search/?text={text}',
            callback=self.parse_searchresult,
            meta={
                "zyte_api_automap": {
                    "browserHtml": True
                },
            }
        )

in response constantly getting something like this:

Request unsuccessful. Incapsula incident ID: 1057000170135418495-45975554798715971

could you please help me to understand how to fix this issue?
maybe it will be required to use some additional parameters or something else?

I've tried to retry for 5 times, but it doesn't work

Thanks.

0 Votes

0 Comments