The issue is that at some point, scraping began to take on average about 10 minutes, after which it essentially returned an empty response. (Automatic Data Extraction API) (example below). Perhaps someone has encountered this, is this the problem of the Zyte servers themselves? And how long does it take on average to scrape a product, for example from Amazon? Is there a way to somehow speed up this process?
Anton Apalanyuk
The issue is that at some point, scraping began to take on average about 10 minutes, after which it essentially returned an empty response. (Automatic Data Extraction API) (example below). Perhaps someone has encountered this, is this the problem of the Zyte servers themselves? And how long does it take on average to scrape a product, for example from Amazon? Is there a way to somehow speed up this process?
[
{
"query": {
"id": "1689828708890-b198da93ce7b94ae",
"domain": "a.co",
"userAgent": "axios/1.2.2",
"userQuery": {
"url": "https://a.co/d/3FX0LOj",
"pageType": "product"
}
},
product: {
"sku": "B07MGJ74JR",
"url": "https://www.amazon.com/dp/B07MGJ74JR?ref_=cm_sw_r_apin_dp_DTPG4WPC7BFX5K1DM3Z4",
"probability": 0.00022832809
},
"webpage": {
"inLanguages": [
{
"code": "en"
}
]
},
"algorithmVersion": "21.12.7"
}
]