Long Scraping And Empty Response

Posted over 1 year ago by Anton Apalanyuk

Post a topic
Un Answered
A
Anton Apalanyuk

The issue is that at some point, scraping began to take on average about 10 minutes, after which it essentially returned an empty response. (Automatic Data Extraction API) (example below). Perhaps someone has encountered this, is this the problem of the Zyte servers themselves? And how long does it take on average to scrape a product, for example from Amazon? Is there a way to somehow speed up this process?


[

     {

         "query": {

             "id": "1689828708890-b198da93ce7b94ae",

             "domain": "a.co",

             "userAgent": "axios/1.2.2",

             "userQuery": {

                 "url": "https://a.co/d/3FX0LOj",

                 "pageType": "product"

             }

         },

         product: {

             "sku": "B07MGJ74JR",

             "url": "https://www.amazon.com/dp/B07MGJ74JR?ref_=cm_sw_r_apin_dp_DTPG4WPC7BFX5K1DM3Z4",

             "probability": 0.00022832809

         },

         "webpage": {

             "inLanguages": [

                 {

                     "code": "en"

                 }

             ]

         },

         "algorithmVersion": "21.12.7"

     }

]

0 Votes


0 Comments

Login to post a comment