videocamWeb Data Extraction Summit - September 30th, 2021.
Join some of the greatest minds in web scraping to educate, inspire, and innovate.
Register for free!
Start a new topic
Answered

Why does crawlera crawl so slowly

I run the crawler, about 16 hours a night, making 478 requests, very slow.I wonder why?When my crawler wasn't running on a messy cloud, it was ok, but Google banned it, so I used cralera, but the efficiency was worrying.


Best Answer
1 Comment

Login to post a comment