How to launch a large-scale web scraping project? Find out how LexisNexis did it. Join the webinar on 29th March.Register now
Start a new topic

Why does crawlera crawl so slowly

I run the crawler, about 16 hours a night, making 478 requests, very slow.I wonder why?When my crawler wasn't running on a messy cloud, it was ok, but Google banned it, so I used cralera, but the efficiency was worrying.

Best Answer
1 Comment

Login to post a comment