Job is running slowly.

Posted about 6 years ago by Artem M

Post a topic
Un Answered
A
Artem M

I have i c50 crawlera plan that runs at 50 threads and quite basic spider.

But it runs impossibly slow. Like 25 requests per minute.

The only thing is that i load 250k start urls from google sheet. Can this influence the speed? Autothrotle is disabled of course.

1 Votes


0 Comments

Login to post a comment