No recent searches
Popular Articles
Sorry! nothing found for
Posted about 6 years ago by Artem M
I have i c50 crawlera plan that runs at 50 threads and quite basic spider.
But it runs impossibly slow. Like 25 requests per minute.
The only thing is that i load 250k start urls from google sheet. Can this influence the speed? Autothrotle is disabled of course.
1 Votes
0 Comments
Login to post a comment
People who like this
This post will be deleted permanently. Are you sure?
I have i c50 crawlera plan that runs at 50 threads and quite basic spider.
But it runs impossibly slow. Like 25 requests per minute.
The only thing is that i load 250k start urls from google sheet. Can this influence the speed? Autothrotle is disabled of course.
1 Votes
0 Comments
Login to post a comment