Running the same spider across several jobs in parallel simultaneously

Posted almost 1 year ago by Adam Kwaśnik

Post a topic
Un Answered
A
Adam Kwaśnik

As in title, I am trying to run the same spider across several jobs, in the same Scrapy Cloud in parallel simultaneously. Is it possible?

How to do it properly?
Currently tasks of the spider are being proceed within jobs one after another.

1 Votes


0 Comments

Login to post a comment