how to set a schedule for my portia spider ?

Posted over 7 years ago by Amin R

Post a topic
Answered
A
Amin R

in Portia ... I have set a spider and have given it samples and it fetched data I needed .... 

now 

in the scrapy cloud how I can tell the spider how often recrawl that site and update those data ?


0 Votes

nestor

nestor posted over 7 years ago Admin Best Answer

Hi,


You can use Periodic Jobs to set schedule the spider.

For more information on Periodic Jobs, please see: https://helpdesk.scrapinghub.com/support/solutions/articles/22000200419-scheduling-periodic-jobs

0 Votes


3 Comments

Sorted by
nestor

nestor posted over 7 years ago Admin

Arguments apply to Scrapy spiders: https://doc.scrapy.org/en/latest/topics/spiders.html#spider-arguments

And Tags are like a label you apply to a job, that you can use to identify them.

0 Votes

A

Amin R posted over 7 years ago

thanks .... and what is the Tags and Arguments there ?

0 Votes

nestor

nestor posted over 7 years ago Admin Answer

Hi,


You can use Periodic Jobs to set schedule the spider.

For more information on Periodic Jobs, please see: https://helpdesk.scrapinghub.com/support/solutions/articles/22000200419-scheduling-periodic-jobs

0 Votes

Login to post a comment