How can we help you today?

Start a new topic
Discussions Scrapy Cloud Technical Help
Answered

how to set a schedule for my portia spider ?

in Portia ... I have set a spider and have given it samples and it fetched data I needed .... 

now 

in the scrapy cloud how I can tell the spider how often recrawl that site and update those data ?


Best Answer

Hi,


You can use Periodic Jobs to set schedule the spider.

For more information on Periodic Jobs, please see: https://helpdesk.scrapinghub.com/support/solutions/articles/22000200419-scheduling-periodic-jobs

3 CommentsSorted by Oldest First
Answer

Hi,


You can use Periodic Jobs to set schedule the spider.

For more information on Periodic Jobs, please see: https://helpdesk.scrapinghub.com/support/solutions/articles/22000200419-scheduling-periodic-jobs

thanks .... and what is the Tags and Arguments there ?

Arguments apply to Scrapy spiders: https://doc.scrapy.org/en/latest/topics/spiders.html#spider-arguments

And Tags are like a label you apply to a job, that you can use to identify them.

Login to post a comment
More topics in Technical Help
See all 446 topics