No recent searches
Popular Articles
Sorry! nothing found for
Posted over 7 years ago by Amin R
in Portia ... I have set a spider and have given it samples and it fetched data I needed ....
now
in the scrapy cloud how I can tell the spider how often recrawl that site and update those data ?
0 Votes
nestor posted over 7 years ago Admin Best Answer
Hi,
You can use Periodic Jobs to set schedule the spider.
For more information on Periodic Jobs, please see: https://helpdesk.scrapinghub.com/support/solutions/articles/22000200419-scheduling-periodic-jobs
3 Comments
nestor posted over 7 years ago Admin
Arguments apply to Scrapy spiders: https://doc.scrapy.org/en/latest/topics/spiders.html#spider-arguments
And Tags are like a label you apply to a job, that you can use to identify them.
Amin R posted over 7 years ago
thanks .... and what is the Tags and Arguments there ?
nestor posted over 7 years ago Admin Answer
Login to post a comment
People who like this
This post will be deleted permanently. Are you sure?
in Portia ... I have set a spider and have given it samples and it fetched data I needed ....
now
in the scrapy cloud how I can tell the spider how often recrawl that site and update those data ?
0 Votes
nestor posted over 7 years ago Admin Best Answer
Hi,
You can use Periodic Jobs to set schedule the spider.
For more information on Periodic Jobs, please see: https://helpdesk.scrapinghub.com/support/solutions/articles/22000200419-scheduling-periodic-jobs
0 Votes
3 Comments
nestor posted over 7 years ago Admin
Arguments apply to Scrapy spiders: https://doc.scrapy.org/en/latest/topics/spiders.html#spider-arguments
And Tags are like a label you apply to a job, that you can use to identify them.
0 Votes
Amin R posted over 7 years ago
thanks .... and what is the Tags and Arguments there ?
0 Votes
nestor posted over 7 years ago Admin Answer
Hi,
You can use Periodic Jobs to set schedule the spider.
For more information on Periodic Jobs, please see: https://helpdesk.scrapinghub.com/support/solutions/articles/22000200419-scheduling-periodic-jobs
0 Votes
Login to post a comment