in Portia ... I have set a spider and have given it samples and it fetched data I needed ....
now
in the scrapy cloud how I can tell the spider how often recrawl that site and update those data ?
Hi,
You can use Periodic Jobs to set schedule the spider.
For more information on Periodic Jobs, please see: https://helpdesk.scrapinghub.com/support/solutions/articles/22000200419-scheduling-periodic-jobs
thanks .... and what is the Tags and Arguments there ?
Arguments apply to Scrapy spiders: https://doc.scrapy.org/en/latest/topics/spiders.html#spider-arguments
And Tags are like a label you apply to a job, that you can use to identify them.
Amin R
in Portia ... I have set a spider and have given it samples and it fetched data I needed ....
now
in the scrapy cloud how I can tell the spider how often recrawl that site and update those data ?
Hi,
You can use Periodic Jobs to set schedule the spider.
For more information on Periodic Jobs, please see: https://helpdesk.scrapinghub.com/support/solutions/articles/22000200419-scheduling-periodic-jobs
- Oldest First
- Popular
- Newest First
Sorted by Oldest Firstnestor
Hi,
You can use Periodic Jobs to set schedule the spider.
For more information on Periodic Jobs, please see: https://helpdesk.scrapinghub.com/support/solutions/articles/22000200419-scheduling-periodic-jobs
Amin R
thanks .... and what is the Tags and Arguments there ?
nestor
Arguments apply to Scrapy spiders: https://doc.scrapy.org/en/latest/topics/spiders.html#spider-arguments
And Tags are like a label you apply to a job, that you can use to identify them.
-
Unable to select Scrapy project in GitHub
-
ScrapyCloud can't call spider?
-
Unhandled error in Deferred
-
Item API - Filtering
-
newbie to web scraping but need data from zillow
-
ValueError: Invalid control character
-
Cancelling account
-
Best Practices
-
Beautifulsoup with ScrapingHub
-
Delete a project in ScrapingHub
See all 446 topics