No recent searches
Popular Articles
Sorry! nothing found for
Posted almost 7 years ago by xavierdurandsmet
Hi,
I am using Scrapy, it works great.
I am migrating to scrapingHub.
I have a script that runs spiders and waits asynchronously for the spiders to finish, to start doing other actions.
How can I do this in scrapingHub?
Example:
# do some stuff process.crawl(MySpider)process.start() # the script will block here until the crawling is finished# do other stuff after the the spiders are done runningThank you
# do some stuff process.crawl(MySpider)
process.start() # the script will block here until the crawling is finished
# do other stuff after the the spiders are done running
0 Votes
0 Comments
Login to post a comment
People who like this
This post will be deleted permanently. Are you sure?
Hi,
I am using Scrapy, it works great.
I am migrating to scrapingHub.
I have a script that runs spiders and waits asynchronously for the spiders to finish, to start doing other actions.
How can I do this in scrapingHub?
Example:
0 Votes
0 Comments
Login to post a comment