Here we will show you how to create your first Scrapy spider. We strongly recommend you also read the Scrapy tutorial for a more in-depth guide.
This assumes you have Scrapy already installed, otherwise please refer to the Scrapy installation guide.
For this example, we will build a spider to scrape famous quotes from this website: http://quotes.toscrape.com/
We begin by creating a Scrapy project which we will call quotes_crawler
:
Then we create a spider for quotes.toscrape.com
:
Then we edit the spider:
Here is the code:
For more information about Scrapy please refer to the Scrapy documentation.
Was this article helpful?
That’s Great!
Thank you for your feedback
Sorry! We couldn't be helpful
Thank you for your feedback
Feedback sent
We appreciate your effort and will try to fix the article