Learn Scrapy (video tutorials)

Modified on Wed, 3 Feb, 2021 at 6:31 AM

1. Getting started with web scraping using Scrapy

Learn the basics of how to extract data from a web page using your browser developer tools and Scrapy Shell.

2. Creating your first Scrapy spider

Learn how to create a Scrapy spider using the selectors seen in the previous video.

3. Scraping multiple items from a page

Learn how to extract many items from a single page. This is a very common pattern that applies to e-commerces, forums, etc.

4. Following pagination links with Scrapy

Learn how to build a spider with the ability to jump from one page to another.

5. Scraping details pages from listings

Learn how to scrape websites that are structured similarly to e-commerces, where there are lists of products and then we have to visit each product page to get the data we need.

6. Scraping infinite scrolling pages

Learn how to find and use underlying APIs that power AJAX-based infinite scrolling mechanisms in web pages.

7. Submitting forms in your Scrapy spiders

Learn how to scrape pages where your spider has to submit POST requests, such as login forms.

8. Run your Scrapy spiders in the cloud

Learn how to deploy and run your spiders on Scrapy Cloud.

You can also watch these videos in the Learn Scrapy playlist in our Youtube channel.