We’ve made a change. Scrapinghub is now Zyte! 

The Scrapy tutorial course part IV: How to follow pagination links

time to read
< 1
Mins
By the one and only

Developed by Pablo Hoffman and Shane Evans, Scrapy is an open source python framework built specifically for web data extraction. With Scrapy spiders you are able to download HTML, parse and process the data and save it in either CSV, JSON or XML file formats.

In our first tutorials we've focussed on how to extract data from a website. In this video we'll show you how to crawl a website using Scrapy.

After watching this, you will know:

  • How to find links in a page
  • How to create requests to other pages

If you haven't yet, we recommend you to first watch part I, part II and part III of our tutorial series.

Watch the third part of the Scrapy tutorial course.

If you like what you saw, we can recommend you to also check out the links below:

Written by Zyte team