zyte logo
zyte logo
zyte login

The Scrapy tutorial part VII: How to submit forms in your spiders

time to read
< 1
Mins
By the one and only

Developed by Pablo Hoffman and Shane Evans, Scrapy is an open-source python framework built specifically for web data extraction. With Scrapy spiders, you are able to download HTML, parse and process the data and save it in either CSV, JSON, or XML file formats.

This video shows how to scrape pages where the users have to submit POST requests, such as login forms.

After watching this video, you will know:

  • How to submit POST requests with Scrapy
  • How to handle validation tokens
  • How to authenticate in a website

If you haven't yet, we recommend you to first watch part I, part II, part III, part IV, part V and part VI of our tutorial series.

linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram