zyte logo
zyte logo
zyte login

Zyte Developers Community newsletter issue #6

time to read
< 1
Mins
By the one and only
June 17, 2021

Hi there,

If you are not signed up already for the Zyte Developers Community newsletter, you can sign up here.

In this issue:

  • Extract JSONs like a pro with chompjs and JMESPath
  • A message producer for Scrapy pipeline
  • Web scraping project: Products to database
  • Web scraping: Infinite scrolling with selenium

Extract JSONs like a pro with chompjs and JMESPath

Roy Healy introduces two packages - chompjs and JMESPath that you can use to easily extract web data from dynamic pages. Read his detailed article. If you prefer watching a video, you can do that too.

A message producer for Scrapy pipeline

Jose writes this article to build and present one viable implementation of a message producer using PikaProducer for use in scrapy pipelines.

Web scraping project: Products to database

John Watson Rooney created this interesting product scraping video to build an advanced Shopify scraper that extracts the products and saves them onto an SQL database. Take a look.

Web scraping: Infinite scrolling with selenium

When web-scraping with python, selenium has proved to be very efficient. It is really useful when web pages load content only upon scrolling but this also brings its fair share of trouble with web scrapers. Zihan has a solution for it!

Written by Himanshi Bhatt
Sign up to the blog
linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram