Explore resources by topic or category

What does the future hold for the tool some describe as “the gift that revolutionised web scraping”?

With the emergence of managed data extraction vendors, businesses no longer need to gather web data themselves.

The Strategic Case for Buying Web Data: Quality, Focus, and Scale

See what 10 years of Scrapy 1.0 has produced — in milestones and metrics - as it became the most-used open source web scraping framework in the world.

Discover how Zyte’s open-source libraries like ClearHTML, Extruct, Chomp.js, and more simplify web data extraction and processing.

Discover the strengths and limitations of Selenium, Puppeteer, and Playwright for web scraping at scale.

Here are four essential Scrapy plugins we use to build efficient web crawlers for our customers.

Web scraping tools save hours of work by automating data extraction, testing web applications, and performing repetitive tasks.

In the first part, we discussed a template to define the clear purpose of your web scraping system that can help you design your crawlers better and prepare you for the uncertainty involved in a large scale web scraping project.