Scraping practice

Articles from the Zyte blog about Scraping practice.

K1
Anti-ban

The recipe for a request: Scaling data extraction through investigation

Learn how an investigative mindset helps scale data extraction from single requests to millions daily by building resilient, efficient scraping systems.

Kieron Spearing5 min read
Teaching AI to scrape like a pro: how we measure LLMs’ data quality
Scraping practice

Teaching AI to scrape like a pro: how we measure LLMs’ data quality

AI-enabled code editors can now conjure scraping code on command. But is it any good? Here’s how Zyte re-engineered LLMs with Web Scraping Copilot to drive best-in-class output.

Theresia Tanzil10 min read
Hybrid scraping: The architecture for the modern web
Anti-ban

Hybrid scraping: The architecture for the modern web

Learn how hybrid scraping combines headless browsers and lightweight HTTP clients to bypass JavaScript challenges efficiently. Reduce RAM usage, improve speed, and scale your web scraping pipelines with session reuse and TLS fingerprinting.

John Rooney10 min read
Scraping Swiss Army Knife: My personal fix for web setup fatigue using Docker, Scrapy and Zyte
Web scraping APIs

How I trade gold using e-ink, live data and an old Raspberry Pi

Track real-world gold and silver retail prices automatically using Zyte API, Python, and a Raspberry Pi with an e-ink display. Learn how to scrape rendered HTML, parse prices, and build an always-on trading dashboard.

Ayan Pahwa10 min read
Scrapy in 2026: New release brings modern async crawling standards
Scraping practice

Scrapy in 2026: New release brings modern async crawling standards

Scrapy 2.14.0 modernizes the framework with native async/await, smarter scheduling, and cleaner spider configuration. Here’s what the new release means for production crawlers in 2026.

Robert Andrews6 min read
Zyte Blog — field notes from the world of data extraction
Scraping practice

The Modern Scrapy Developer's Guide (Part 2): Page Objects with scrapy-poet

In this guide, we'll fix this by refactoring our spider to a professional, modern standard using Scrapy Items and Page Objects (via crapy-poet). We will completely separate our crawling logic from our parsing logic.

John Rooney5 min read
Zyte Blog — field notes from the world of data extraction
Scraping practice

The Modern Scrapy Developer's Guide (Part 1): Building Your First Spider

In this definitive guide, we will walk you through, step-by-step, how to build a real, multi-page crawling spider. You will go from an empty folder to a clean JSON file of structured data in about 15 minutes

John Rooney4 min read
How to build a daily industry news digest
Web data collection

How to build a daily industry news digest

Learn how data analyst Anshika Khandelwal automated a daily AI funding news digest using n8n and Zyte API. Discover how to pull articles, classify funding stories, and deliver a curated newsletter that saves 10+ hours per week.

Robert Andrews5 min read
Zyte Blog — field notes from the world of data extraction
Scraping practice

How to Scrape Images from Any Website: A Complete Guide

Image scrapers work by fetching the website’s HTML source code, finding the references to images, and downloading those image files via their URLs.

Karlo Jeđud8 min read
Browser bother: Three painkillers for headless scraping headaches
Scraping practice

Browser bother: Three painkillers for headless scraping headaches

This article shares three strategies to operationalize large-scale browser automation yourself,and what alternatives exist.

Theresia Tanzil10 min read
Overcoming web scraping challenges of Puppeteer and Playwright
Scraping practice

Overcoming web scraping challenges of Puppeteer and Playwright

Explore issues like browser farm management, IP rotation, and anti-scraping measures that can complicate large-scale operations.

Neha Setia Nagpal1 min read
Selenium, Puppeteer, Playwright: Which tool is right for web scraping at scale?
Scraping practice

Selenium, Puppeteer, Playwright: Which tool is right for web scraping at scale?

Discover the strengths and limitations of Selenium, Puppeteer, and Playwright for web scraping. Learn about their scalability challenges and what to consider when choosing the right tool for your scraping needs.

Neha Setia Nagpal1 min read