Field notes from the world of data extraction.

Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.

Zyte Blog — field notes from the world of data extraction
Search results

SERP data collection at scale and why efficiency matters again

Why has SERP data collection become more expensive? Learn what changed, why efficiency declined, and how it impacts SEO platforms and AI systems at scale.

Arnold Alexander10 min read
Teaching AI to scrape like a pro: how we measure LLMs’ data quality
Scraping practice

Teaching AI to scrape like a pro: how we measure LLMs’ data quality

AI-enabled code editors can now conjure scraping code on command. But is it any good? Here’s how Zyte re-engineered LLMs with Web Scraping Copilot to drive best-in-class output.

Theresia Tanzil10 min read
Generate HTML Parsing code the right way with Scrapy & Web Scraping Copilot

Generate HTML Parsing code the right way with Scrapy & Web Scraping Copilot

John Rooney22 min read
Zyte Blog — field notes from the world of data extraction

The New Guide to Web Scraping at Scale_One_Page

20 min read
Api first scraping extraction for the modern web

API-first scraping: Extraction for the modern web

This is the "API-first" method, a workflow that turns brittle, complex parsing jobs into clean, reliable, high-velocity JSON pipelines.

John Rooney10 min read
Sun, sea and code: What we built at Zyte’s API hackathon
Web data collection

Sun, sea and code: What we built at Zyte’s API hackathon

Discover the 7 creative projects built at Zyte’s API Hackathon in Turkey, from security scanning tools to price comparison engines and smart caching systems.

Robert Andrews5 min read
Zyte Blog — field notes from the world of data extraction
Use case

How to evaluate a web scraping company

Learn how to evaluate a web scraping company based on reliability, operating model, compliance, and organizational maturity. A practical guide to choosing a long-term web data partner.

Arnold Alexander10 min read
Claude Sonnet 4.6 is the new best model for writing scrapers
AI-assisted data extraction

Claude Sonnet 4.6 is the new best model for writing scrapers

Claude Sonnet 4.6 is now the top model in Zyte’s Web Scraping Copilot benchmark, narrowly beating Gemini 3 Pro on extraction quality, with a small increase in code complexity.

Konstantin Lopukhin10 min read
Zyte Blog — field notes from the world of data extraction
Use case

Best Web Scraping Companies (Software + Services)

Looking for the best web scraping company? Compare top providers by success rates, data quality, compliance standards, and enterprise support.

Arnold Alexander10 min read
Electric cars and the journey to the future of web data
Web scraping APIs

Electric cars and the journey to the future of web data

Discover how web scraping APIs are replacing proxy-based setups, just as electric vehicles are transforming the auto industry. Learn why APIs deliver lower total cost, better scalability, and long-term value for web data teams.

Iain Lennon10 min read
Building solidarity and strategy at Zyte’s global meet-up
Leadership

Building solidarity and strategy at Zyte’s global meet-up

What happens when a remote-first company meets in person? Zyte's COO Suzanne Hassett shares insights from the 2026 Antalya meet-up, where strategy, solidarity, and customer voices shaped the year ahead.

Suzanne Hassett5 min read
Hybrid scraping: The architecture for the modern web
Anti-ban

Hybrid scraping: The architecture for the modern web

Learn how hybrid scraping combines headless browsers and lightweight HTTP clients to bypass JavaScript challenges efficiently. Reduce RAM usage, improve speed, and scale your web scraping pipelines with session reuse and TLS fingerprinting.

John Rooney10 min read