Field notes from the world of data extraction.

Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.

Actually, web scraping APIs are cheaper
Web scraping APIs

Actually, web scraping APIs are cheaper

Many data teams still think running a proxy-based scraping stack is most cost-effective. Industry pressures and our research disprove that idea.

Theresia Tanzil10 min read
The science of compliance: Tech tips for a legal data pipeline
Use case

The science of compliance: Tech tips for a legal data pipeline

New legal and regulatory compulsions for web data have significant business consequences. So, how can technologists engineer their company’s risk profile lower?

Theresia Tanzil10 min read
AI won’t fix your data quality (until you answer these three questions)
Scraping practice

AI won’t fix your data quality (until you answer these three questions)

In our interview, a QA expert warns - before you delegate web scraping quality assurance to AI, make sure you can describe what ‘good’ looks like for yourself.

Neha Setia Nagpal10 min read
Why 10 million tokens won’t save your AI agent (and what will)
AI

Why 10 million tokens won’t save your AI agent (and what will)

New models can process larger inputs, and confuse themselves in the process. Context management techniques can solve the problem.

Joaquin Bonifacino10 min read
Web scraping APIs vs proxies: A head-to-head comparison
Web scraping APIs

Web scraping APIs vs proxies: A head-to-head comparison

Proxies are essential to scraping at scale. So, how do full-stack web scraping APIs compare?

Theresia Tanzil10 min read
OpenClaw and Claude helped me buy the perfect sneakers using Zyte API
Tool-assisted coding

OpenClaw and Claude helped me buy the perfect sneakers using Zyte API

Quickly compare e-commerce products across any site with an agent, a skill and an AI-powered web scraping API.

Ayan Pahwa10 min read
Legal clarity comes with compliance demands
Web scraping APIs

Legal clarity comes with compliance demands

Explore how new regulations like the EU AI Act and California AB 2013 are reshaping AI data compliance in 2026. Learn why provenance, transparency, and lawful sourcing are now critical.

Theresia Tanzil, Robert Andrews5 min read
Brand visibility in the digital era: How web data help brands see the full picture
Web data collection

Brand visibility in the digital era: How web data help brands see the full picture

Discover how web data helps brands improve visibility, track competitors, monitor availability, and analyze reviews to win on the digital shelf.

Theresia Tanzil5 min read
Giving spidey-senses to your web scraping spiders using Spidermon
Web scraping APIs

Giving spidey-senses to your web scraping spiders using Spidermon

Learn how Spidermon helps you monitor web scraping data quality in real time. Validate items, track field coverage, and get alerts before bad data impacts your pipeline.

Ayan Pahwa5 min read
Web traffic is splintering into access lanes
Web scraping APIs

Web traffic is splintering into access lanes

Explore how AI agents are reshaping web traffic into hostile, negotiated, and invited access lanes. Learn what this means for bots, scraping, and the future of data access.

Robert Andrews5 min read
How online retailers use web data to compete on price, promotion, and availability
Web data collection

How online retailers use web data to compete on price, promotion, and availability

Discover how retailers leverage web data to optimize pricing, track competitor stock, detect trends, and improve sales performance.

Theresia Tanzil5 min read
K1
Anti-ban

The recipe for a request: Scaling data extraction through investigation

Learn how an investigative mindset helps scale data extraction from single requests to millions daily by building resilient, efficient scraping systems.

Kieron Spearing5 min read