Zyte Blog

Field notes from the world of data extraction.

Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.

⌕

Running Playwright at scale: connecting to the Zyte CDP browser

We've released our CDP Browser, ideal for those with existing Playwright scripts looking for better access, as well as developers who need granular control over a browser, but don't want the hassle of running locally.

John RooneySeptember 7, 2026

Access handling

The State of Web Access: How today's web raises its barriers

Robert Andrews

Web data collection

Data is the new water

Robert Andrews10 min read

Browse

Hot topics

Data quality AI-assisted data extraction Scraping strategy Data gathering for AI Web scraping APIs

Latest

What we've been publishing

See all

Article

One Scrapy Spider, Three Browser Setups: Playwright, Patchright, and Zyte

One Scrapy spider, three browser setups: stock Playwright, Patchright via the new PLAYWRIGHT_BROWSER_PROVIDER hook, and a remote browser on Zyte over CDP. Same spider and selectors throughout, only the browser changes.

John RooneyHow ToSeptember 22, 2026

Article

Stopping a crawl when the data stops looking real with Jev

A Scrapy pipeline that asks a fast, calibrated AI model whether each scraped field still looks real, and stops the crawl when too many don't. What it caught, what it misses, and whether building it was worth it.

John RooneyData qualitySeptember 22, 2026

Article

Jev, the model that cannot write a word, and where it fits in web scraping(does it?)

Jev by TypeFace AI cannot generate a string, so it cannot extract a field. What it is, how it differs from an LLM, and the one job it earns in a scraping pipeline.

Ayan PahwaSeptember 21, 2026

A spyglass reveals a robot secretly using a web browser with its hand on the mouse.

Article

Inside antibot, the arms race you can't see

Only 18.5% of top sites run dedicated antibot, but every one of them chose to. Why it's the most intentional barrier in the stack, and the strongest signal of a hardened site.

Robert AndrewsAccess handlingSeptember 21, 2026

Article

uv Python cheatsheet: what changed in 0.12 and what still trips you up

uv 0.12 changed several defaults that Python developers rely on—from how `uv init` structures projects to how hash checking and lockfiles behave. This practical cheatsheet tests the differences across versions and highlights the command-line traps most likely to surprise you.

Ayan PahwaTool-assisted codingSeptember 18, 2026

Article

Firewalls run the web, just not on purpose

Web Application Firewalls run on 92.4% of the top websites, but most arrived bundled with a CDN and were never tuned to resist automated access.

Robert AndrewsAccess handlingSeptember 14, 2026

Article

Give your AI agent a browser: search, compare, and check product availability with Zyte CDP

What if your AI agent could use a real browser to search, click, compare products, and collect data, without you writing a selector for every step? By connecting it to a remote Zyte CDP browser, you can turn plain-language instructions into practical browser automation.

John RooneyAISeptember 11, 2026

Article

The page your agent scrapes is now an attack surface. Is it ready for the hostile web?

Real web is becoming hostile for AI Agents. The page your agent scrapes now could be a potential attack surface. Read more and join Zyte's virtual meet-up to see it in action.

Ayan PahwaSeptember 8, 2026

Article

Running Playwright at scale: connecting to the Zyte CDP browser

John RooneyHow ToSeptember 7, 2026

A toy robot walking toward a blocking robots.txt file

Article

Four in 10 sites block AI bots with robots.txt

Nearly four in 10 of the world's top sites are now closed to well-behaved AI crawlers. Here's what operators actually do with robots.txt, and which AI agents they block or welcome.

Robert AndrewsData gathering for AISeptember 7, 2026

Article

Fable 5.1 shipped, and GLM-5.3-Flash turned out to be someone I already met

A personal take on Claude Fable 5.1 and GLM-5.3-Flash: real benchmarks, a live extraction test, and the model I guessed before Zhipu confirmed it.

Ayan PahwaSeptember 2, 2026

Article

Web data in a reactive notebook: an introduction to marimo

marimo is a reactive Python notebook that reruns only affected cells. Learn to scrape web data with Zyte API, chart prices, and cache costly API calls.

Ayan PahwaSeptember 2, 2026

More articles More videos More webinars More case studies More white papers