Field notes from the world of data extraction.

Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.

AI and the web: What 2025 changed and what comes next
Web data application

Your business doesn’t care about scraping - it cares about data

Web scraping isn’t the competitive advantage it used to be. Learn why shifting to a scraping API helps engineers reclaim time, reduce maintenance, and focus on delivering reliable data.

John Rooney10 min read
Zyte API Sessions - flexible cookie management maintaining control

Zyte API Sessions - flexible cookie management maintaining control

John Rooney8 min read
Scraping Swiss Army Knife: My personal fix for web setup fatigue using Docker, Scrapy and Zyte
Web scraping APIs

Scraping Swiss Army Knife: My personal fix for web setup fatigue using Docker, Scrapy and Zyte

Tired of repeating web scraping setup? Learn how a multi-arch Docker container with Scrapy, Zyte, Requests, and Pandas speeds up exploration and debugging.

Ayan Pahwa10 min read
Scraping Swiss Army Knife: My personal fix for web setup fatigue using Docker, Scrapy and Zyte
Web scraping APIs

How I trade gold using e-ink, live data and an old Raspberry Pi

Track real-world gold and silver retail prices automatically using Zyte API, Python, and a Raspberry Pi with an e-ink display. Learn how to scrape rendered HTML, parse prices, and build an always-on trading dashboard.

Ayan Pahwa10 min read
Zyte Blog — field notes from the world of data extraction
Use case

The best web scraping tools in 2026

Compare the best headless browsers for web scraping in 2026. Learn when to use Playwright, Puppeteer, Selenium, or Zyte API’s managed CDP browser for scalable, anti-ban scraping.

Arnold Alexander10 min read
Zyte Blog — field notes from the world of data extraction
How To

Web scraping for pricing intelligence: how to track competitor prices at scale

Compare the best headless browsers for web scraping in 2026. Learn when to use Playwright, Puppeteer, Selenium, or Zyte API’s managed CDP browser for scalable, anti-ban scraping.

Mitch Holt10 min read
Web data for engineering leaders in 2026: Scale scraping without scaling headcount
Use case

Web data for business insights in 2026: Elevate your BI function with quality data

Discover how BI teams in 2026 use AI-powered web data to cut data wrangling, improve quality, and stay compliant. Insights from Zyte’s Web Scraping Industry Report.

Theresia Tanzil5 min read
Zyte Blog — field notes from the world of data extraction
How To

Best headless browsers for web scraping in 2026

Compare the best headless browsers for web scraping in 2026. Learn when to use Playwright, Puppeteer, Selenium, or Zyte API’s managed CDP browser for scalable, anti-ban scraping.

Arnold Alexander10 min read
How to transfer browser cookies to an http session when web scraping

How to transfer browser cookies to an http session when web scraping

John Rooney9 min read
Web data for engineering leaders in 2026: Scale scraping without scaling headcount
Use case

Web data for scraping developers in 2026: AI fuels the agentic future

AI is reshaping web scraping in 2026. Learn how agentic systems, scraping APIs, and automated access management help developers build faster, more resilient data pipelines.

Theresia Tanzil5 min read
Web data for engineering leaders in 2026: Scale scraping without scaling headcount
Use case

Web data for engineering leaders in 2026: Scale scraping without scaling headcount

Explore how agentic AI is transforming web scraping in 2026, and why engineering leaders should rethink DIY infrastructure.

Theresia Tanzil5 min read
Scrapy Docker P1

How to create a Docker container with Scrapy and PostgreSQL

John Rooney9 min read