How To

Articles from the Zyte blog about How To.

playwright-zyte-cdp
How To

Running Playwright at scale: connecting to the Zyte CDP browser

We've released our CDP Browser, ideal for those with existing Playwright scripts looking for better access, as well as developers who need granular control over a browser, but don't want the hassle of running locally.

John Rooney
harness-engineering-3
AI

Harness Engineering #3- Headless mode: the minimal agent harness

What's the smallest harness that still works? Turns out it's already sitting inside almost every coding agent you have installed — headless mode: same loop, tools, and reasoning as the interactive agent, minus the human in the chair. We point it at a web page and pull clean, structured data out the other end in about ten lines.

Ayan Pahwa12 min read
scrapy-ai-skills
Scraping practice

AI generated these Scrapy projects - why I won't ship them

What happens if you let AI create a Scrapy project from just a simple prompt? Here's what I got and what I had to fix.

John Rooney1 min read
Zyte Blog — field notes from the world of data extraction
How To

Web scraping for pricing intelligence: how to track competitor prices at scale

Compare the best headless browsers for web scraping in 2026. Learn when to use Playwright, Puppeteer, Selenium, or Zyte API’s managed CDP browser for scalable, anti-ban scraping.

Mitch Holt10 min read
Zyte Blog — field notes from the world of data extraction
How To

Best headless browsers for web scraping in 2026

Compare the best headless browsers for web scraping in 2026. Learn when to use Playwright, Puppeteer, Selenium, or Zyte API’s managed CDP browser for scalable, anti-ban scraping.

Arnold Alexander10 min read
Zyte Blog — field notes from the world of data extraction
How To

Best proxy providers for web scraping in 2026 | Zyte

Compare the best proxy providers for web scraping in 2026. Learn which residential, ISP, and mobile proxies work best—and when teams move beyond proxies to automation.

Arnold Alexander10 min read
Zyte Blog — field notes from the world of data extraction
How To

Hybrid Scraping: The Architecture for the Modern Web

John Rooney4 min read
Zyte Blog — field notes from the world of data extraction
How To

The Modern Web Scraping Method You NEED to Know

Learn how to scrape data in json format from a websites API

John Rooney10 min read
Scrape, Analyze & Visualize Web Data with Streamlit
How To

Scrape, Analyze & Visualize Web Data with Streamlit

Join Hyder Khan | Data Engineer, @ Flipdish as he shares how to extract, clean, analyze, and visualize web data using a seamless workflow with Streamlit.

Hyder Khan1 min read
Sustainability in Open Source | Fireside Chat
How To

Sustainability in Open Source | Fireside Chat

Learn how successful open-source projects balance community value with sustainable growth. Industry leaders share insights on monetization, maintenance, and building thriving communities.

Shane Evans2 min read
Inside Zyte's System Design Process: How We Build Scalable, Reliable Solutions
How To

Inside Zyte's System Design Process: How We Build Scalable, Reliable Solutions

Explore Zyte’s approach to building scalable and reliable systems through PRDs, technical requirements, solution evaluation, and real-world design insights.

Alexander Sibiryakov1 min read
Advanced session management with Scrapy
How To

Advanced session management with Scrapy

Master advanced session management with Scrapy-Zyte-API. Learn techniques to optimize efficiency, streamline workflows, and gain full control over your web scraping processes.

Sigit Dewanto2 min read