AI-assisted data extraction

Articles from the Zyte blog about AI-assisted data extraction.

What multi-agent orchestration looks like in a large-scale web scraping project
AI-assisted data extraction

What multi-agent orchestration looks like in a large-scale web scraping project

Multi-agent orchestration is having its moment. The diagrams are everywhere now. Boxes for planners, boxes for hands, boxes for daemons, arrows to a shared brain, a human floating at the top. They keep getting prettier. The part where the web pushes back is still the part nobody draws.

Neha Setia Nagpal18 min read
I built scraping agents for 30 days - here’s what I learned
AI-assisted data extraction

I built scraping agents for 30 days - here’s what I learned

For the last 30 days, I did one thing almost exclusively: I built scraping systems with AI agents, from the ground up, across real targets, with real deadlines. Not prototypes designed to impress in a demo, not isolated experiments running against a toy website, but production-grade pipelines that needed to ship and keep running.

John Rooney12 min read
The Scrapy whisperer: Adrian Chaves on Web Scraping Copilot
AI-assisted data extraction

The Scrapy whisperer: Adrian Chaves on Web Scraping Copilot

An interview with Scrapy maintainer Adrian Chaves on Zyte’s Web Scraping Copilot, AI-generated parsing code, and building reliable scraping workflows.

Neha Setia Nagpal10 min read
Code is cheap, show me the talk: How copilots are re-engineering developers
AI-assisted data extraction

Code is cheap, show me the talk: How copilots are re-engineering developers

Discover how AI copilots like Zyte’s Web Scraping Copilot are transforming developer workflows—making code a commodity and shifting value to problem-solving and prompting skills.

Ayan Pahwa10 min read
Claude skills, MCP or Web Scraping Copilot: Which should you choose?
AI-assisted data extraction

Claude skills, MCP or Web Scraping Copilot: Which should you choose?

Compare Claude skills, MCP servers, and Web Scraping Copilot to understand when to use each for AI-powered web scraping, data extraction, and production pipelines with Zyte API.

Neha Setia Nagpal10 min read
Supercharging web scraping with Claude skills
AI-assisted data extraction

Supercharging web scraping with Claude skills

Learn how Claude skills can automate HTML fetching, AI parsing, selector generation, and structured data extraction to build faster, smarter web scraping workflows.

John Rooney10 min read
Claude Sonnet 4.6 is the new best model for writing scrapers
AI-assisted data extraction

Claude Sonnet 4.6 is the new best model for writing scrapers

Claude Sonnet 4.6 is now the top model in Zyte’s Web Scraping Copilot benchmark, narrowly beating Gemini 3 Pro on extraction quality, with a small increase in code complexity.

Konstantin Lopukhin10 min read
AI and the web: What 2025 changed and what comes next
AI-assisted data extraction

AI and the web: What 2025 changed and what comes next

2025 was the year AI learned to reason. From reasoning-first LLMs to autonomous agents and a reshaped web economy, this retrospective explores what changed—and what’s coming next.

Iván Sánchez10 min read
Gemini 3.0 Pro is the new best model for writing scrapers
AI-assisted data extraction

Gemini 3.0 Pro is the new best model for writing scrapers

Gemini 3.0 Pro outperforms GPT-5, Claude, and other leading LLMs in Zyte’s Web Scraping Copilot benchmarks, delivering the highest code accuracy and lowest complexity. See full results, pros, cons, and recommendations for production workflows.

Konstantin Lopukhin10 min read
AI and the web: What 2025 changed and what comes next
AI-assisted data extraction

Why AI agents struggle with web scraping (and how to help them)

Explore the key challenges AI agents face in web scraping and how Zyte’s Web Scraping Copilot boosts automation, accuracy, and developer productivity.

Iván Sánchez10 min read
AI and the web: What 2025 changed and what comes next
Web data collection

Five key takeaways from Extract Summit 2025

From AI-accelerated scraping to “dead internet” risks and rising access wars, these five takeaways from Extract Summit 2025 show where web data is heading next.

Robert Andrews5 min read
Introducing Web Scraping Copilot - A rocket boost for data extractors
Web data collection

Introducing Web Scraping Copilot - A rocket boost for data extractors

Meet Web Scraping Copilot: your AI-powered coding partner for Scrapy in VS Code.

Valter Sciarrillo10 min read