Web Scraping Blog | Stay Updated with Zyte for the Latest in Web Scraping and Data Extraction

Light

Dark

Newsletter

Announcement

Product Update

Open Source

Use case

How To

Leadership

Handling Bans

Is your AI coding assistant stuck in the past?

AI speeds up development - but it might default to past conventions and versions. How can developers ensure they work with the latest features and requirements?

by Theresia Tanzil

The Scrapy whisperer: Adrian Chaves on Web Scraping Copilot

by Neha Setia Nagpal

Data outcomes are top of the scraping stack

by Theresia Tanzil

No-code web scraping workflows are here: Introducing the Zyte integration for Zapier

by Robert Andrews

Most Recent

Code is cheap, show me the talk: How copilots are re-engineering developers

Mastery of computer code used to be an engineer’s differentiator. Thanks to AI assistants, code is now the commodity, sensibility is the real premium.

Web scraping finally has a home in the IDE

Discover how web scraping is moving into the IDE. Learn how tools like VS Code and AI-assisted extensions are streamlining scraper development, testing, and maintenance.

Introducing Web Scraping Copilot 1.0: AI-accelerated web scraping inside VS Code

Discover Web Scraping Copilot 1.0, Zyte’s VS Code extension that uses AI to generate, test, and deploy production-ready Scrapy spiders faster while maintaining full developer control.

Build your own MCP server: LLMs meets web data with Zyte API

Learn how to build your own Model Context Protocol (MCP) server to connect LLMs with real-time web data using Zyte API, FastMCP, and the Docker MCP toolkit.

Open Source

More data, more trouble: How a perfect corpus corrupted my AI dream

What a failed experiment taught me about curated data, prompting, and when scraping actually matters.

Open Source

Claude skills, MCP or Web Scraping Copilot: Which should you choose?

Three ways to bring Zyte-powered web data into your AI workflow — from production spiders to conversational extraction.

Open Source

Supercharging web scraping with Claude skills

Learn how Claude skills can automate HTML fetching, AI parsing, selector generation, and structured data extraction to build faster, smarter web scraping workflows.

Leadership

Is your AI breaking the law? Legal experts’ advice for web scrapers

Legal experts discuss how AI, web scraping, copyright law, and the EU AI Act intersect—covering fair use, data provenance, and compliance risks for businesses.

Use case

Brewing a bot: RAG and web data fuel the perfect coffee recommendation

Learn how to build a real-time AI chatbot using RAG, web scraping, Zyte API, LangChain, and OpenAI. Scrape JavaScript-heavy websites, store data in a vector database, and generate accurate answers from fresh web data.

Use case

Beyond text: Unlocking value on the multimedia web

The web is about more than the written word. Why companies are racing to harness the power of video, audio and pictures.

How To

Teaching AI to scrape like a pro: how we measure LLMs’ data quality

AI-enabled code editors can now conjure scraping code on command. But is it any good? Here’s how Zyte re-engineered LLMs with Web Scraping Copilot to drive best-in-class output.

Sun, sea and code: What we built at Zyte’s API hackathon

Discover the 7 creative projects built at Zyte’s API Hackathon in Turkey, from security scanning tools to price comparison engines and smart caching systems.

Load more articles...

Get the latest posts straight to your inbox

No matter what data type you're looking for, we've got you