PINGDOM_CHECK

#ExtractSummit2026 The world's largest web scraping conference returns. Austin Oct 7–8 · Dublin Nov 10–11.

Register now
Data Services
Pricing
Login
Try Zyte APIContact Sales
  • Unblocking and Extraction

    Zyte API

    The ultimate API for web scraping. Avoid website bans and access a headless browser or AI Parsing

    Ban Handling

    Headless Browser

    AI Extraction

    SERP

    Enterprise

    DocumentationSupport

    Hosting and Deployment

    Scrapy Cloud

    Run, monitor, and control your Scrapy spiders however you want to.

    Coding Agent Add-Ons

    Agentic Web Data

    Plugins that give coding agents the context to build production Scrapy projects. Starts with Claude Code.

  • Data Services
  • Pricing
  • Browse

    • BlogArticles, podcasts, videos
    • Case studiesCustomer outcomes
    • White papersIn-depth reports
    • DocumentationGuides & API reference
    • EventsConferences, webinars, recordings

    Subscribe

    • NewsletterSwiftly delivered
    • Discord communityExtract Data community
  • Product and E-commerce

    From e-commerce and online marketplaces

    Data for AI

    Collect and structure web data to feed AI

    Job Posting

    From job boards and recruitment websites

    Real Estate

    From Listings portals and specialist websites

    News and Article

    From online publishers and news websites

    Search

    Search engine results page data (SERP)

    Social Media

    From social media platforms online

  • Meet Zyte

    Our story, people and values

    Contact us

    Get in touch

    Support

    Knowledge base and raise support tickets

    Terms and Policies

    Accept our terms and policies

    Open Source

    Our open source projects and contributions

    Web Data Compliance

    Guidelines and resources for compliant web data collection

    Join the team building the future of web data
    We're Hiring
    Trust Center
    Security, compliance & certifications
Login
Try Zyte APIContact Sales

Zyte Developers

Coding tools & hacks straight to your inbox

Become part of the community and receive a bi-weekly dosage of all things code.

Join us
    • Zyte Data
    • News & Articles
    • Search
    • Social Media
    • Product
    • Data for AI
    • Job Posting
    • Real Estate
    • Zyte API - Ban Handling
    • Zyte API - Headless Browser
    • Zyte API - AI Extraction
    • Web Scraping Copilot
    • Zyte API Enterprise
    • Scrapy Cloud
    • Solution Overview
    • Blog
    • Webinars
    • Case Studies
    • White Papers
    • Documentation
    • Web Scraping Maturity Self-Assesment
    • Web Data compliance
    • Meet Zyte
    • Jobs
    • Terms and Policies
    • Trust Center
    • Support
    • Contact us
    • Pricing
    • Do not sell
    • Cookie settings
    • Sign up
    • Talk to us
    • Cost estimator
All articles
AI64, 64 articles
Data quality13, 13 articles
Developer interest57, 57 articles
Integration2, 2 articles
Open-source41, 41 articles
Proxies29, 29 articles
Scraping practice17, 17 articles
Scraping strategy27, 27 articles
Web data60, 60 articles
Web scraping APIs33, 33 articles
Scrapy Cloud48, 48 articles
Web Scraping Copilot11, 11 articles
Zyte API54, 54 articles
AI & Machine Learning2, 2 articles
Automotive2, 2 articles
E-commerce & retail27, 27 articles
Entertainment & Streaming2, 2 articles
Financial Services8, 8 articles
Government2, 2 articles
Market Research & Intelligence3, 3 articles
Media & publishing8, 8 articles
Real Estate2, 2 articles
Recruitment & HR3, 3 articles
Transportation & Logistics2, 2 articles
Travel & hospitality2, 2 articles
Extract Summit25, 25 articles
PyCon1, 1 articles
Large language model23, 23 articles
MCP3, 3 articles
iPaaS2, 2 articles
Python95, 95 articles
Web Scraping Industry Report10, 10 articles
Extract Data podcast1, 1 articles
Zyte Learning Centre1, 1 articles
Zyte YouTube channel1, 1 articles
Zyte blog398, 398 articles
16:9 video4, 4 articles
Article392, 392 articles
Guide1, 1 articles
Build-through2, 2 articles
Curated digest1, 1 articles
Insight and analysis26, 26 articles
Perspective18, 18 articles
Perspectives multi2, 2 articles
Product announcement3, 3 articles
Product demo1, 1 articles
Product update1, 1 articles
Recap3, 3 articles
Research results1, 1 articles
Tutorial7, 7 articles
Viewpoint4, 4 articles
Viewpoint4, 4 articles
Insight and analysis26, 26 articles
Build-through2, 2 articles
Product announcement3, 3 articles
Recap3, 3 articles
Curated digest1, 1 articles

Appearance

Discord Community
BlogAI-assisted data extractionClaude Fable 5 is the new best model for writing scrapers
ArticleViewpointAI-assisted data extractionLarge Language Models (LLMs)

Claude Fable 5 is the new best model for writing scrapers

We ran nine models, including the new GPT-5.6, through our Zyte Scraping Code Benchmark. Claude Fable 5 puts Sol and others in the shade - but it’s pricey, and the best extraction code still depends on the best infrastructure.

Konstantin Lopukhin · Head of R&D

1 min read · July 10, 2026

Claude Fable 5 is the new best model for writing scrapers

The past three weeks have been unusually busy in AI, even by 2026 standards.

Anthropic shipped Claude Sonnet 5 on June 30 and restored access to Claude Fable 5 on July 1, and, on July 9, OpenAI made the GPT-5.6 family (Sol, Terra, and Luna) generally available.

So Zyte's R&D team did what it always does when the frontier moves: we ran them all through our benchmark for AI-generated scraping code, alongside the previous generation of models.

The verdict

The result is unambiguous. Extraction code written using Claude Fable 5 produces the best-quality data output of any model we have tested, with a ROUGE-1 F1 (adj) score of 0.910 - that’s about 0.03 ahead of the next group. Given how tightly the rest of the field is packed, that is a clear lead.

Zyte Scraping Code Benchmark July 2026

Model Agent ROUGE-1 F1 (adj) Avg $/run Avg SLOC Avg run time
Claude Fable 5 Claude Code 0.910 $4.74 239 9m 48s
Codex GPT-5.4 Codex 0.882 $1.83 300 5m 16s
Claude Sonnet 5 Claude Code 0.879 $1.48† 202 9m 05s
Codex GPT-5.5 Codex 0.878 $3.30 298 7m 02s
Claude Opus 4.8 Claude Code 0.865 $2.38 212 8m 58s
GPT-5.6 Sol Codex 0.857 $1.47 192 6m 38s
Claude Sonnet 4.6 Claude Code 0.846 $1.80 195 10m 49s
GPT-5.6 Luna Codex 0.814 $0.26 152 3m 54s
GPT-5.6 Terra Codex 0.813 $0.57 122 3m 45s

Zyte Scraping Code Benchmark, July 2026. 6 sites, 21 test pages. ROUGE-1 F1 (adj) measures extracted values against annotated ground truth, normalized per site; higher is better. † Introductory pricing; see footnotes on cost and run time below.

Behind Fable 5, three models are effectively tied: Codex GPT-5.4 (0.882), Claude Sonnet 5 (0.879), and Codex GPT-5.5 (0.878). With one run per model, differences of about 0.01 are within noise, so we read this as one cluster rather than a ranking.

Surprise 1: GPT-5.6 doesn't move the frontier for scraping code

The headline of the week is GPT-5.6 - but, on this task, the new family does not move the needle for data quality.

Sol in predecessor’s shade

  • GPT-5.6 Sol, the flagship, scored 0.857 - that’s below OpenAI's earlier GPT-5.4 and GPT-5.5 models.
  • Per-site results were mixed (Sol won two sites outright).
  • But, in aggregate, the older Codex models still write better extraction code.

Sol a good, balanced pick

What Sol does deliver is cost: at $1.47 per extractor, it is less than half the price of GPT-5.5 ($3.30), for quality that is only slightly lower. If you were running GPT-5.5 for scraping code generation, Sol is a straightforward cost win.

Luna wins the budget end

Terra and Luna, the budget tiers, are a different product entirely.

  • They wrote roughly half as much code, finished in under four minutes, and cost $0.26 to $0.57 per extractor.
  • But their extracted data quality landed at ~0.81, clearly below everything else.
  • Those quality losses come more from value precision than from missing fields. On the simplest site in the set, Luna scored 0.774 for extraction quality where GPT-5.5, Sol, and Terra all scored ~0.881 on the same fields. The two budget tiers land in the same place on quality; Luna gets there at half of Terra's cost.

Surprise #2: Sonnet 5 is the value pick

The cost column has a story of its own. Claude Sonnet 5 delivered cluster-level quality (0.879) at $1.48 per extractor - the cheapest run of any model above the budget tiers, and essentially the same price as GPT-5.6 Sol ($1.47), for clearly better output.

  • Part of the reason is Anthropic's introductory pricing ($2/$10 per million tokens through August 31). At standard rates, the same run would cost about $2.22 - still the cheapest in its quality cluster.
  • For extraction quality, Sonnet 5 is also a big step over its predecessor: 0.879 vs Sonnet 4.6's 0.846 in the identical setup. That is the same kind of generation-over-generation jump we saw when Sonnet 4.6 topped this benchmark in February.

Top quality has a price. Fable 5 cost $4.74 per extractor, roughly 3x Sonnet 5, for its +0.03 quality lead.

Fable 5 is still more token-efficient than its price sheet suggests:

  • Its list price is 3.3x Sonnet 5's standard rate. But its runs cost only about 2.1x as much, meaning it used roughly a third fewer price-weighted tokens for the same task.
  • And $4.74 for a working, tested extractor remains far below the cost of the engineering time it replaces.

What we measured, and what changed

The Zyte Scraping Code Benchmark gives a coding agent saved HTML pages from a real website, plus a target schema, and asks it to write code that extracts the schema's fields from each page.

We score the extracted values against carefully annotated ground truth. Our current test data set covers six sites and 21 pages, including:

  • E-commerce product and product listing pages, including categories and next-page URLs.
  • Several languages.
  • Schemas up to ~25 fields.
  • Pages up to multiple megabytes of HTML.

It is a representative subset of the larger dataset behind our previous benchmarks, with small ground-truth fixes - so scores here are not directly comparable to previously published numbers.

This time, we tested the models as coding agents out of the box:

  • Each in its native harness (Claude models in Claude Code, OpenAI models in Codex CLI).
  • Reasoning effort set to high, with an identical, separate evaluation pass scoring every model.

Which model should you pick?

  • Best quality: Claude Fable 5 is the clear winner - at $4.74 per extractor, it is the most expensive run in the table, but the premium is trivial next to the engineering time it saves.
  • Balanced: GPT-5.4, Sonnet 5, and GPT-5.5 are interchangeable on quality. Sonnet 5 was the cheapest of the three ($1.48 at introductory pricing, ~$2.22 at standard). GPT-5.6 Sol matches that price at somewhat lower quality - the better pick mainly if you're committed to the OpenAI stack.
  • Budget: GPT-5.6 Luna at $0.26 per extractor, if you accept ~0.10 lower quality and check the output more carefully.

One more pattern worth noting for maintainers is code complexity:

  • Claude models consistently write less code than the older Codex models for the same task - roughly 200–240 source lines of code (SLOC) vs ~300.
  • The GPT-5.6 family reverses Codex's verbosity - Terra wrote the least code of any model, at a quality cost.

What the agents still can't do

Every model in this table was handed the gift of clean, saved HTML from which to extract.

But getting that HTML from real websites at scale - past bans and bot detection - and running, scheduling, and monitoring the resulting spiders in production is exactly what none of these agents solve on their own.

That is where our stack sits:

  • Zyte API for access, with automatic ban handling driven by a library of 320,000 strategies, browser rendering, sessions, and data extraction.
  • Scrapy Cloud for operations, with cloud hosting, monitoring, logging and quality assurance for spiders at scale.
  • Agentic Web Data with agent skills that wire your coding agent or development environment into both.

The agents can help write great code, but they still need a great environment in which to run it.

Footnotes

  1. Cost: per-extractor cost of the code-generation phase, as reported by each agent's CLI at standard API rates. Sonnet 5 is shown at its introductory pricing ($2/$10 per million tokens through August 31, 2026); at standard $3/$15 pricing its cost would be about $2.22 per extractor.
  2. Run time: wall-clock per extractor, including identical infrastructure overhead (container start, repo clone/push) for every model.
  3. Noise: one run per model per extractor. Differences of ~0.01 ROUGE are within noise; Fable 5's +0.03 lead is comfortably above it.

Try Zyte API

Build your first scraper in minutes

Free trial, no credit card. From a single request to production in an afternoon.

Get started
AI-assisted data extractionLarge Language Models (LLMs)

Konstantin Lopukhin

Head of R&D

Konstantin is Zyte’s Head of R&D, where he leads research and development into machine learning methods to improve extraction, parsing, and content quality. He has also participated in Kaggle competitions, achieving a Grandmaster Title, and contributes to the community with t…

More from this author

In this article

  • The verdict
  • Surprise 1: GPT-5.6 doesn't move the frontier for scraping code
  • Sol in predecessor’s shade
  • Sol a good, balanced pick
  • Luna wins the budget end
  • Surprise #2: Sonnet 5 is the value pick
  • What we measured, and what changed
  • Which model should you pick?
  • What the agents still can't do
  • Footnotes

Follow

Get the latest

Zyte and the data web in your inbox — or wherever you already are.

Subscribe

Or follow elsewhere

The Community · Newsletter

The best of Zyte and the data web, in your inbox.

One curated edition — new articles, product updates, and the stories shaping the data web. No noise.

G2.com

Capterra.com

Proxyway.com

EWDCI logoMost loved workplace certificateZyte rewardISO 27001 iconG2 rewardG2 rewardG2 reward

© Zyte Group Limited 2026