PINGDOM_CHECK

Web Scraping Copilot is live. Build Scrapy spiders 3× faster, free in VS Code.

Install Now
Data Services
Pricing
LoginTry Zyte APIContact Sales

  • Unblocking and Extraction

    Zyte API

    The ultimate API for web scraping. Avoid website bans and access a headless browser or AI Parsing

    Ban Handling

    Headless Browser

    AI Extraction

    Enterprise

    DocumentationSupport

    Hosting and Deployment

    Scrapy Cloud

    Run, monitor, and control your Scrapy spiders however you want to.

    AI-powered IDE Integration

    Web Scraping-Copilot

    The complete, production-ready spider workflow from AI-generated code to cloud deployment. All in VS Code.

  • Data Services
  • Pricing

  • Blog

    Learn

    Case Studies

    Webinars

    Videos

    White Papers

    Join our Community
    Introducing Web Scraping Copilot 1.0: AI-Accelerated web scraping inside VS
    Blog Post
    The seven habits of highly effective data teams
    Blog Post

  • Product and E-commerce

    From e-commerce and online marketplaces

    Data for AI

    Collect and structure web data to feed AI

    Job Posting

    From job boards and recruitment websites

    Real Estate

    From Listings portals and specialist websites

    News and Article

    From online publishers and news websites

    Search

    Search engine results page data (SERP)

    Social Media

    From social media platforms online

  • Meet Zyte

    Our story, people and values

    Contact us

    Get in touch

    Support

    Knowledge base and raise support tickets

    Terms and Policies

    Accept our terms and policies

    Open Source

    Our open source projects and contributions

    Web Data Compliance

    Guidelines and resources for compliant web data collection

    Join the team building the future of web data
    We're Hiring
    Trust Center
    Security, compliance & certifications
LoginTry Zyte APIContact Sales

Zyte Developers

Coding tools & hacks straight to your inbox

Become part of the community and receive a bi-weekly dosage of all things code.

Join us
    • Zyte Data
    • News & Articles
    • Search
    • Social Media
    • Product
    • Data for AI
    • Job Posting
    • Real Estate
    • Zyte API - Ban Handling
    • Zyte API - Headless Browser
    • Zyte API - AI Extraction
    • Web Scraping Copilot
    • Zyte API Enterprise
    • Scrapy Cloud
    • Solution Overview
    • Blog
    • Webinars
    • Case Studies
    • White Papers
    • Documentation
    • Web Scraping Maturity Self-Assesment
    • Web Data compliance
    • Meet Zyte
    • Jobs
    • Terms and Policies
    • Trust Center
    • Support
    • Contact us
    • Pricing
    • Do not sell
    • Cookie settings
    • Sign up
    • Talk to us
    • Cost estimator

For Developers by Developers

The world leading data extraction platform

Get the web data you need fast

Tech stack for web scraping

Access developer tools, data extraction APIs and documentation, built and maintained by our world-leading team of over 100 extraction experts.

Get StartedTry Free
Go beyond standard proxy management

Zyte API

Collect data from any website with our AI powered web scraping solution that automatically uses the leanest proxy configuration and technical setup to return HTML, so you can forget about the tech and focus on the data.


  • Lean Anti-Ban

    Zyte API automatically Unlocks any website using the leanest set of tools possible on a site by site basis.

  • Headless Browser Zyte API

    Zyte API Contains a built-for-purpose Scriptable Headless browser to execute javascript, and automate browser actions.

Learn more

Turn web pages into JSON with AI Extraction

Switch on automatic extraction for articles, product pages or job listings and our patented ML will structure it for you. Forget about writing (and fixing) parsing code for your website.


  • Massively reduce time to build spiders

  • Minimize maintenance overhead per site

  • Can be extended and overridden

Try Zyte API: Automatic ExtractionLearn more

Dev tools that make scraping easy

Scrapy Cloud

Scrapy Cloud is our battle-tested platform for running and managing web crawlers.

Easily build crawlers and deploy them instantly. Your spiders run in the cloud, scaling on demand from thousands to billions of pages.

Try freeLearn more

Zyte API Enterprise

Supercharge Your Data Scraping Team. When data collection is too important to outsource, but laws, bans and proxies still keep you up at night. We have the perfect solution for you.


Software + Strategy = Zyte API Enterprise.

Talk to usLearn more

Pricing built for business of all sizes

Zyte API

from

$

2

/ 10k requests

Full pricing

  • $5 Free Credit

  • 24/7 support

  • Detailed usage reporting

  • Price calculator

Scrapy Cloud

-

$

9

/ month

Full pricing

  • Free starter plan

  • 120-day data retention

  • 1 Unit = 1 GB of RAM and 1 concurrent crawl

Unified data schemas

Data comes in all shapes and sizes. We deliver your web data in a standardized, unified format. So you’re assured on consistent quality and reduced development time across the millions of records we extract every day.

News & articleProductReal estateOrganisationProduct reviewsRestaurantMusicJobsFlightMovieVehiclesMedical drugForumCommentsSocial mediaSearch
Open source

Data extraction innovators

Open source is in our DNA. And you’ll see our commitment with over twenty active projects including Scrapy - the leading open source web crawling framework - as well as Splash, Dateparser and Spidermon.

Learn more
Scrapinghub

Tutorials and guides for developers

Tutorial

Advanced Use Cases for Session Management

Read more

Tutorial

Web Scraping Dynamic Websites With Zyte API

Read more

Tutorial

How to Scrape Images from Any Website: A Complete Guide

Read more

Article

Has Your Google Scraper Broken? Here’s What You Need to Know

Read more

Article

Build a better brain - get ready for RAG

Read more

G2.com

Capterra.com

Proxyway.com

EWDCI logoMost loved workplace certificateZyte rewardISO 27001 iconG2 rewardG2 rewardG2 reward
© Zyte Group Limited 2026
Read docs

1from scrapy import Request, Spider
2
3
4class MySpider(Spider):
5    my_spider = "toscrape_com"
6
7    def start_requests(self):
8        yield Request(
9            "https://books.toscrape.com/",
10            meta={
11                "zyte_api_automap": {
12                    "httpResponseBody": True,  
13                    "productList": True,  
14                },
15            },
16        )
17
18    def parse(self, response):
19        http_response_body: bytes = response.body
20        productList = response.raw_api_response["productList"]
Copy