Open source
Scrapy
The Python framework for crawling websites and extracting structured data. BSD-licensed, maintained by Zyte, and used everywhere from weekend projects to production pipelines.
PyCon Ireland 2026 · Dublin · 21 November
You know Scrapy. Meet the team that builds it
Zyte created Scrapy and still maintains it. At PyCon Ireland you can meet the people who work on Scrapy, Zyte API and Zyte MCP every day. Bring your trickiest web scraping question.
80M+
Scrapy downloads
15+ years
of web data engineering
1M+
developers using Zyte tools
21 Nov
Chartered Accountants House, Dublin
What we'll be talking about
Everything afterpip install scrapy
Scrapy gets you a working spider. These are the pieces that keep it working in production.
Zyte API
Unblocking, rendering and extraction in one API
Send a URL, get back HTML, a screenshot or structured data. Zyte API picks the proxy type and browser setup each request needs, so you stop maintaining them yourself.
Zyte MCP
Unblock your agent
A hosted MCP server that gives Claude Code, Cursor, Codex, GitHub Copilot and VS Code access to web pages and your Scrapy Cloud jobs. Nothing to install, and no separate MCP fee.
Claude Code & Codex plugin
Web scraping skills for your coding agent
Zyte Web Data is a free plugin that teaches Claude Code and Codex how to build Scrapy spiders the way our engineers do. Two commands to install, and the code it writes is plain Python you own.
Try it before Dublin
Add Zyte to the spider you already have
Already running Scrapy? Zyte API is one plugin and two settings away. Not using Scrapy? Call the API straight from Python, or give your coding agent the Zyte plugin or Zyte MCP with a single command.
1# pip install scrapy-zyte-api
2# settings.py
3ADDONS = {
4 "scrapy_zyte_api.Addon": 500,
5}
6ZYTE_API_KEY = "YOUR_API_KEY"
7
8# That's it. Your existing spiders now send
9# their requests through Zyte API.At the conference
Come and find us in Dublin
PyCon Ireland runs on Saturday 21 November at Chartered Accountants House, Pearse Street. Catch the Zyte team between talks, pick up a sticker, and tell us what keeps breaking in your pipeline. We'd rather hear about your hardest site than give you a pitch.
FAQ
Questions we get at every PyCon
Yes. Scrapy is BSD-licensed and stays that way. Zyte maintains it alongside a community of contributors, and you never need a Zyte account to use it.
The parts around your spiders that are hard to run in production: Zyte API for unblocking, browser rendering and extraction; Scrapy Cloud for running and scheduling spiders; and Zyte Data, where our engineers deliver the data to you.
Install scrapy-zyte-api, add the add-on and your API key to settings.py, and your existing spiders send their requests through Zyte API. The Scrapy sample above is the whole setup.
Yes, two ways. The free Zyte Web Data plugin for Claude Code and Codex helps your agent write Scrapy spiders. Zyte MCP, a hosted server at mcp.zyte.com/v1/mcp, lets agents in Claude Code, Cursor, Codex, GitHub Copilot or VS Code fetch pages and work with Scrapy Cloud. There's no separate MCP fee.
Pay as you go, priced per 1,000 responses. Simple sites cost less than heavily protected ones, and the Zyte API Playground shows you what a crawl will cost before you run it.