Explore resources by topic or category
Browse by Category
Browse by topic
Learn
Building a production-style web scraper with Scrapy, Docker, and PostgreSQL
Ayan Pahwa
March 2, 2026
Blog
Teaching AI to scrape like a pro: how we measure LLMs’ data quality
Theresia Tanzil
10 min
February 23, 2026
AI-enabled code editors can now conjure scraping code on command. But is it any good? Here’s how Zyte re-engineered LLMs with Web Scraping Copilot to drive best-in-class output.
Learn
Web scraping for pricing intelligence: how to track competitor prices at scale
Mitch Holt
10 mins
February 2, 2026
Compare the best headless browsers for web scraping in 2026. Learn when to use Playwright, Puppeteer, Selenium, or Zyte API’s managed CDP browser for scalable, anti-ban scraping.
Learn
Best headless browsers for web scraping in 2026
10 mins
January 27, 2026
Compare the best headless browsers for web scraping in 2026. Learn when to use Playwright, Puppeteer, Selenium, or Zyte API’s managed CDP browser for scalable, anti-ban scraping.
Learn
Best proxy providers for web scraping in 2026
10 mins
January 16, 2026
Compare the best proxy providers for web scraping in 2026. Learn which residential, ISP, and mobile proxies work best—and when teams move beyond proxies to automation.
Learn
The Modern Scrapy Developer's Guide (Part 3): Auto-Generating Page Objects with the Web Scraping Copilot
John Rooney
December 16, 2025
Learn
The Modern Scrapy Developer's Guide (Part 2): Page Objects with scrapy-poet
John Rooney
December 16, 2025
Learn
The Modern Scrapy Developer's Guide (Part 1): Building Your First Spider
John Rooney
December 16, 2025
Blog
AI Web Scraping as the Future of Scalable Data Collection
Karlo Jedud
5 mins
September 4, 2025
AI-powered web scraping is transforming data collection by making it faster, smarter, and highly scalable. Learn how it overcomes traditional scraping challenges and unlocks new opportunities for businesses across industries.
Learn
How to Scrape Search Engine Results
Karlo Jedud
5 mins
August 25, 2025
From SEO audits to market intelligence, lead generation, and even brand monitoring, structured SERP data can give you the insights you need to make smarter, faster business decisions. But scraping search engines isn't as simple as sending a GET request and collecting some HTML.
Learn
Scrape Web Pages and Files Using Python, wget, and Zyte
Karlo Jedud
7 mins
June 27, 2025
The command-line utility wget (pronounced "web-get") can download online files. This free network downloader may run in the background without user intervention.