Explore resources by topic or category

Introducing Scrapy Cloud with Python 3 Support - Discover the enhanced features of Scrapy Cloud, now with Python 3 support for better performance.

Introducing Portia2Code: Seamlessly integrate Portia projects into Scrapy spiders with our latest guide, unlocking new possibilities for efficient web scraping.

Introducing the Datasets Catalog - Explore our vast datasets catalog. Find the perfect data for your research and analysis needs.

Zyte Smart Proxy Manager is a smart downloader that allows you to crawl and scrape websites responsibly. It rotates IP addresses and keeps

Data Extraction with Scrapy and Python - Learn the art of data extraction with Scrapy and Python. Harness the full potential of web scraping.

We recently announced our integration with MonkeyLearn, bringing machine learning to Scrapy Cloud. MonkeyLearn offers numerous text analysis services via its

Scrapy Cloud has been with Zyte since the beginning, but we decided some spring cleaning was in order. To that end, we’re proud to announce Scrapy

Splash 2.0: Here with Qt 5 and Python 3 - Explore the new and improved Splash 2.0 with Qt 5 and Python 3 support. Elevate your web scraping capabilities.

Migrate Your Kimono Projects to Portia - Seamlessly transition from Kimono to Portia. Continue your web scraping projects with ease.

Python 3 Support with Scrapy 1 - Upgrade your Scrapy projects to Python 3. Leverage the latest features and improvements.

Introducing JavaScript Support for Portia - Unlock the potential of Portia with JavaScript support. Improve web scraping on JavaScript-rendered pages.

This past year, we have been working on a distributed version of our crawl frontier framework, Frontera. This work was partially funded by DARPA and is