Field notes from the world of data extraction.
Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.

Optimizing Memory Usage Of Scikit-Learn Models Using Succinct Tries
We use the scikit-learn library for various machine-learning tasks at Zyte. For example, for text classification we'd typically build a statistical

Open source at Zyte
Open Source at Zyte, Now Zyte - Embrace the open-source movement at Zyte. Learn how we contribute to the community and promote transparency.

Open Source | Zyte | Looking Back At 2013
Looking Back at 2013 - Join us as we reflect on the highlights and achievements of Zyte in 2013. See how far we've come in the web scraping industry.

Marcos Campal Is A ScrapingHubber!
Marcos Campal is a Zyteber - Get to know one of our talented team members, Marcos Campal. Learn about his contributions to the world of web scraping.

Introducing Dash
Introducing Dash - Discover Dash, a new tool designed to simplify web scraping. Learn how to leverage its capabilities for better data extraction.

Why MongoDB Is A Bad Choice For Storing Scraped Data
MongoDB was used early on at Zyte to store scraped data because it's convenient. Scraped data is represented as (possibly nested) records which can be

Introducing Smart Proxy Manager
Introducing Zyte Smart Proxy Manager - Enhance your web scraping with Smart Proxy Manager. Explore its powerful features and benefits as a smart proxy manager.

Git Workflow For Scrapy Projects
Git Workflow for Scrapy Projects - Streamline your Scrapy projects with an efficient Git workflow. Improve collaboration and project management.

How To Fill Login Forms Automatically
We often have to write spiders that need to fill login forms to sites. Our customers provide us with the site, username and password, and we do the rest.

Spiders Activity Graphs
Spiders Activity Graphs - Visualize your spiders' performance with activity graphs. Optimize your web scraping process with actionable insights.

Finding Similar Items
This post describes an approach to the problem of finding similar items among crawled items and how this was implemented at Zyte.

Scrapy 0.15: Dropping Support for Python 2.5
Scrapy 0.15 Dropping Support for Python 2.5 - Important update for Scrapy users! Discover the changes in the latest release and the end of Python 2.5 support.




_HFpro5d6k3.png&w=256&q=75)
_E4PyVpfAxa.png&w=256&q=75)


-(1).png&w=1920&q=75)
-(1)_VZGHqxCgXV.png&w=1920&q=75)