Field notes from the world of data extraction.

Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.

4 simple Steps for effective Automated Data QA Process
Product Update

Scrapy + MonkeyLearn: Textual Analysis Of Web Data

We recently announced our integration with MonkeyLearn, bringing machine learning to Scrapy Cloud. MonkeyLearn offers numerous text analysis services via its

Valdir Stumm Junior6 min read
A Practical Guide to Web Data QA (Part V): Navigating Broad Crawls
Product Update

Introducing Scrapy Cloud 2.0

Scrapy Cloud has been with Zyte since the beginning, but we decided some spring cleaning was in order. To that end, we’re proud to announce Scrapy

Valdir Stumm Junior6 min read
A Not-So-Short Story on Getting Decent Internet Access
Scraping strategy

A Not-So-Short Story on Getting Decent Internet Access

A Not-So-Short Story on Getting Decent Internet Access - Read our adventure in securing reliable internet access for efficient web scraping operations.

agustin7 min read
A Practical Guide To Web Data QA Part IV
Open-source

Scraping Websites Based On ViewStates With Scrapy

Welcome to the April Edition of Scrapy Tips from the Pros. Each month we’ll release a few tricks and hacks that we’ve developed to help make your Scrapy

Valdir Stumm Junior5 min read
Want To Predict Fitbit’s Quarterly Revenue? Eagle Alpha Did It Using Web Scraped Product Data
How To

Machine Learning With Web Scraping: New MonkeyLearn Addon

We deal in data. Vast amounts of it. But while we’ve been traditionally involved in providing you with the data that you need, we are now taking it a step

Cecilia Haynes5 min read
Mapping Corruption In The Panama Papers With Open Data
Use case

Mapping Corruption In The Panama Papers With Open Data

We are at a point in the digital age where corruption is increasingly difficult to hide. Information leaks are abundant and shocking.

Cecilia Haynes5 min read
Master Web Scraping for E-Commerce: 5 Strategies for Success
Use case

Web Scraping to Create Open Data: Empowering Data Accessibility

Web Scraping to Create Open Data - Embrace the power of web scraping in generating open data. Contribute to the open data movement.

Cecilia Haynes4 min read
Chats with Rinar Solutions: Insights into Remote Working
Open-source

Scrapy Tips from the Pros (March 2016 Edition): Mastering the Craft

Scrapy Tips from the Pros: March 2016 Edition - Upgrade your web scraping game with the latest expert tips from our Scrapy pros.

Valdir Stumm Junior4 min read
Chats with Rinar Solutions: Insights into Remote Working
Open-source

This Month In Open Source At Zyte March 2016

Welcome to This Month in Open Source at Zyte! In this monthly column, we share all the latest updates on our open source projects including Scrapy,

Adrian Chaves5 min read
Google Summer of Code 2015: Empowering Open Source Projects
Open-source

Join Zyte for Google Summer of Code 2016: Contributing to Open Source

Join Zyte for Google Summer of Code 2016 - Get involved in Google Summer of Code with Zyte. Contribute to exciting open-source projects.

Cecilia Haynes3 min read
Blog Comments API Beta Release: Engaging with Readers
Use case

How Web Scraping Reveals Lobbying and Corruption in Peru

How Web Scraping is Revealing Lobbying and Corruption in Peru - Discover how web scraping is shedding light on lobbying and corruption issues in Peru.

Valdir Stumm Junior4 min read
A Practical Guide To Web Data QA Part IV
Product Update

Splash 2.0: Powering Web Rendering with QT 5 and Python 3

Splash 2.0: Here with Qt 5 and Python 3 - Explore the new and improved Splash 2.0 with Qt 5 and Python 3 support. Elevate your web scraping capabilities.

Valdir Stumm Junior3 min read