Field notes from the world of data extraction.

Articles, interviews and analysis on how data is gathered, used and fought over — written by the people closest to it.

Handling COVID-19 as a Fully Remote Company: Zyte's Approach
Scraping strategy

Handling COVID-19 as a Fully Remote Company: Zyte's Approach

As a fully remote company, we at Zyte would like to take this opportunity to offer help and support to anyone who is trying to adapt to a remote workplace.

Suzanne Hassett2 min read
Article data extraction | How to Maximize Quality
Use case

Extract Article HTML With News API

Anyone interested in leveraging the web content faces some challenges. Learn how to extract clean and high-quality article content using our news API.

Ivan de Prado Alonso9 min read
Job Postings API Stable Release: Simplified Access to Data
Use case

Job Postings at Scale Beta API: Simplifying Recruitment

Job Postings at Scale Beta API - Unlock the potential of job postings data with our Job Postings at Scale Beta API, empowering your job market analysis.

Attila Toth2 min read
Building Spiders Made Easy | GUI For Scrapy Shell
Open-source

Building Spiders Made Easy | GUI For Scrapy Shell

We are introducing a new open source project, Scrapy-GUI. It provides a GUI for Scrapy Shell and makes it easier to write spiders.

Roy Healy4 min read
Proxy management: In-house or off-the-shelf proxy solutions?
Handling Bans

Ways for Web Scraping Without Getting Blocked

Learn what the subtle ways a website can recognize you as a bot and not a human. Understand the best practices to access web data while you scrape the web.

Attila Toth6 min read
Custom Crawling & News API: Design A Web Scraping Solution
Use case

News Web Data Extraction To Predict Irish Election Results

This analysis of news data extracted from multiple news websites provides a correlation between media coverage and final votes during Irish Election 2020.

Cristi Constantin6 min read
Backconnect proxies explained: How to use them in a scraping project?
Proxies

Introducing Zyte Smart Proxy Manager — Free Trials & New Plans

We are introducing a new Zyte Smart Proxy Manager plans that better suit your web scraping proxy needs. Try Zyte Smart Proxy Manager for completely free.

Pablo Hoffman2 min read
Gender Inequality Across Programming Languages
Scraping strategy

Best Recruitment Tips: How To Scout Top Talent

It's time for employers to turn towards the untapped power of web scraped recruitment data. Read the blog for recruitment tips from our Talent Acquitision team.

Eric Burke5 min read
EuroPython 2015: Uniting Pythonistas in Europe
Developer interest

End year review: The most important things in 2019 for us

2019 has been a monumental year for us. With the wealth of experience and knowledge that we collected in 2019, we hope to make 2020 even better for you!

Attila Toth4 min read
The rise of web data in hedge fund decision making
Use case

How To Leverage Alternative Data In Asset Management

As big data continues to disrupt the investment research market, learn how harnessing the power of web extracted alternative data can give you an edge.

Marie Moynihan4 min read
Backconnect proxies explained: How to use them in a scraping project?
Proxies

Backconnect proxies explained: How to use them in a scraping project?

Scaling up your web scraping project without a reliable backconnect rotating proxy service is difficult. Learn how a backconnect proxy works and when to use it.

Attila Toth4 min read
4 Sectors That Benefited Most From Business Intelligence Software
Use case

4 Sectors That Benefited Most From Business Intelligence Software

Business Intelligence software can transform data into gold. Learn more about the various use cases where a business intelligence software can be leveraged.

Himanshi Bhatt5 min read