PINGDOM_CHECK

The latest from Ian Kerins

Blog post thumbnail
Use case
How To
Leadership

The challenges e-commerce retailers face managing their web scraping proxies

In this article we discuss some main challenges that e-commerce retailers face on a daily basis due to the amount of web data needed and how to solve them.
Blog post thumbnail
Leadership

Visual web scraping tools no longer fit your purpose?

Visual web scraping tools are great. They allow people with little to no technical know-how to extract data from websites with only a couple of hours of upskilling, making them great for simple lead generation, market intelligence, and competitor monitoring projects.
Blog post thumbnail
Product Update

From the creators of Scrapy: Automatic data extraction API

To accurately extract data from a web page, developers usually need to develop custom code for each website.
Blog post thumbnail
Product Update

Zyte A.I. Automatic Extraction API | e-commerce & articles

Today, we’re delighted to announce the launch of the beta program for Zyte's new AI-powered Automatic Extraction API for automated product and article extraction.
Blog post thumbnail
Open Source

Spidermon: Zyte's secret to data quality

If you know anything about Zyte , you know that we are obsessed with data quality and data reliability.
Blog post thumbnail
Leadership

Proxy management: In-house or off-the-shelf?

Proxy management is the thorn in the side of most web scrapers. Without a robust and fully featured proxy infrastructure, you will often experience constant reliability issues and hours spent putting out proxy fires - a situation no web scraping professional wants to deal with.
Blog post thumbnail
Use case

The rise of web data in hedge fund decision making

Over the past few years, there has been an explosion in the use of alternative data sources in investment decision making in hedge funds, investment banks, and private equity firms.
Blog post thumbnail
Use case

Witness the power of web scraped product data for investors

Blog post thumbnail
Announcement

Looking Back at 2018: A Year of Growth and Challenges

What a year 2018 has been for Zyte !!
It’s hard to know where to start…
This year has seen tremendous growth at Zyte , setting us up to have a great 2019.
Blog post thumbnail
Announcement

Shubber Gettogether 2018: Gathering Innovators and Thinkers

2018 has been a great year at Zyte , so there was no better way to cap it off than with a company retreat in Lisbon, Portugal.
Blog post thumbnail
Leadership

Data Quality Assurance For Enterprise Web Scraping

When it comes to web scraping, one key element is often overlooked until it becomes a big problem.
Blog post thumbnail
Use case

Price intelligence: Scraping 100 billion products pages

Web scraping can look deceptively easy these days. There are numerous open-source libraries/frameworks, visual scraping tools, and data extraction tools that make it very easy to scrape data from a website.
Blog post thumbnail
Use case

A Sneak Peek Inside What Hedge Funds Think of Alternative Financial Data

Unbeknownst to many, there is a data revolution happening in finance.
In their never ending search for alpha hedge funds and investment banks are increasingly turning to new alternative sources of data to give them an informational edge over the market.
Blog post thumbnail
Use case

Want To Predict Fitbit’s Quarterly Revenue? Eagle Alpha Did It Using Web Scraped Product Data

Throughout the history of the financial markets information has been power.
Blog post thumbnail
Use case

GDPR Compliance Tools for Web Scraping Crawlers

Over the last couple weeks, GDPR has brought data protection center stage. What was once a fringe concern for most businesses overnight became a burning problem that needed to be solved immediately.
Blog post thumbnail
Open Source

Scraping The Steam Game Store With Scrapy

This is a guest post from the folks over at Intoli, one of the awesome companies providing Scrapy commercial support and longtime Scrapy fans.