PINGDOM_CHECK

Explore resources by topic or category

Learn

From Basic to Advanced Ways of Managing Bans in Web Scraping

Karlo Jedud
10 mins
February 7, 2025
Discover a comprehensive guide on managing bans in web scraping, from basic strategies to advanced techniques, ensuring efficient and ethical data extraction.

Blog

Has Your Google Scraper Stopped Working? Here’s What You Need to Know

Theresia Tanzil
4 Mins
January 23, 2025
Discover how to adapt to Google’s January 2025 SERP changes requiring JavaScript rendering.

Blog

Overcoming web scraping challenges of Puppeteer and Playwright

Neha Setia Nagpal
1 mins
December 5, 2024
Discover the challenges of scaling web scraping with Playwright & Puppeteer, from browser farm management to IP rotation and anti-scraping tactics.

Blog

How Session Management Minimizes Bans and Enhances Data Quality in Web Scraping

Neha Setia Nagpal
1 mins
November 18, 2024
User sessions can help overcome website bans, handle IP rate limits, streamline cookie management, and avoid detection.

Blog

Web Scraping APIs: Igniting a New Era of Efficiency in Web Data Extraction

Cleber Alexandre
1 mins
October 17, 2024
In this article we show how AI-powered web scraping has become the fastest way to get data from the internet.

Learn

Proxy-Shopping Primer: Datacenter Proxies and Beyond

Theresia Tanzil
20 mins
September 18, 2024
Datacenter proxy is a proxy management system built on top of a pool of datacenter IPs used for web scraping.

Blog

Why are Sessions Crucial in Web Data Extraction?

Neha Setia Nagpal
1 mins
September 9, 2024
Whether you're scraping a simple webpage or navigating a complex multi-step process, leveraging sessions is key to ensuring success.

Blog

Static vs Rotating Proxies: A Comprehensive Guide

Felipe Boff Nunes
10 Mins
September 5, 2024
The decision between static and rotating proxies can significantly impact your success rates in data extraction activities.

Blog

Choosing Between Puppeteer vs. Selenium for Web Scraping

Karlo Jedud
8 mins
July 10, 2024
Web scraping tools save hours of work by automating data extraction, testing web applications, and performing repetitive tasks.

Blog

When LLM Web Scraping isn't Enough to Scale Web Scraping

Anita Clarke
6 mins
June 12, 2024
If you’re not using AI, you’re being left behind. Ever since ChatGPT burst onto the scene, this is the message developers are constantly hearing.

Blog

Use Powerful Ban Management With Zyte API’s Scripting API

Mushtaq Ali and Luiz Silva
4 mins
April 25, 2024
You encounter so many different anti-bot systems as a developer working on custom projects for Zyte Data clients. This cat and mouse game requires your time, persistence and deep knowledge of web scraping.

Blog

Simplify Your Web Scraping Project with Zyte API

Daniel Cave
5 mins
November 15, 2023
Web scraping developers often find themselves in a struggle to manage bans and blocks. Every time they resolve a ban, it's only a matter of time before their scrapers encounter the same issue again.