Senior editor

Robert Andrews

Robert is a journalist and editor turned content strategist who eats and sleeps the web. Previously senior editor at Google, News Corp, ContentNext and others.

Subscribe to our Blog

The latest from Robert Andrews

The seven habits of highly effective data teams

Announcement

No-code web scraping workflows are here: Introducing the Zyte integration for Zapier

Leadership

Is your AI breaking the law? Legal experts’ advice for web scrapers

Sun, sea and code: What we built at Zyte’s API hackathon

Open Source

Scrapy in 2026: New release brings modern async crawling standards

Data in 2026: Bets and forecasts from web experts

Zyte’s 2025 review: Year of locks and unlocks

Zyte leads the pack in Proxyway’s 2025 Web Scraping API Report

Beyond the block: The front line of data access

How to build a daily industry news digest

Five key takeaways from Extract Summit 2025

Leadership

Death of the Proxy? There’s An API for That

Leadership

Why the Best Engineers Are Actually Lazy

Open Source

The future of Scrapy: Smarter, faster and ready for AI-powered scraping

Open Source

Rise of the Data Vendor: How Outsourcing is Transforming Supply and Fuelling Businesses

Discover the seven habits that set high-performing data teams apart—from treating data as a product to ensuring data trust, quality, and decision impact. Learn how leading teams scale reliable data systems.

Now you can plug web data into all your business apps, without code.

Legal experts discuss how AI, web scraping, copyright law, and the EU AI Act intersect—covering fair use, data provenance, and compliance risks for businesses.

Discover the 7 creative projects built at Zyte’s API Hackathon in Turkey, from security scanning tools to price comparison engines and smart caching systems.

Scrapy 2.14.0 is released with a major under-the-hood modernization. Say goodbye to Twisted Deferreds.

What will 2026 have in store for the world of web data? We asked eight experts for their predictions.

2025 reshaped web scraping. From AI-assisted extraction and escalating bot defenses to clearer legal frameworks and cheaper APIs, Zyte reviews the forces redefining access to web data—and what comes next.

Proxyway’s 2025 Web Scraping API Report ranks Zyte #1 for unblocking success, speed, cost efficiency, and AI-powered data extraction. See the full breakdown.

A deep dive into the evolving battle for web data access—featuring insights from Castle, Scrapoxy, and Zyte at Extract Summit 2025. Learn how AI, anti-bots, economics, and authentication standards like Web Bot Auth are transforming scraping, security, and the future of the open internet.

Learn how data analyst Anshika Khandelwal automated a daily AI funding news digest using n8n and Zyte API. Discover how to pull articles, classify funding stories, and deliver a curated newsletter that saves 10+ hours per week.

From AI-accelerated scraping to “dead internet” risks and rising access wars, these five takeaways from Extract Summit 2025 show where web data is heading next.

The proxy era is ending as web scraping shifts from managing IP pools to smarter, API-driven solutions.

There’s a popular archetype in web scraping circles: the heroic engineer who fights CAPTCHAs at 3 a.m., hand-tunes a proxy farm before breakfast, then rewrites four spiders after lunch because the target sites pushed new JavaScript.

What does the future hold for the tool some describe as “the gift that revolutionised web scraping”?

With the emergence of managed data extraction vendors, businesses no longer need to gather web data themselves.