Zyte Writer
Neha Setia Nagpal
Neha is a Senior Developer Advocate at Zyte. She works at the intersection of web scraping, developer experience, and AI, helping developers understand what is possible with web data and how to achieve it. She creates technical experiences: blogs, events, workshops, and demos that draw inspiration from unexpected places. fiction, films, conversations that stuck, and experiments that broke. She connects the dots and transforms them into content that makes complex things click.
The latest from Neha Setia Nagpal
Product Update
The Scrapy whisperer: Adrian Chaves on Web Scraping Copilot
An interview with one of the popular framework’s co-maintainers on Zyte’s new, AI-powered Scrapy sidekick.
Open Source
More data, more trouble: How a perfect corpus corrupted my AI dream
What a failed experiment taught me about curated data, prompting, and when scraping actually matters.
Open Source
Claude skills, MCP or Web Scraping Copilot: Which should you choose?
Three ways to bring Zyte-powered web data into your AI workflow — from production spiders to conversational extraction.
Open Source
A Deep Dive into Zyte's Open-Source Libraries
Discover how Zyte’s open-source libraries like ClearHTML, Extruct, Chomp.js, and more simplify web data extraction and processing.
How To
Use case
Analyze web data quickly with Jupyter Notebooks and Zyte API
With AI Scraping in Zyte API, you can pull data from any e-commerce website straight into your Jupyter notebooks.
How To
Handling Bans
Overcoming web scraping challenges of Puppeteer and Playwright
Discover the challenges of scaling web scraping with Playwright & Puppeteer, from browser farm management to IP rotation and anti-scraping tactics.
How To
Handling Bans
How Session Management Minimizes Bans and Enhances Data Quality in Web Scraping
User sessions can help overcome website bans, handle IP rate limits, streamline cookie management, and avoid detection.
Use case
How To
Best web scraping methods for JavaScript-heavy websites
Discover key techniques to efficiently extract data from JavaScript-heavy websites.
Use case
How To
Open Source
Selenium, Puppeteer, Playwright: Which tool is right for web scraping at scale?
Discover the strengths and limitations of Selenium, Puppeteer, and Playwright for web scraping at scale.
Use case
Handling Bans
How To
Why are Sessions Crucial in Web Data Extraction?
Whether you're scraping a simple webpage or navigating a complex multi-step process, leveraging sessions is key to ensuring success.
Use case
Open Source
4 essential Scrapy plugins for building efficient and effective spiders
Here are four essential Scrapy plugins we use to build efficient web crawlers for our customers.
Open Source
Use case
How To
The Scraper’s System Part 2: Explorer’s Compass to analyze websites
In the first part, we discussed a template to define the clear purpose of your web scraping system that can help you design your crawlers better and prepare you for the uncertainty involved in a large scale web scraping project.
How To
How Web Scraping and Graph Databases Can Power Recommendation Engines
I recently had the pleasure of participating in the third episode of Graphversation, a monthly live stream series that brings together graph experts and Neo4j enthusiasts for engaging and enlightening discussions about the captivating world of graphs.
Leadership
Scraper's System: Secrets to architect scalable web scraping
Staring at the Statement of Work opened on your laptop screen, your thoughts must be wandering in all directions - where do you start?
Handling Bans
How To Use Selenium With Zyte Smart Proxy Manager
Using Selenium and/or Zyte Smart Proxy Manager? You just stumbled upon the right blog.
Handling Bans
How to use Playwright with Smart Proxy Manager
We have launched a new Zyte SmartProxy Playwright and we’re sure you’re going to love it!
Handling Bans
The best way to Use Puppeteer With Zyte Smart Proxy Manager
We are super excited to share some good news for all the Puppeteer users who are looking for an easy-to-integrate anti-ban solution for extracting data from javascript-heavy websites.
Handling Bans
Rotating proxies and why they are important | Rotating proxy
If you are new to proxies, we recommend skimming through this blog to understand what a proxy is and why you need proxies for web scraping.
_HFpro5d6k3.png&w=256&q=75)
_E4PyVpfAxa.png&w=256&q=75)
-(1).png&w=1920&q=75)
-(1)_VZGHqxCgXV.png&w=1920&q=75)
