Neha is a Senior Developer Advocate at Zyte. She works at the intersection of web scraping, developer experience, and AI, helping developers understand what is possible with web data and how to achieve it. She creates technical experiences: blogs, events, workshops, and demos that draw inspiration from unexpected places. fiction, films, conversations that stuck, and experiments that broke. She connects the dots and transforms them into content that makes complex things click.
Subscribe to our Blog
The latest from Neha Setia Nagpal
Product Update
The Scrapy whisperer: Adrian Chaves on Web Scraping Copilot
Open Source
More data, more trouble: How a perfect corpus corrupted my AI dream
Open Source
Claude skills, MCP or Web Scraping Copilot: Which should you choose?
Open Source
A Deep Dive into Zyte's Open-Source Libraries
How To
Use case
Analyze web data quickly with Jupyter Notebooks and Zyte API
How To
Handling Bans
Overcoming web scraping challenges of Puppeteer and Playwright
How To
Handling Bans
How Session Management Minimizes Bans and Enhances Data Quality in Web Scraping
Use case
How To
Best web scraping methods for JavaScript-heavy websites
Use case
How To
Open Source
Selenium, Puppeteer, Playwright: Which tool is right for web scraping at scale?
Use case
Handling Bans
How To
Why are Sessions Crucial in Web Data Extraction?
Use case
Open Source
4 essential Scrapy plugins for building efficient and effective spiders
Open Source
Use case
How To
The Scraper’s System Part 2: Explorer’s Compass to analyze websites
Newsletter
How Zyte API takes care of the fundamental needs of your web scraping project!
How To
How Web Scraping and Graph Databases Can Power Recommendation Engines
Leadership
Scraper's System: Secrets to architect scalable web scraping
Handling Bans
How To Use Selenium With Zyte Smart Proxy Manager
Handling Bans
How to use Playwright with Smart Proxy Manager
Handling Bans
The best way to Use Puppeteer With Zyte Smart Proxy Manager
Handling Bans
A Developer’s Guide To Rotating Proxies In Python
Handling Bans
Rotating proxies and why they are important | Rotating proxy
Use case
Find the best pint using web scraping on St. Patrick’s day
An interview with one of the popular framework’s co-maintainers on Zyte’s new, AI-powered Scrapy sidekick.
What a failed experiment taught me about curated data, prompting, and when scraping actually matters.
Three ways to bring Zyte-powered web data into your AI workflow — from production spiders to conversational extraction.
Discover how Zyte’s open-source libraries like ClearHTML, Extruct, Chomp.js, and more simplify web data extraction and processing.
With AI Scraping in Zyte API, you can pull data from any e-commerce website straight into your Jupyter notebooks.
Discover the challenges of scaling web scraping with Playwright & Puppeteer, from browser farm management to IP rotation and anti-scraping tactics.
User sessions can help overcome website bans, handle IP rate limits, streamline cookie management, and avoid detection.
Discover key techniques to efficiently extract data from JavaScript-heavy websites.
Discover the strengths and limitations of Selenium, Puppeteer, and Playwright for web scraping at scale.
Whether you're scraping a simple webpage or navigating a complex multi-step process, leveraging sessions is key to ensuring success.
Here are four essential Scrapy plugins we use to build efficient web crawlers for our customers.
In the first part, we discussed a template to define the clear purpose of your web scraping system that can help you design your crawlers better and prepare you for the uncertainty involved in a large scale web scraping project.
I recently had the pleasure of participating in the third episode of Graphversation, a monthly live stream series that brings together graph experts and Neo4j enthusiasts for engaging and enlightening discussions about the captivating world of graphs.
Staring at the Statement of Work opened on your laptop screen, your thoughts must be wandering in all directions - where do you start?
Using Selenium and/or Zyte Smart Proxy Manager? You just stumbled upon the right blog.
We have launched a new Zyte SmartProxy Playwright and we’re sure you’re going to love it!
We are super excited to share some good news for all the Puppeteer users who are looking for an easy-to-integrate anti-ban solution for extracting data from javascript-heavy websites.
If you are new to proxies, we recommend skimming through this blog to understand what a proxy is and why you need proxies for web scraping.
At Zyte we are known for our ability to help companies make mission-critical business decisions through the use of web scraping.
Before we begin, take a look at this short video - it's the scene from Harry Potter where he gets The Invisibility Cloak. It’ll help us better understand the concepts behind proxies.