ArticleOpen-source

Portia: The Open-Source Visual Web Scraper

As you can see, Portia allows you to visually configure what’s crawled and extracted in a very natural way. It provides immediate feedback, making the process

Shane Evans · Founder, CEO at Zyte

1 min read ·

Portia: The Open-Source Visual Web Scraper

Announcing Portia, the open-source visual web scraper!

Note: Portia is no longer available for new users. It has been disabled for all the new organisations from August 20, 2018 onward. Please visit our Zyte API page

We’re proud to announce the developer release of Portia, our new open source visual scraping tool based on Scrapy. Check out this video:

As you can see, Portia allows you to visually configure what’s crawled and extracted in a very natural way. It provides immediate feedback, making the process of creating web scrapers quicker and easier than ever before!

Portia is available to developers on github. We plan to offer a hosted version on Zyte soon, which will be compatible with Autoscraping and fully integrated with our platform.

Please send us your feedback!

Try Zyte API

Build your first scraper in minutes

Free trial, no credit card. From a single request to production in an afternoon.

Get started
Open-source

Shane Evans

Founder, CEO at Zyte

Shane's articles trace Zyte's history and open-source projects, including the Scrapinghub-to-Zyte rebrand, Portia's visual scraping tool, and Dash. He also wrote on data-storage architecture decisions (why MongoDB was a poor fit for scraped data), remote-work transition lessons f…

More from this author

Continue reading

Scrapy in 2026: New release brings modern async crawling standards
Open Source

Scrapy in 2026: New release brings modern async crawling standards

Scrapy 2.14.0 is released with a major under-the-hood modernization. Say goodbye to Twisted Deferreds.

Robert Andrews6 min
The new economics of web data: Smaller scraping just got cheaper
Open Source

The new economics of web data: Smaller scraping just got cheaper

Smarter tools and AI-driven automation are rewriting the rules of web scraping. As costs fall and setup barriers vanish, smaller teams can now compete at scale, reshaping how the web’s data economy works.

Theresia Tanzil2 mins
A Deep Dive into Zyte's Open-Source Libraries
Open Source

A Deep Dive into Zyte's Open-Source Libraries

Discover how Zyte’s open-source libraries like ClearHTML, Extruct, Chomp.js, and more simplify web data extraction and processing.

Neha Setia Nagpal1 mins
Zyte Blog — field notes from the world of data extraction
Open Source

Building Spiders Made Easy | GUI For Scrapy Shell

As a python developer at Zyte (formerly Scrapinghub), I spend a lot of time in the Scrapy shell.

Roy Healy4 Mins
The future of Scrapy: Smarter, faster and ready for AI-powered scraping
Open Source

The future of Scrapy: Smarter, faster and ready for AI-powered scraping

What does the future hold for the tool some describe as “the gift that revolutionised web scraping”?

Robert Andrews6 min
Rise of the Data Vendor: How Outsourcing is Transforming Supply and Fuelling Businesses
Open Source

Rise of the Data Vendor: How Outsourcing is Transforming Supply and Fuelling Businesses

With the emergence of managed data extraction vendors, businesses no longer need to gather web data themselves.

Robert Andrews6 min

The Community · Newsletter

The best of Zyte and the data web, in your inbox.

One curated edition — new articles, product updates, and the stories shaping the data web. No noise.