zyte logo
scrapy cloud

Scalable cloud hosting for your Scrapy spiders

Try Free
The perfect companion to Scrapy

Host and monitor your Scrapy spiders in the cloud

Manage and automate your spiders at scale

Think of it as a Heroku for web data extraction. From the creators of the Scrapy framework.

Reliability
when storing your spiders

Focus on the output

Run, monitor, and control your crawlers with Scrapy Cloud's easy-to-use web interface

Deploy
and monitor your spiders with ease

On-demand scaling

Increase the scale and firepower of your scraping operation with only a few clicks.

Scale
your web scraping easily

Easy integration

Seamlessly integrate Smart Proxy Manager (formerly Crawlera), Splash, Spidermon, etc. to your web scraping stack to take the hassle out of scraping the web at scale.

Seamless
integration with our other tools

Full suite QA tools

Built in spider monitoring, logging and data QA tools. Along with easy integration of Spidermon, our open source spider monitoring framework.

assurance at it's core
Quality

Zero vendor lock-in

Develop your code using Scrapy, the most popular open-source web scraping framework, and retain the freedom to migrate it to any hosting solution.

Freedom
to migrate your spiders anywhere you want
2,000+ companies use Scrapy Cloud

Trusted by leading brands

Specifically designed for web scraping at scale
Can connect with Github

Everything you need straight out of the box

Start scraping the web in minutes.  Deploy code to Scrapy Cloud via your command line or directly with GitHub

Real-time dashboard
bullet point
Intelligent scheduling
bullet point
Built-in monitoring
bullet point
Customizable containers
bullet point
Smart Proxy Manager integration
bullet point
Splash Headless browser integration
zyte web scraping illustration

Only pay for as much capacity as you need.

Elastic pricing

Starter

$0free forever

Ideal for small projects or if you simply want to give Scrapy Cloud a try.
  • Unlimited team members
  • Unlimited projects
  • Unlimited requests
  • 1 hour crawl time
  • 1 concurrent crawl
  • 7 day data retention

Professional

$9/unit per month
Ideal for developers and companies who want a hassle free way to scrape the web at scale.
  • Unlimited team members
  • Unlimited projects
  • Unlimited requests
  • Unlimited crawl runtime
  • Unlimited concurrent crawls
  • Intelligent crawl scheduling
  • 120 day data retention
  • Personalised support
1 Scrapy Unit = 1 GB of RAM and 1 concurrent crawl

Provides a simple way to run your crawls and browse results

Scrapy is really pleasant to work with. It hides most of the complexity of web crawling, letting you focus on the primary work of data extraction.

Zyte (formerly Scrapinghub) provides a simple way to run your crawls and browse results, which is especially useful for larger projects with multiple developers.

Jacob Perkins - StreamHacker.com