Explore resources by topic or category

It’s been another standout year for Scrapinghub and the scraping community at large. Together we crawled 79.1 billion pages (nearly double 2016), with over 103 billion scraped records; what a year!

We started 2016 with an eye on blowing 2015 out of the water. Mission accomplished.

It’s that time of year again! Google Summer of Code 2016 applications are upon us and we welcome any and all students who are interested in open source and web scraping.

Earlier this month we attended PyCon Philippines as a gold sponsor, presenting on the 2nd day. This was particularly exciting as it was the first time the whole Philippines team was together in one place and it was nice meeting each other in person!

We are very excited to be participating again this year on Google Summer of Code.

33 Zytans from 15 countries will be meeting (most of them, for the first time) in Bilbao, for what is going to be our largest get-together event so far.

We are veterans in the chat group arena. We have been using one form of another since we started Zyte in 2010 and I've been personally using corporate group chats since 2004.

Joanne O’Flynn meets with Pablo Hoffman and Shane Evans to find out what inspired them to set up web crawling company Zyte.

One year ago we were looking back at the great 2013 we had and realized we would have quite a big challenge in front of us in order to have as much growth as we had during last year.

This time last year Pablo and I were chatting about the previous year and what to expect in 2013. I noticed that our team had almost doubled in size in the previous year and we wondered could that possibly continue in 2013?