WHITEPAPER

6 best practices for efficient web scraping

A glimps of what's inside

  • How to not harm the websites you scrape.

  • How to avoid violating copyright.

  • How to identify yourself.

  • What to look for before you start your project.

  • Being aware of GDPR.

  • And much more.

Introduction

We hear a lot that scraping is a legal grey area, but the truth is scraping itself isn’t illegal. It’s the manner in which you scrape and what you scrape that falls into the grey area. In this guide, we’ll give you a set of guidelines to follow when scraping the web so you know when you need to be cautious about the manner and type of data you scrape.