We are at a point in the digital age where corruption is increasingly difficult to hide. Information leaks are abundant and shocking.
Open data is the idea that some data should be freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control.
Update: With the release of the Panama Papers, a reliable means of exposing corruption and the methods of money laundering and tax evasion are now even more important. Web scraping provides an avenue to find, collate, and organize data without relying on information leaks.
Check out Part 1 comparing Black Friday and Cyber Monday, Part 2 comparing Black Friday, Cyber Monday, and Green Monday, and Part 3 comparing Christmas Eve and New Year’s Eve.
Zyte is participating in Memex, an ambitious DARPA project that tackles the huge challenge of crawling, indexing, and making sense of areas of the Deep Web, that is, web content not being indexed by traditional search engines such as Google, Bing and others.