Project Horizon, developed as a Palantir Hack Day project on top of the Palantir platform, empowers analysts to start with their entire ecosystem of data (literally billions of rows of data), and iteratively pare the data down to discover the proverbial needle in the haystack at the speed of thought (discover the unknown unknowns). Project Horizon is part of Palantir’s approach for big data: rapid, interactive analysis of datasets that contain billions of records. User interface response times in this video are unedited; Horizon really is processing all half billion objects interactively on about $5,000 of commodity hardware!
Palantir uses practices like Hack Days to unleash Silicon Valley’s best engineering talent on hard problems that our customers face to arrive at organic, bottom up innovation. Project Horizon represents 1 of 25 Hack Day projects developed this year. At Palantir, we understand that innovation has to be cultivated, not commanded.
This video has two sections. The first section presents an analysis of almost half a billion anonymized mortgage applications to quickly identify several banks that may have engaged in predatory lending. The second section presents analysis of two sets of firewall log data to show how Horizon can be applied to cyber investigations.