Presented By O'Reilly and Cloudera
Make Data Work
31 May–1 June 2016: Training
1 June–3 June 2016: Conference
London, UK

Insight at the speed of thought: Visualizing and exploring data at scale

Nicholas Turner (Incited)
14:55–15:35 Friday, 3/06/2016
Data-driven business
Location: Capital Suite 4 Level: Non-technical
Average rating: ***..
(3.33, 3 ratings)

Prerequisite knowledge

Attendees should have a high-level familiarity with the main projects in the Hadoop ecosystem.


Using examples from recent industry case studies, Nick Turner offers an insightful view on how technology is delivering self-service analytics through visualization and enabling business users to quickly explore their data at scale. Nick shows how organizations are generating and using increasing volumes and varieties of data to uncover previously hidden insights by linking internal and external datasets and making insight actionable with visualization and data science. Nick then explores the technical architectures and operational processes that helped deliver UK-based insurance company Markerstudy’s Big Data Insights project, winner of two Cloudera Data Impact Awards and the Celent International Award for Data Mastery and Analytics. The tangible business results include a reduction in claims costs through better fraud detection and prevention at point of quote, as well as an improved understanding of individual customer needs to provide more accurate pricing.

At the heart of the solution is a Hadoop-centric data architecture that empowers business users to perform big data exploration on their own. Nick guides attendees through the challenges of how to integrate an enterprise data platform with existing systems, third party enrichment services and data from legacy systems of record and offers solutions that take advantage of Hadoop ingestion components, web services that provide data enrichment, visualization, and analytics at speed using Impala, and Spark-based machine learning for statistical and predictive modeling. Nick shares some lessons learned across these projects as well as some of the new opportunities being created and directions for the future.

Nicholas Turner