Presented By O'Reilly and Cloudera
Make Data Work
22–23 May 2017: Training
23–25 May 2017: Tutorials & Conference
London, UK

Data science at scale: Using Spark and Hadoop (Day 2)

Kai Voigt (Cloudera)
Location: Capital Suite 16

What you'll learn

  • Learn how Spark and Hadoop enable data scientists to help companies reduce costs, increase profits, improve products, retain customers, and identify new opportunities

Description

Data scientists build information platforms to provide deep insight and answer previously unimaginable questions. Spark and Hadoop are transforming how data scientists work by allowing interactive and iterative data analysis at scale. Learn how Spark and Hadoop enable data scientists to help companies reduce costs, increase profits, improve products, retain customers, and identify new opportunities.

Kai Voigt explores what data scientists do, the problems they solve, and the tools and techniques they use. Using in-class simulations and exercises, Kai walks you through applying data science methods to real-world challenges in different industries, offering preparation for and experience with data scientist roles in the field.

Topics include:

  • How to identify potential business use cases where data science can provide impactful results
  • How to obtain, clean, and combine disparate data sources to create a coherent picture for analysis
  • What statistical methods to leverage for data exploration that will provide critical insight into your data
  • Where and when to leverage Hadoop streaming and Apache Spark for data science pipelines
  • What machine-learning technique to use for a particular data science project
  • How to implement and manage recommenders using Spark‚Äôs MLlib and how to set up and evaluate data experiments
  • The pitfalls of deploying new analytics projects to production at scale
Photo of Kai Voigt

Kai Voigt

Cloudera

Kai Voigt is a senior instructor for Hadoop classes at Cloudera, delivering training classes for developers and administrators worldwide. Kai held the same role at MySQL, Sun, and Oracle. He has spoken at a number of O’Reilly conferences.