Presented By O'Reilly and Cloudera
December 5-6, 2016: Training
December 6–8, 2016: Tutorials & Conference

TRAINING: Data science at scale: Using Spark and Hadoop (Day 2)

9:00am–5:00pm Tuesday, December 6, 2016
Location: 334

What you'll learn

  • Understand how how Spark and Hadoop can help you reduce costs, increase profits, improve products, retain customers, and identify new opportunities for your company


Data scientists build information platforms to provide deep insight and answer previously unimaginable questions. Spark and Hadoop are transforming how data scientists work by allowing interactive and iterative data analysis at scale.

Maojin Jiang demonstrates how Spark and Hadoop enable data scientists to help companies reduce costs, increase profits, improve products, retain customers, and identify new opportunities. Through in-class simulations and exercises, Maojin walks you through applying data science methods to real-world challenges in different industries, offering preparation for data scientist roles in the field.

Topics include:

  • How to identify potential business use cases where data science can provide impactful results
  • How to obtain, clean, and combine disparate data sources to create a coherent picture for analysis
  • What statistical methods to leverage for data exploration that will provide critical insight into your data
  • Where and when to leverage Hadoop streaming and Apache Spark for data science pipelines
  • What machine-learning technique to use for a particular data science project
  • How to implement and manage recommenders using Spark’s MLlib and how to set up and evaluate data experiments
  • The pitfalls of deploying new analytics projects to production at scale
Photo of Maojin Jiang  (江毛进)

Maojin Jiang (江毛进)


Maojin Jiang is an instructor at Cloudera. Previously, Maojin worked as a big data engineer, a software engineer, a DevOps developer, a system administrator, and a researcher with interests in topic-sentiment analysis, information retrieval, web mining, political text analysis, machine learning, and natural language processing. In early 2012, Maojin introduced Cloudera Hadoop training into mainland China. Since then, he has dedicated himself to driving widespread adoption of Hadoop-based big data technologies by helping hundreds of engineers, architects, IT managers, executives, and university students and their teachers gain knowledge of Hadoop-based big data technologies, including Cloudera’s industry-leading and world-recognized best practices and solutions.