Presented By O'Reilly and Cloudera
Make Data Work
March 13–14, 2017: Training
March 14–16, 2017: Tutorials & Conference
San Jose, CA

How to leverage your private cloud infrastructure to deploy Hadoop

Dwai Lahiri (Cloudera)
4:20pm5:00pm Wednesday, March 15, 2017
Hadoop platform and applications
Location: LL21 E/F Level: Intermediate
Secondary topics:  Architecture, Cloud
Average rating: ****.
(4.50, 2 ratings)

Who is this presentation for?

  • Hadoop architects, infrastructure architects, and systems engineers

Prerequisite knowledge

  • A working knowledge of virtualization technologies and Hadoop
  • Knowledge of platforms and Hadoop administration/builds

What you'll learn

  • Understand which of the prevalent private cloud design patterns can be leveraged easily to build reliable and performant Hadoop clusters


Dwai Lahiri explains how to leverage private cloud infrastructure to successfully build Hadoop clusters and outlines dos, don’ts, and gotchas for running Hadoop on private clouds. Dwai covers some of the prevalent design patterns for private cloud deployments, as well as popular paradigms in virtualization and the kinds of challenges they pose for successful Hadoop deployments.

Topics include:

  • Physical system partitioning: An overview of private cloud hypervisor technologies and their strengths and weaknesses
  • Storage layer configuration: A discussion of the many options, from shared storage and ephemeral storage to object storage, and the potential impact of software-defined storage on a Hadoop cluster
  • Network configuration: A comparison of fully virtualized networks and those using NFV technologies
Photo of Dwai Lahiri

Dwai Lahiri


Dwai Lahiri is a long-term IT Infrastructure guy. Dwai is a senior solutions architect at Cloudera, where he works with Cloudera’s hardware and private and public cloud partners, enabling them to run Cloudera’s Enterprise EDH stack on their respective platforms.