At Disney, Hadoop is a core platform of our Data Solutions infrastructure, powering various use cases from ETL processing to Clickstream analysis. As usage of the Hadoop clusters grows, so does the demands around management and monitoring of these systems.
In this talk, we present how Disney has effectively leveraged the various integration capabilities of Cloudera Manager to successfully manage our Hadoop clusters. From, integrating the Cloudera Manager API with Chef to address installation/configuration and scaling issues, to leveraging the SNMP interfaces for alert notifications to using the API to provide high-level status information regarding the clusters, Disney has combined best of breed technologies to create a comprehensive end-to-end solution.
We will review the various features available in Cloudera manager and highlight the ones that have been most helpful to Disney (e.g. cluster rebalancing, decommissioning workflows, monitoring & alerting, configuration management, etc.) We will also share some of the lessons learnt and best practices on how to use Cloudera Manager.
Staff Systems Engineer with The Walt Disney Company. Over 8 years supporting large scale Internet operations delivering millions of page views per hour in a highly dynamic, and user-content driven environment.
Comments on this page are now closed.
For exhibition and sponsorship opportunities, contact Susan Stewart at firstname.lastname@example.org
For information on trade opportunities with O'Reilly conferences email mediapartners
For media-related inquiries, contact Maureen Jennings at email@example.com
View a complete list of Strata + Hadoop World 2013 contacts