• 10gen
  • DataStax, Inc.
  • Dell
  • Google
  • Lexis Nexis
  • Oracle
  • VMware
  • Percona

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the convention, contact Sharon Cordesse at scordesse@oreilly.com

Download the OSCON Data Sponsor/Exhibitor Prospectus

Media Partner Opportunities

For information on trade opportunities with O'Reilly conferences or contact mediapartners@ oreilly.com

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

OSCON Bulletin

To stay abreast of convention news and announcements, please sign up for the OSCON email bulletin (login required)

Contact Us

View a complete list of OSCON contacts

Developing and Deploying Hadoop Security

Data: Hadoop
Location: C124
Average rating: **...
(2.25, 4 ratings)

Hadoop 0.20 implicitly trusts the user when they state their username and group membership. That is acceptable when used by small teams, but large corporations need more control. For example, large corporations need to have independent clusters for each different kind of sensitive information (financial, personal identifiable information, etc.) and control access by limiting access to those clusters. With Hadoop’s new security features and its integration with Kerberos, it is possible to verify that the user is who they claim to be and ensure they only have the correct access to data or resources. This allows corporations to allow finer grained access to information and reduce their operational overhead by coalescing their distinct clusters. This presentation will cover the goals of security and how to use the new features to ensure the security of their HDFS and MapReduce clusters. I will also include Yahoo’s experiences deploying the back-ported Hadoop Security features on their science and production clusters.

Photo of Owen O'Malley

Owen O'Malley


Owen O’Malley is a software architect on Hadoop working for HortonWorks, a startup focusing on Hadoop development. Prior to cofounding HortonWorks, Owen and the rest of the HortonWorks team worked at Yahoo developing Hadoop. He has been contributing patches to Hadoop since before it was separated from Nutch and was the original chair of the Hadoop PMC. Before working on Hadoop, he worked on Yahoo Search’s WebMap project, which builds a graph of the known Web and applies many heuristics to the entire graph that control search. Prior to Yahoo, Owen wandered between testing (UCI), static analysis (Reasoning), configuration management (Sun), and software model checking (NASA). He holds a PhD in software engineering from the University of California, Irvine.

Comments on this page are now closed.


Picture of Sheeri K. Cabral
Sheeri K. Cabral
09/07/2011 4:17am PDT

A video of this presentation is online at www.youtube.com/watch?v=_l4...