Presented By O'Reilly and Cloudera
Make Data Work
March 13–14, 2017: Training
March 14–16, 2017: Tutorials & Conference
San Jose, CA

End-to-end security for Kafka, Spark ML, and Hadoop

Ajit Gaddam (VISA), Jiphun Satapathy (VISA)
2:40pm3:20pm Wednesday, March 15, 2017
Platform Security and Cybersecurity
Location: LL21 B Level: Intermediate
Secondary topics:  Architecture, Data Platform, Financial services, Streaming
Average rating: ***..
(3.83, 6 ratings)

Who is this presentation for?

  • Security practitioners, architects, and Hadoop admins

Prerequisite knowledge

  • An understanding of Hadoop and message processing systems
  • Familiarity with cloud and distributed systems design
  • Knowledge of threat modeling

What you'll learn

  • Understand the current state of security for native Kafka deployment
  • Learn how to use security controls like client authentication and data security
  • Explore a reference architecture for integrating Hadoop with Kafka
  • Discover how to leverage Kafka to enrich cybersecurity by utilizing machine-learning models


Because of its highly scalable, available, and reliable distributed features, Apache Kafka is used by over 35% of Fortune 500 companies to store and process some of their most sensitive datasets. Most Kafka deployments deal with processing sensitive data, such as user information, financial data, intellectual property, user location information, or personal or identifying information.

With that rapid adoption rate, it is crucial that your Kafka deployment be secured. Ajit Gaddam and Jiphun Satapathy provide a security reference architecture to secure your Kafka cluster while leveraging it to support your organization’s cybersecurity requirements.

Topics include:

  • IAM: How to make sure an end-to-end identity and access management framework is established for a Kafka cluster
  • Data protection: How to make sure data within a Kafka cluster is protected both at rest and in transit
  • Cybersecurity: A framework using Kafka, Spark ML, and Hadoop platform to provide both real streaming and batch processing of security events
  • A reference architecture for security of a data lake leveraging Kafka
Photo of Ajit Gaddam

Ajit Gaddam


Ajit Gaddam is chief security architect at Visa. Ajit is a technologist, serial entrepreneur, and a security expert specializing in machine learning, cryptography, big data security, and cybersecurity issues. Over the last decade, Ajit held senior roles at various tech and financial firms and founded two startups. He is an active participant in various open source and security architecture standards bodies. As a well-known security expert and industry veteran, he has authored numerous articles and white papers for publication and is a frequent speaker at high-profile conferences such as BlackHat, Strata + Hadoop World, and SABSA World Congress. He holds multiple patents in data security and other disruptive technologies.

Photo of Jiphun Satapathy

Jiphun Satapathy


Jiphun Satapathy is a senior security architect at Visa, where he leads the security architecture of Visa’s digital and mobile products like Visa Token Service, Visa Checkout, Visa Direct, which are used by millions of users. Jiphun’s areas of expertise include application security, data security, and cloud security. Previously, he was a software architect at Intel, where he led multiple teams to deliver products leveraging HW security.

Comments on this page are now closed.


03/28/2017 12:49am PDT

Hello Ajit and Jiphun,

Great session. Would you be able to share the material used?