Presented by O'Reilly and Cloudera
Make Data Work
July 12-13, 2017: Training
July 13-15, 2017: Tutorials & Conference
Beijing, China

在Apache Hadoop和Spark上加速大数据加密 (Speed up big data encryption in Apache Hadoop and Spark)

此演讲使用中文 (This will be presented in Chinese)

Haifeng Chen (Intel)
14:50–15:30 Friday, 2017-07-14
安全 (Security)
Location: 多功能厅2(Function Room 2) 观众水平 (Level): Intermediate

必要预备知识 (Prerequisite Knowledge)

A basic understanding of distributed systems like HDFS and Spark, how data encryption works, and encryption algorithms

您将学到什么 (What you'll learn)

Understand the performance challenges of data encryption posed by the existing implementations and learn the proven ways to solve these challenges in Hadoop and Spark

描述 (Description)




  • Java AES加密的性能现状和面临的挑战,以及基于SASL DIGEST-MD5的RPC和网络加密。
  • 为什么以及怎么样在基于硬件加速的条件下使用Apache Commons Crypto来提升加密的性能
  • Apache Hadoop和Spark社区为解决这个加密的性能挑战所完成的最新工作,以及了解它是如何工作的

Although the processing capability of modern platforms is approaching memory speed, securing big data using encryption still hurts performance. Enterprises that choose performance over data security face serious risks of data leaks and damage to their business in the big data era. Haifeng Chen shares proven ways to speed up data encryption in Hadoop and Spark, as well as the latest progress in open source, and demystifies using hardware acceleration technology to protecting your data.

Topics include:

  • The performance state and challenges from Java AES Cipher and SASL DIGEST-MD5-based RPC and network encryption
  • Why and how to utilize Apache Commons Crypto to speed up encryption performance based on hardware acceleration
  • The latest work the community has done in Apache Hadoop and Spark to solve the performance challenges of encryption (and how it performs)
Photo of Haifeng Chen

Haifeng Chen


Haifeng Chen is a senior software architect at Intel’s Asia Pacific R&D Center. He has more than 12 years’ experience in software design and development, big data, and security, with a particular interest in image processing. Haifeng is the author of image browsing, editing, and processing software ColorStorm.

Connect with O'ReillyData

Use the QR Code to follow OReillyData and get the latest conference information and browse data articles.

WeChat QRcode


Stay Connected Image 1
Stay Connected Image 3
Stay Connected Image 2

Read the latest ideas on big data.

ORB Data Site