Sep 23–26, 2019

Wei-Chiu Chuang
Software Engineer, Cloudera

Wei-Chiu Chuang is a software engineer at Cloudera, where he’s responsible for the development of Cloudera’s storage systems, mostly the Hadoop Distributed File System (HDFS). He’s an Apache Hadoop Committer and Project Management Committee member for his contribution in the open source project. He’s also a cofounder of the Taiwan Data Engineering Association, a nonprofit organization promoting better data engineering technologies and applications in Taiwan. Wei-Chiu earned his PhD in computer science from Purdue University for his research in distributed systems and programming models.

Sessions

4:35pm–5:15pm Wednesday, September 25, 2019

Location: 1E 07/08

Apache Hadoop 3.x state of the union and upgrade guidance

Data Engineering and Architecture

Secondary topics: Deep dive into specific tools, platforms, or frameworks

Wangda Tan (Cloudera), Wei-Chiu Chuang (Cloudera)

Wangda Tan and Wei-Chiu Chuang outline the current status of Apache Hadoop community and dive into present and future of Hadoop 3.x. You'll get a peak at new features like erasure coding, GPU support, NameNode federation, Docker, long-running services support, powerful container placement constraints, data node disk balancing, etc. And they walk you through upgrade guidance from 2.x to 3.x. Read more.