Put open source to work
July 16–17, 2018: Training & Tutorials
July 18–19, 2018: Conference
Portland, OR

Cassandra on RocksDB

Dikang Gu (Facebook)
5:05pm–5:45pm Thursday, July 19, 2018
Evolutionary architecture
 Location: Portland 251
Level: Intermediate
Average rating: ****.
(4.00, 2 ratings)

Who is this presentation for?

  • Database users and developers

Prerequisite knowledge

  • Familiarity with NoSQL database concepts

What you'll learn

  • Learn how Instagram's Cassandra team is creating a project to make Apache Cassandra's storage engine pluggable and implement a new RocksDB-based storage engine into Cassandra

Description

Instagram runs one of the largest Cassandra deployments in the world. Dikang Gu details a very interesting project from Instagram’s Cassandra team to make Apache Cassandra’s storage engine pluggable and implement a new RocksDB-based storage engine into Cassandra. The new storage engine can improve the performance of Apache Cassandra significantly. Dikang describes the team’s motivation, different approaches that were considered, the high-level design of the chosen solution, and the performance metrics in benchmark and production environments.

Photo of Dikang Gu

Dikang Gu

Facebook

Dikang Gu is a software engineer on Instagram’s Cassandra team, where he works on providing Apache Cassandra as a general distributed key-value storage in Instagram. He’s also an Apache Cassandra committer. Previously, Dikang helped build a cache invalidation pipeline on top of Postgres and worked on the development of Apache HDFS as part of Facebook’s data infrastructure team.