Instagram runs one of the largest Cassandra deployments in the world. Dikang Gu details a very interesting project from Instagram’s Cassandra team to make Apache Cassandra’s storage engine pluggable and implement a new RocksDB-based storage engine into Cassandra. The new storage engine can improve the performance of Apache Cassandra significantly. Dikang describes the team’s motivation, different approaches that were considered, the high-level design of the chosen solution, and the performance metrics in benchmark and production environments.
Dikang Gu is a software engineer on Instagram’s Cassandra team, where he works on providing Apache Cassandra as a general distributed key-value storage in Instagram. He’s also an Apache Cassandra committer. Previously, Dikang helped build a cache invalidation pipeline on top of Postgres and worked on the development of Apache HDFS as part of Facebook’s data infrastructure team.
©2018, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org