Engineer for the future of Cloud
June 10-13, 2019
San Jose, CA

Monitor disk space and other ways to keep Apache Kafka happy

Gwen Shapira (Confluent)
3:50pm4:30pm Wednesday, June 12, 2019
Distributed Data
Location: 230 A
Average rating: ****.
(4.33, 3 ratings)

Who is this presentation for?

  • SREs and the developers who love them



Prerequisite knowledge

  • Knowledge of Apache Kafka
  • Familiarity with at least one monitoring system

What you'll learn

  • Learn the most common causes for production issues with Apache Kafka
  • See how to monitor Kafka effectively
  • Gain troubleshooting techniques


After five years of helping hundreds of customers use Apache Kafka, you’ve seen it all.

This is for anyone running, or planning to run, Apache Kafka in production. Gwen Shapira reviews the most common causes for downtime and data loss in Apache Kafka deployments—some were self-inflicted and easy to avoid, others were unexpected and tricky to troubleshoot. Then, she discusses how to avoid those common issues and how to troubleshoot some tricky cases. Gwen teaches you how to run Apache Kafka responsibly in production and gives you the tools to self-rescue when things go wrong anyway.

Photo of Gwen Shapira

Gwen Shapira


Gwen Shapira is a system architect at Confluent, where she helps customers achieve success with their Apache Kafka implementations. She has 15 years of experience working with code and customers to build scalable data architectures, integrating relational and big data technologies. Gwen currently specializes in building real-time reliable data processing pipelines using Apache Kafka. Gwen is an Oracle Ace Director, the coauthor of Hadoop Application Architectures, and a frequent presenter at industry conferences. She is also a committer on Apache Kafka and Apache Sqoop. When Gwen isn’t coding or building data pipelines, you can find her pedaling her bike, exploring the roads and trails of California and beyond.

Comments on this page are now closed.


Picture of Gwen Shapira
06/13/2019 11:27am PDT

Added a link to the deck

Joanne Sun | ENGINEER
06/12/2019 11:52am PDT

I missed the presentation. Can I get a slides? Thank you !