Presented By O’Reilly and Cloudera
Make Data Work
March 5–6, 2018: Training
March 6–8, 2018: Tutorials & Conference
San Jose, CA

Stream processing with Kafka

Tim Berglund (Confluent)
9:00am12:30pm Tuesday, March 6, 2018
Average rating: ****.
(4.36, 11 ratings)

Who is this presentation for?

  • Developers who want to use Kafka Streams

Prerequisite knowledge

  • Basic Java skills

Materials or downloads needed in advance

  • A laptop with at least 4 GB of RAM and the ability to run a VirtualBox VM

What you'll learn

  • Understand Kafka architecture
  • Learn how to use the Kafka Streams Java API and KSQL


The toolset for building scalable data systems is maturing, having adapted well to our decades-old paradigm of update-in-place databases. We ingest events, we store them in high-volume OLTP databases, and we have new OLAP systems to analyze them at scale—even if the size of our operation requires us to grow to dozens or hundreds of servers in the distributed system. But something feels a little dated about the store-and-analyze paradigm, as if we are missing a new architectural insight that might more efficiently distribute the work of storing and computing the events that happen to our software. That new paradigm is stream processing.

Tim Berglund leads a basic architectural introduction to Apache Kafka and walks you through using Kafka Streams and KSQL to process streaming data. You’ll learn the basics of Kafka as a messaging system, including the core concepts of topic, producer, consumer, and broker. Tim also explains how topics are partitioned among brokers and highlights the simple Java APIs for getting data in and out. But more importantly, you’ll discover how to extend this scalable messaging system into a streaming data processing system—one that offers significant advantages in scalability and deployment agility while locating computation in your data pipeline in precisely the places it belongs: in your microservices and applications, not in costly, high-density systems.

Photo of Tim Berglund

Tim Berglund


Tim Berglund is the senior director of developer experience with Confluent, where he serves as a teacher, author, and technology leader. Tim can frequently be found speaking at conferences internationally and in the United States. He’s the copresenter of various O’Reilly training videos on topics ranging from Git to distributed systems and is the author of Gradle Beyond the Basics. He tweets as @tlberglund, blogs very occasionally at, and is the cohost of the DevRel Radio podcast. He lives in Littleton, Colorado, with the wife of his youth and their youngest child, the other two having mostly grown up.

Comments on this page are now closed.


03/02/2018 8:23am PST

@Sampann – see the “changing your tutorial or training selections” here:

03/02/2018 8:19am PST

I want to change tutorial session, how can I do that.