Presented By O’Reilly and Cloudera
Make Data Work
September 11, 2018: Training & Tutorials
September 12–13, 2018: Keynotes & Sessions
New York, NY

Stream processing with Kafka and KSQL

Tim Berglund (Confluent)
9:00am–12:30pm Tuesday, 09/11/2018
Average rating: ****.
(4.33, 3 ratings)

Who is this presentation for?

  • Software developers building streaming or microservices systems

Prerequisite knowledge

  • A basic understanding of SQL and messaging systems
  • Familiarity with Java (useful but not required)

Materials or downloads needed in advance

  • A laptop
  • Clone the course GitHub repository and go through the steps of Exercise 0 (This will require you to install Docker on your machine and do the docker-compose pull command that will take some significant downloading. Please make sure to do this before you arrive onsite.)

What you'll learn

  • Learn how Kafka works and how to process streaming data with a SQL-like language


Apache Kafka is a de facto standard streaming data processing platform. It’s widely deployed as a messaging system and has a robust data integration framework (Kafka Connect) and stream processing API (Kafka Streams) to meet the needs that commonly attend real-time message processing. But there’s more.

Kafka now offers KSQL, a declarative, SQL-like stream processing language that lets you define powerful stream-processing applications easily. What once took some moderately sophisticated Java code can now be done at the command line with a familiar and eminently approachable syntax.

Tim Berglund leads this solid introduction to Apache Kafka as a streaming data platform. You’ll cover the internal architecture, APIs, and platform components like Kafka Connect and Kafka Streams, then finish with an exercise processing streaming data using KSQL, the new SQL-like declarative stream processing language for Kafka. Join in for an overview of KSQL with live-coding on live streaming data.

Photo of Tim Berglund

Tim Berglund


Tim Berglund is the senior director of developer experience with Confluent, where he serves as a teacher, author, and technology leader. Tim can frequently be found speaking at conferences internationally and in the United States. He’s the copresenter of various O’Reilly training videos on topics ranging from Git to distributed systems and is the author of Gradle Beyond the Basics. He tweets as @tlberglund, blogs very occasionally at, and is the cohost of the DevRel Radio podcast. He lives in Littleton, Colorado, with the wife of his youth and their youngest child, the other two having mostly grown up.