Fueling innovative software
July 15-18, 2019
Portland, OR

Stream processing with Apache Kafka

Tim Berglund (Confluent), Brandon Bird (Confluent)
9:00am12:30pm Tuesday, July 16, 2019
Secondary topics:  Data Driven
Average rating: ****.
(4.54, 13 ratings)

Who is this presentation for?

  • Software developers and software architects

Level

Intermediate

Description

Apache Kafka is a de facto standard streaming data processing platform that’s widely deployed as a messaging system and has a robust data integration framework (Kafka Connect) and stream processing API (Kafka Streams) to meet the common needs of real-time message processing.

The Kafka ecosystem now offers KSQL, a declarative, SQL-like stream processing language that lets you define powerful stream-processing applications easily. What once took some moderately sophisticated Java code can now be done at the command line with a familiar and eminently approachable syntax.

Tim Berglund details how to produce and consume from a Kafka topic, how to use Kafka Connect to consume data from a relational database, and how to enrich and aggregate streaming data using KSQL. You’ll leave much more of a Kafka user and thinker, ready to explore your first event-driven system as soon as you get home.

Prerequisite knowledge

  • A working knowledge of a relational database
  • Familiarity with Linux command line

Materials or downloads needed in advance

What you'll learn

  • Understand the boundaries of the Kafka ecosystem
  • Learn how to process streaming data in KSQL
Photo of Tim Berglund

Tim Berglund

Confluent

Tim Berglund is the senior director of developer experience with Confluent, where he serves as a teacher, author, and technology leader. Tim can frequently be found speaking at conferences internationally and in the United States. He’s the copresenter of various O’Reilly training videos on topics ranging from Git to distributed systems and is the author of Gradle Beyond the Basics. He tweets as @tlberglund, blogs very occasionally at Timberglund.com, and is the cohost of the DevRel Radio podcast. He lives in Littleton, Colorado, with the wife of his youth and their youngest child, the other two having mostly grown up.

Brandon Bird

Confluent

SRE at Confluent