Mar 15–18, 2020

Streaming microservice architectures with Apache Kafka and Istio service mesh

Kai Wähner (Confluent)
11:00am11:40am Wednesday, March 18, 2020
Location: LL20C

Who is this presentation for?

Data engineers, data architects, developers

Level

Intermediate

Description

Apache Kafka became the de facto standard for microservice architectures. It goes far beyond reliable and scalable high-volume messaging. In addition, you can leverage Kafka Connect for integration and the Kafka Streams API for building lightweight stream processing microservices in autonomous teams. A service mesh like Istio complements the architecture. It describes the network of microservices that make up such applications and the interactions between them. Its requirements can include discovery, load balancing, failure recovery, metrics, and monitoring. A service mesh also often has more complex operational requirements, like A/B testing, canary rollouts, rate limiting, access control, and end-to-end authentication.

Kai Wähner explores the problem of distributed microservices communication and how Apache Kafka and service mesh solutions address it. You’ll take a look at some approaches for combining them to build a reliable and scalable microservice architecture with decoupled and secure microservices.

Prerequisite knowledge

  • Experience with distributed systems and messaging frameworks or other open source middleware (useful but not required)

What you'll learn

  • Understand that Apache Kafka is a reliable and scalable event streaming platform—much more than just a messaging solution
  • Discover why a service mesh technology like Istio is a perfect complementary solution to decouple and secure distributed microservice communication
  • Learn how the combination of Kafka and Istio allows you to build scalable and reliable streaming microservices—without the limitations and disadvantages of traditional HTTP and REST microservice communication
Photo of Kai Wähner

Kai Wähner

Confluent

Kai Waehner is a technology evangelist at Confluent. Kai’s areas of expertise include big data analytics, machine learning, deep learning, messaging, integration, microservices, the internet of things, stream processing, and blockchain. He’s regular speaker at international conferences such as JavaOne, O’Reilly Software Architecture, and ApacheCon and has written a number of articles for professional journals. Kai also shares his experiences with new technologies on his blog.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)

Contact us

confreg@oreilly.com

For conference registration information and customer service

partners@oreilly.com

For more information on community discounts and trade opportunities with O’Reilly conferences

Become a sponsor

For information on exhibiting or sponsoring a conference

pr@oreilly.com

For media/analyst press inquires