Streaming microservice architectures with Apache Kafka and Istio service mesh
Who is this presentation for?Data engineers, data architects, developers
Apache Kafka became the de facto standard for microservice architectures. It goes far beyond reliable and scalable high-volume messaging. In addition, you can leverage Kafka Connect for integration and the Kafka Streams API for building lightweight stream processing microservices in autonomous teams. A service mesh like Istio complements the architecture. It describes the network of microservices that make up such applications and the interactions between them. Its requirements can include discovery, load balancing, failure recovery, metrics, and monitoring. A service mesh also often has more complex operational requirements, like A/B testing, canary rollouts, rate limiting, access control, and end-to-end authentication.
Kai Wähner explores the problem of distributed microservices communication and how Apache Kafka and service mesh solutions address it. You’ll take a look at some approaches for combining them to build a reliable and scalable microservice architecture with decoupled and secure microservices.
- Experience with distributed systems and messaging frameworks or other open source middleware (useful but not required)
What you'll learn
- Understand that Apache Kafka is a reliable and scalable event streaming platform—much more than just a messaging solution
- Discover why a service mesh technology like Istio is a perfect complementary solution to decouple and secure distributed microservice communication
- Learn how the combination of Kafka and Istio allows you to build scalable and reliable streaming microservices—without the limitations and disadvantages of traditional HTTP and REST microservice communication
Kai Waehner is a technology evangelist at Confluent. Kai’s areas of expertise include big data analytics, machine learning, deep learning, messaging, integration, microservices, the internet of things, stream processing, and blockchain. He’s regular speaker at international conferences such as JavaOne, O’Reilly Software Architecture, and ApacheCon and has written a number of articles for professional journals. Kai also shares his experiences with new technologies on his blog.
Leave a Comment or Question
Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?
Join the conversation here (requires login)
Premier Diamond Sponsors
Premier Exhibitor Plus
For conference registration information and customer service
For more information on community discounts and trade opportunities with O’Reilly conferences
For information on exhibiting or sponsoring a conference
For media/analyst press inquires