Presented By O'Reilly and Cloudera
Make Data Work
September 25–26, 2017: Training
September 26–28, 2017: Tutorials & Conference
New York, NY

The three realities of modern programming: The cloud, microservices, and the explosion of data

Gwen Shapira (Confluent)
11:20am12:00pm Thursday, September 28, 2017
Secondary topics:  Architecture, Cloud, Streaming
Average rating: ****.
(4.50, 2 ratings)

Who is this presentation for?

  • Anyone who wants to learn more about Apache Kafka and stream processing

Prerequisite knowledge

  • A basic understanding of Apache Kafka and streaming data

What you'll learn

  • Learn how the three biggest trends in modern programming affect developers and what the future holds


There are three key realities of modern programming that are affecting how developers and companies operate today: the explosion of data and data systems, building business processes as microservices instead of monolithic applications, and the rise of the public cloud. How do companies deal with these realities, all while the variety and volume of data are increasing in tandem with the the need to process this data in real time across these distributed systems?

Now more than ever, companies across all industries, including retail, financial services, technology, and media, among others, are turning to streaming data and Apache Kafka for mission-critical applications. Observing this adoption of Kafka across various businesses, there’s one thing in common: Kafka can power the three key realities of modern programming. These major trends define the developer experience in a truly novel way. Gwen Shapira explores these three realities one by one to share lessons learned from running large-scale distributed systems and explains how Kafka will impact the architectures and applications of the future.

Photo of Gwen Shapira

Gwen Shapira


Gwen Shapira is a system architect at Confluent, where she helps customers achieve success with their Apache Kafka implementations. She has 15 years of experience working with code and customers to build scalable data architectures, integrating relational and big data technologies. Gwen currently specializes in building real-time reliable data processing pipelines using Apache Kafka. Gwen is an Oracle Ace Director, the coauthor of Hadoop Application Architectures, and a frequent presenter at industry conferences. She is also a committer on Apache Kafka and Apache Sqoop. When Gwen isn’t coding or building data pipelines, you can find her pedaling her bike, exploring the roads and trails of California and beyond.