Presented By O’Reilly and Cloudera
Make Data Work
September 11, 2018: Training & Tutorials
September 12–13, 2018: Keynotes & Sessions
New York, NY

Building Fabric Answers using Apache Heron

Karthik Ramasamy (Streamlio), Andrew Jorgensen (Google)
2:05pm–2:45pm Wednesday, 09/12/2018
Streaming systems & real-time applications
Location: 1E 07/08 Level: Beginner
Average rating: ****.
(4.00, 1 rating)

Who is this presentation for?

  • Engineers and engineering managers

Prerequisite knowledge

  • A basic understanding of streaming systems, messaging systems, and storage systems (useful but not required)

What you'll learn

  • Learn how streaming and Apache Heron are used with Google Fabric to connect a billion devices

Description

Real-time insights into how mobile applications are being used provide instant feedback to application developers. This feedback is valuable to improve product features and usability to create a sticky experience. Fabric Answers is a real-time, opinionated mobile analytics product that is part of Google’s mobile development platform alongside Firebase. Answers provides usage analytics to thousands of apps from over a billion devices across both iOS and Android.

Processing data at this scale is made possible using a lambda architecture to combine both real-time and batch views into a cohesive user experience. Apache Heron is at the core of the real-time processing layer supporting Answers and provides excellent support for scalability and operability, allowing Google to scale easily with its customers.

Karthik Ramasamy and Andrew Jorgensen offer an overview of Fabric Answers, explain how Heron powers one of Google’s most compelling real-time features, Launch Day Experience, and share some of the tricks they’ve learned to improve the scalability of Google’s system using Heron.

Photo of Karthik Ramasamy

Karthik Ramasamy

Streamlio

Karthik Ramasamy is the cofounder of Streamlio, a company building next-generation real-time processing engines. Karthik has more than two decades of experience working in parallel databases, big data infrastructure, and networking. Previously, he was engineering manager and technical lead for real-time analytics at Twitter, where he was the cocreator of Heron; cofounded Locomatix, a company that specialized in real-time stream processing on Hadoop and Cassandra using SQL (acquired by Twitter); briefly worked on parallel query scheduling at Greenplum (acquired by EMC for more than $300M); and designed and delivered platforms, protocols, databases, and high-availability solutions for network routers at Juniper Networks. He is the author of several patents, publications, and one best-selling book, Network Routing: Algorithms, Protocols, and Architectures. Karthik holds a PhD in computer science from the University of Wisconsin-Madison with a focus on databases, where he worked extensively in parallel database systems, query processing, scale-out technologies, storage engines, and online analytical systems. Several of these research projects were spun out as a company later acquired by Teradata.

Photo of Andrew Jorgensen

Andrew Jorgensen

Google

Andrew Jorgensen is a senior software engineer at Google primarily focused on building distributed real-time data processing systems for mobile analytics to help give developers deeper insight into their app. Andrew has worked on Fabric Answers since its launch in 2014 and helped it grow to handle over six billion sessions per day.

Comments on this page are now closed.

Comments

Tian Xing (Henry) Zhang | DATA ENGINEER
09/15/2018 3:49pm EDT

Hi, will the slides be posted? Thanks.