Presented By O'Reilly and Cloudera
Make Data Work
December 1–3, 2015 • Singapore

Druid: Power Applications to Analyze Sensor Data

Fangjin Yang (Imply)
2:20pm–3:00pm Thursday, 12/03/2015
IoT and Real-time
Location: 328-329 Level: Intermediate
Average rating: ****.
(4.33, 3 ratings)

Prerequisite Knowledge

Audiences should have some background in the data infrastructure space.

Description

Cluster computing frameworks such as Hadoop or Spark are tremendously beneficial in processing and deriving insights from data. However, long query latencies make these frameworks sub-optimal choices to power interactive applications. Organizations frequently rely on dedicated query layers, such as relational databases and key/value stores, for faster query latencies; but these technologies suffer many drawbacks for analytic use cases. In this session, we discuss examine using Druid to power applications designed to analyze sensor data, and why the architecture is well suited for different use cases in “smart cities”.

User-facing applications are replacing traditional reporting interfaces as the preferred means for organizations to derive value from their datasets. In order to provide an interactive user experience, user interactions with analytic applications must complete in an order of milliseconds. To meet these needs, organizations often struggle with selecting a proper serving layer. Many serving layers are selected because of their general popularity, without understanding the possible architecture limitations.

Druid is an open source distributed data store designed for analytic (OLAP) queries on timeseries data. It draws inspiration from Google’s Dremel, Google’s PowerDrill, and search infrastructure. Many large technology companies are switching to Druid for analytics, and we will cover why the technology is a good fit for its intended use cases.

Photo of Fangjin Yang

Fangjin Yang

Imply

Fangjin Yang is a coauthor of the open source Druid project and a cofounder of Imply, a data analytics startup based in San Francisco. Previously, Fangjin held senior engineering positions at Metamarkets and Cisco Systems. Fangjin has a BASc in electrical engineering and an MASc in computer engineering from the University of Waterloo, Canada.

Comments on this page are now closed.

Comments

Picture of Fangjin Yang
Fangjin Yang
12/05/2015 8:52pm +08

Slides available at: https://speakerdeck.com/druidio/druid-power-applications-to-analyze-sensor-data

Stefan Bisang
12/05/2015 4:31pm +08

could you please make the slides available? thanks