Mar 15–18, 2020

Simplifying data analytics by creating continuously up-to-date aggregates

David Kohn (TimescaleDB)
2:35pm3:15pm Tuesday, March 17, 2020
Location: LL21A
Secondary topics:  Data Quality

Who is this presentation for?

Data engineers, data architects, developers

Level

Advanced

Description

One characteristic of time series data workloads (e.g., data from servers, sensors, IoT devices, finance, or even satellites) is that the dataset grows very quickly.

So given this high velocity and continuous workload of handling streams of time series data, insert performance is paramount. But what’s the use of inserting and storing a significant amount of data if you can’t analyze, visualize, and act on it in real time? Or if you’re limited to a snapshot or summary over the most recent data rather than the ability to gain arbitrary insights over time. Historical aggregates are key.

David Kohn details how to transparently and efficiently maintain continuous data aggregates over time, which is critical for speeding up queries using precalculated results. Yet in many time series settings such as IoT devices, server monitoring, even financial applications, data may arrive late or out of order, which typically leads to incorrect results or triggers expensive recomputation on every late input. You’ll discover how such late data is correctly and efficiently handled in TimescaleDB’s continuous aggregates and how this simplifies building data-intensive time series applications.

Prerequisite knowledge

  • General knowledge of databases or streaming data architectures

What you'll learn

  • Learn why it’s important to implement the proper infrastructure when managing time series workloads
  • Discover how creating continuously up-to-date aggregates can speed up query performance and lead to more useful analysis
Photo of David Kohn

David Kohn

TimescaleDB

After a BS in environmental engineering at Yale, founding an electrochemistry startup, joining a battery startup, and doing crazy things with PostgreSQL for Moat (an ad-analytics company), David joined Timescale to focus on research and development. He also cooks, does pottery and builds furniture.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)

Contact us

confreg@oreilly.com

For conference registration information and customer service

partners@oreilly.com

For more information on community discounts and trade opportunities with O’Reilly conferences

Become a sponsor

For information on exhibiting or sponsoring a conference

pr@oreilly.com

For media/analyst press inquires