Presented By O'Reilly and Cloudera
Make Data Work
Dec 4–5, 2017: Training
Dec 5–7, 2017: Tutorials & Conference

Painless real-time scalable serverless data pipelines - What Google Cloud can do for you (Sponsored by Google Cloud)

Felipe Hoffa (Google)
11:15am11:55am Wednesday, December 6, 2017
Location: 334/335

How awesome would it be if you could bring new and underutilized data sources alive? How hard is it to scale up to ingest millions of messages per second? Can you give your teams a secure, productive and collaborative data environment? Focus on what matters – your data and your insights.

In this session, we are going to learn how Google Cloud can help you go from data to insights while abstracting away infrastructure complexities. With Cloud Dataprep, we are going to interactively explore, clean and ingest existing datasets. Cloud Dataflow will allow us to merge both batch and streaming pipelines into one unified model, sunsetting the lambda architecture. Distributing hundreds of million of messages per second? Easy with Cloud Pub/Sub. We will then discover how to analyze terabytes of data in seconds with BigQuery. To end, we will show you how to make all this data accessible – from data scientists to executives – with Datalab and Data Studio.

Expect live demos – these tools are real, and you can start using them right now.

This session is sponsored by Google Cloud

Photo of Felipe Hoffa

Felipe Hoffa


In 2011, Felipe Hoffa moved from Chile to San Francisco to join Google as a Software Engineer. Since 2013, he’s been a Developer Advocate on Big Data – to inspire developers around the world to leverage the Google Cloud Platform tools to analyze and understand their data in ways they could never before. You can find him in several YouTube videos, blog posts, and conferences around the world.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)