Presented By
O’Reilly + Cloudera
Make Data Work
29 April–2 May 2019
London, UK
Please log in

From legacy to cloud: An end-to-end data integration journey

Max Schultze (Zalando SE)
16:3517:15 Thursday, 2 May 2019
Data Engineering and Architecture
Location: Capital Suite 8/9
Average rating: ****.
(4.83, 12 ratings)

Who is this presentation for?

  • Engineers interested in or working with data pipelines at scale

Level

Intermediate

Prerequisite knowledge

  • Familiarity with data engineering concepts and cloud technology

What you'll learn

  • Learn how Zalondo runs data pipelines in production

Description

Transitioning a full company to the cloud is hard. Starting a data lake halfway through is even harder. Integrating data sources from both cloud and legacy data centers has to be done tailored to the past with the future in mind.

Max Schultze details Zalondo’s end-to-end data integration platform to serve analytical use cases and machine learning throughout the company, covering raw data collection, standardized data preparation (binary conversion, partitioning, etc.), user-driven analytics, and machine learning. Along the way, he shares the technical challenges and lessons learned building and operating data pipelines and computation as a service for hundreds of teams operating at petabyte scale.

Photo of Max Schultze

Max Schultze

Zalando SE

Max Schultze is a data engineer working on building a data lake at Zalando, Europe’s biggest online fashion retailer. His focus lies on building data pipelines at scale of terabytes per day and productionizing Spark and Presto as analytical platforms inside the company. He graduated from the Humboldt University of Berlin, actively taking part in the university’s initial development of Apache Flink.

Comments on this page are now closed.

Comments

Picture of Max Schultze
Max Schultze | DATA ENGINEER
8/05/2019 13:41 BST

Hi everyone,
the slides are now available :)

Radu Dragusin | SENIOR DATA SCIENTIST
4/05/2019 0:19 BST

It was an amazing presentation. Can you upload or link to the slides? Thanks!

Paschalis Dimitriou |
3/05/2019 10:46 BST

Would it be possible to upload the presentation that you made?