Presented By
O’Reilly + Cloudera
Make Data Work
29 April–2 May 2019
London, UK
Please log in

Creating a data engineering culture

Jesse Anderson (Big Data Institute)
17:2518:05 Wednesday, 1 May 2019
Culture and organization, Strata Business Summit
Location: Capital Suite 17
Average rating: ****.
(4.71, 7 ratings)

Who is this presentation for?

  • CxOs, VPs, directors, managers, and team leads

What you'll learn

  • Learn how USAA created a data engineering culture


The biggest initial hurdle to success with Big Data isn’t technical – it’s management. Your data engineering project’s initial success is predicated on your management team correctly staffing and resourcing it. This runs opposite to how most data engineering teams are started and run. If you just choose the best technologies, things will just fall into place. They don’t and that’s a common pattern for failure.

But how do you correctly do something that’s so new? This could be your team’s first data engineering project. What should the team look like? What skills should the team have? What should you look for in Data Engineer (because you’ll probably have to hire a Software Engineer and train them)? What are some of the management pitfalls?

In this talk, we will cover the most common reasons why data engineering teams fail and how to correct them. This will include ways to get your management to understand that data engineering is really complex and time consuming. It is not data warehousing with new names. Management needs to understand that you can’t compare a data engineering team to the web development team, for example.

Jesse will share the stories of teams who haven’t set up their data engineering culture correctly and what happened. Then, Jesse will talk about the teams who’ve turned around their culture and how they did it.

Finally, Jesse will share the skills that every data engineering team needs.

Photo of Jesse Anderson

Jesse Anderson

Big Data Institute

Jesse Anderson is a data engineer, creative engineer, and managing director of the Big Data Institute. Jesse trains employees on big data—including cutting-edge technology like Apache Kafka, Apache Hadoop, and Apache Spark. He’s taught thousands of students at companies ranging from startups to Fortune 100 companies the skills to become data engineers. He’s widely regarded as an expert in the field and recognized for his novel teaching practices. Jesse is published by O’Reilly and Pragmatic Programmers and has been covered in such prestigious media outlets as the Wall Street Journal, CNN, BBC, NPR, Engadget, and Wired. You can learn more about Jesse at

Comments on this page are now closed.


13/05/2019 23:09 BST

Thank you for the deck!

13/05/2019 9:57 BST

Thanks Jesse!

Picture of Jesse Anderson
10/05/2019 17:20 BST

Here you go

10/05/2019 14:34 BST

Is it possible to get the slides from this presentation?