Fueling innovative software
July 15-18, 2019
Portland, OR

Kubernetes for machine learning: Productivity over primitives

Sophie Watson (Red Hat), William Benton (Red Hat)
11:45am12:30pm Tuesday, July 16, 2019
ML Ops Day
Location: E145/146
Average rating: ****.
(4.67, 3 ratings)

Who is this presentation for?

  • Data scientists and machine learning engineers
  • DevOps or infrastructure engineers who support data scientists and machine learning engineers




Kubernetes is today’s hottest way to deploy and manage contemporary applications in the cloud, but it also offers the essential foundation for repeatable and reliable machine learning workflows.

Sophie Watson and William Benton demonstrate open source tools that build on Kubernetes to facilitate solving data science workflow challenges for practitioners. They focus on high-level tools that build productive solutions on powerful primitives without forcing data scientists to care about the primitive details of their infrastructure. They’ll walk you through a typical machine learning workflow and show you how Kubernetes supports data scientists at each step. You’ll see tools that effortlessly provision custom research environments, publish reproducible notebooks, operationalize models and pipelines as services, and detect data drift automatically.

Prerequisite knowledge

  • Familiarity with machine learning workflows
  • Familiarity with Kubernetes (useful but not required)

What you'll learn

  • Gain a better understanding of what Kubernetes brings to production machine learning workflows and inspiration for how to get started
  • Learn the next steps to get started enabling diverse teams to put intelligence into production on Kubernetes
Photo of Sophie Watson

Sophie Watson

Red Hat

Sophie Watson is a software engineer in an Emerging Technology Group at Red Hat, where she applies her data science and statistics skills to solving business problems and informing next-generation infrastructure for intelligent application development. She has a background in mathematics and holds a PhD in Bayesian statistics, in which she developed algorithms to estimate intractable quantities quickly and accurately.

Photo of William Benton

William Benton

Red Hat

William Benton leads a team of data scientists and engineers at Red Hat, where he has built machine learning systems to solve problems ranging from understanding infrastructure logs at datacenter scale to designing better cycling workouts.