Presented By O’Reilly and Cloudera
Make Data Work
September 11, 2018: Training & Tutorials
September 12–13, 2018: Keynotes & Sessions
New York, NY

Building a high-performance model serving engine from scratch using Kubernetes, GPUs, Docker, Istio, and TensorFlow

Chris Fregly (Amazon Web Services)
2:00pm–2:40pm Thursday, 09/13/2018
Data engineering and architecture, Expo Hall
 Location: Expo Hall Level: Intermediate
Secondary topics:  Model lifecycle management
Average rating: ***..
(3.50, 2 ratings)

Who is this presentation for?

  • Data scientists, data engineers, data analysts, CTOs, and CEOs

Prerequisite knowledge

  • A basic understanding of machine learning

What you'll learn

  • Learn how to serve models in production the right way

Description

Drawing on his experience at Netflix, particularly its culture, which encourages “freedom and responsibility,” Chris Fregly explains how data scientists can use PipelineAI to safely deploy their ML/AI pipelines into production using live data and details a full-featured, open source end-to-end TensorFlow model training and deployment system, using the latest advancements with Kubernetes, TensorFlow, and GPUs.

In addition to training and hyperparameter tuning, the model deployment pipeline includes continuous canary deployments of TensorFlow models into a live hybrid-cloud production environment. This is the holy grail of data science: rapid and safe experiments of ML/AI models directly in production.

Offline batch training and validation is for the slow and weak. Online real-time training and validation on live production data is for the fast and strong. Learn to be fast and strong by attending this talk.

Photo of Chris Fregly

Chris Fregly

Amazon Web Services

Chris Fregly is a senior developer advocate focused on AI and machine learning at Amazon Web Services (AWS). Chris shares knowledge with fellow developers and data scientists through his Advanced Kubeflow AI Meetup and regularly speaks at AI and ML conferences across the globe. Previously, Chris was a founder at PipelineAI, where he worked with many startups and enterprises to deploy machine learning pipelines using many open source and AWS products including Kubeflow, Amazon EKS, and Amazon SageMaker.