Put open source to work
July 16–17, 2018: Training & Tutorials
July 18–19, 2018: Conference
Portland, OR

Got a trained deep learning model? Now what? Deploying deep learning models

Hannes Hapke (SAP ConcurLabs)
1:30pm2:00pm Tuesday, July 17, 2018
Location: B115-116
Tags: tensorflow
Average rating: *****
(5.00, 3 ratings)

TensorFlow and its community provide a variety of deep learning tools to develop novel deep learning models. A large number of talks have focused on amazing tools like TensorBoard or novel TensorFlow implementations like the support for sequence-to-sequence networks. However, developing deep learning models with TensorFlow is often only half of the story. To be useful to the public, the model needs to be deployed.

Hannes Hapke explains how to deploy your TensorFlow model easily with TensorFlow Serving, introduces an emerging project called Kubeflow, and highlights some deployment pitfalls like model versioning and deployment flow. You’ll learn when a deployment with TensorFlow Serving or Kubeflow makes sense, how to deploy trained TensorFlow models with TensorFlow Serving, how to install required system dependencies, and Kubeflow basic concepts. You’ll leave ready to deploy your TensorFlow models yourself or guide your DevOps colleagues to deploy your models for your organization.

Photo of Hannes Hapke

Hannes Hapke

SAP ConcurLabs

Hannes Hapke is a senior data scientist at SAP ConcurLabs. He’s been a machine learning enthusiast for many years and is a Google Developer Expert for machine learning. Hannes has applied deep learning to a variety of computer vision and natural language problems, but his main interest is in machine learning engineering and automating model workflows. Hannes is a coauthor of the deep learning publication Natural Language Processing in Action and he’s working on a book about Building Machine Learning Pipelines with TensorFlow Extended (O’Reilly). When he isn’t working on a deep learning project, you’ll find him outdoors running, hiking, or enjoying a good cup of coffee with a great book.