Getting started with Kubeflow
Who is this presentation for?
- Data scientists and AI infrastructure engineers
Kubeflow consists of dozens of components used to train and serve machine learning models, but the first task is to understand the Kubeflow architecture and how it fits into the larger Kubernetes ecosystem. Skyler Thomas details the performance, availability, and security impacts of various Kubeflow deployment options and decisions that you might make in how you use Kubeflow.
Once you understand the basics, it’s time for you to go hands on and actually deploy a subset of the Kubeflow components into a running Kubernetes environment using Jupyter Hub and Jupyter Notebooks to import your training data and set up prerequisites for creating training environments using TensorFlow (and PyTorch, time permitting). You’ll begin to submit training jobs and generate models and serve these models via TensorFlow Serving (and Seldon Core, time permitting).
- A working knowledge of GitHub (The ability to clone a GitHub repo is required.)
- General knowledge of Kubernetes and various machine learning frameworks like TensorFlow and PyTorch (useful but not required)
Materials or downloads needed in advance
- A laptop with connectivity to GitHub and a >v1.11 Kubernetes environment (This environment can be a Minikube installation, but you'll get the most out of this if you have a Kubernetes cluster with several nodes available.)
What you'll learn
- Understand the architecture of Kubeflow
- Learn to install Kubeflow into Kubernetes, use Jupyter Notebooks, start a TensorFlow training job, and serve your models to handle requests
Skyler Thomas is the chief architect for Kubernetes and a principal engineer at MapR. At MapR, Skyler designs Kubernetes-based infrastructure to deliver machine learning and big data applications at scale. Previously, Skyler was a lead architect for WebSphere at IBM, where he worked with hundreds of customers to deliver extreme-scaled applications in various industries, including healthcare and financial services.
Leave a Comment or Question
Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?
Join the conversation here (requires login)
Diversity and Inclusion Sponsor
R & D and Innovation Track Sponsor
For conference registration information and customer service
For more information on community discounts and trade opportunities with O’Reilly conferences
For information on exhibiting or sponsoring a conference
View a complete list of O'Reilly AI contacts