Sep 9–12, 2019

The OS for AI: How Serverless Computing Enables the Next Gen of Machine Learning

Jonathan Peck (Algorithmia)
4:50pm5:30pm Thursday, September 12, 2019
Location: LL21 E/F

Who is this presentation for?

DataScientists, ML Developers and Implementers, Team Leads and CTOs using ML




Machine Learning has been advancing rapidly, but only a few contributors are focusing on the infrastructure and scaling challenges that come with it. When you have thousands of model versions, each written in any mix of frameworks (Python/R/Java/Ruby, PyTorch/SciKit/Caffe/Tensorflow etc), how do you efficiently deploy them as elastic, scalable, secure APIs with 10ms of latency and GPU access?

We’ve built, deployed, and scaled thousands of algorithms and machine learning models, using every kind of framework. We’ve seen many of the challenges faced in this area, and in this talk I’ll share some insights into the problems you’re likely to face, and how to approach solving them.

In brief, we’ll examine the need for, and implementations of, a complete “Operating System for AI”: a common interface for different algorithms to be used and combined, and a general architecture for serverless machine learning which is discoverable, versioned, scalable and sharable.

Prerequisite knowledge

General understanding of what ML is, but no deep technical/coding in specific frameworks is required

What you'll learn

Attendees will gain insight into the role AI will play in their applications, how various Machine Learning components interoperate, and enjoy a unique take on the evolution of ML as it parallels the early development of Operating Systems. They'll leave with an understanding of how to successfully move their ML models into production environments.
Photo of Jonathan Peck

Jonathan Peck


A full-stack developer with two decades of industry experience, Jon Peck now focuses on bringing scalable, discoverable, and secure machine-learning microservices to developers across a wide variety of platforms via

Organizer: Seattle Building Intelligent Applications Meetup

Speaker: Galvanize, CodeFellows, Metis, Epicodus, Alchemy (tech talks); OpenSeattle; SeattleJS; AI Next; DeveloperWeek

Educator: Cascadia College, Seattle C&W, independent instruction

Lead Developer: Empower Engine, Giftstarter, Mass General Hospital, Cornell University

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)

Contact us

For conference registration information and customer service

For more information on community discounts and trade opportunities with O’Reilly conferences

Become a sponsor

For information on exhibiting or sponsoring a conference

Contact list

View a complete list of O'Reilly AI contacts