Sep 9–12, 2019

The OS for AI: How serverless computing enables the next gen of machine learning

Jonathan Peck (GitHub)
4:50pm5:30pm Thursday, September 12, 2019
Location: 230 B
Secondary topics:  Machine Learning
Average rating: *****
(5.00, 1 rating)

Who is this presentation for?

  • Data scientists, ML developers and implementers, and team leads and CTOs using ML




Machine learning has been advancing rapidly, but only a few contributors are focusing on the infrastructure and scaling challenges that come with it. When you have thousands of model versions, each written in any mix of frameworks (Python, R, Java, Ruby, PyTorch, scikit-learn, Caffe, TensorFlow, etc.), it’s difficult to know how to efficiently deploy them as elastic, scalable, secure APIs with 10 ms of latency and GPU access.

Algorithmia has seen many of the challenges faced in this area. Jonathan Peck explores how the company built, deployed, and scaled thousands of algorithms and machine learning models using every kind of framework. You’ll learn some insights into the problems you’re likely to face and how to approach solving them. Jonathan examines the need for, and implementations of, a complete operating system for AI: a common interface for different algorithms to be used and combined, and a general architecture for serverless machine learning which is discoverable, versioned, scalable, and sharable.

Prerequisite knowledge

  • General knowledge of ML

What you'll learn

  • Gain insight into the role AI will play in your applications and how various ML components interoperate
  • Get a unique take on the evolution of ML as it parallels the early development of operating systems
  • Understand how to successfully move your ML models into production environments
Photo of Jonathan Peck

Jonathan Peck


A full-stack developer with two decades of industry experience, Jon Peck constantly strives to make technical concepts digestible — demonstrating the value of new technology at every level, from developers through execs.

Former speaker at DeveloperWeek, OSCON, AI Next, O’Reilly AI, ODSC, API World. Former developer/advocate at Mass General Hospital, Cornell University, Algorithmia. Current technical advocate at GitHub.

Comments on this page are now closed.


Picture of Jonathan Peck
Jonathan Peck | Technical Advocate
09/12/2019 3:39am PDT

Slides can be found at:

  • Intel AI
  • O'Reilly
  • Amazon Web Services
  • IBM Watson
  • Dataiku
  • Dell Technologies
  • Intuit
  • Gamalon
  • Hewlett Packard Enterprise
  • MapR Technologies
  • Sisu Data
  • Intuit

Contact us

For conference registration information and customer service

For more information on community discounts and trade opportunities with O’Reilly conferences

Become a sponsor

For information on exhibiting or sponsoring a conference

For media/analyst press inquires