Presented By O’Reilly and Intel AI
Put AI to work
8-9 Oct 2018: Training
9-11 Oct 2018: Tutorials & Conference
London, UK

The OS for AI: How microservices and serverless enable the next generation of machine intelligence

Diego Oppenheimer (Algorithmia)
11:55–12:35 Wednesday, 10 October 2018
AI in the Enterprise
 Location: Westminster Suite
Secondary topics:  Platforms and infrastructure

Who is this presentation for?

  • Data science team leaders and decision makers

Prerequisite knowledge

  • A basic understanding of machine learning (no deep technical knowledge required)

What you'll learn

  • Learn how to efficiently productionize machine learning, especially when many different frameworks and languages are involved
  • Understand the advantages serverless provides to AI
  • Discover how the industry can move forward in a cohesive fashion

Description

You’ve trained machine learning models on your data, but how do you put them into production? When you have tens of thousands of model versions, each written in any mix of frameworks from R, Java, and Ruby to scikit-learn, Caffe, and TensorFlow on GPUs and exposed as REST API endpoints, and your users love to chain algorithms and run ensembles in parallel, how do you maintain a latency of less than 20 ms on just a few servers?

As hot as AI has been lately, with constant advances in what is possible, there’s not been as much discussion of the infrastructure and scaling challenges that come with it. Algorithmia has built, deployed, and scaled thousands of algorithms and machine learning models, using every kind of framework, and has faced and solved many of its challenges.

Diego Oppenheimer explains why machine learning is a natural fit for serverless computing, discusses issues he ran into when implementing on-demand scaling over GPU clusters at Algorithmia, and provides general solutions and a vision for the future of cloud-based ML. Diego then shares a complete operating system for AI—a common interface for different algorithms to be used and combined—and a general architecture for serverless machine learning that is discoverable, versioned, scalable, and sharable.

Photo of Diego Oppenheimer

Diego Oppenheimer

Algorithmia

Diego Oppenheimer is the founder and CEO of Algorithmia. An entrepreneur and product developer with extensive background in all things data, Diego has designed, managed, and shipped some of Microsoft’s most used data analysis products, including Excel, Power Pivot, SQL Server, and Power BI. Diego holds a bachelor’s degree in information systems and a master’s degree in business intelligence and data analytics from Carnegie Mellon University.