Presented By O’Reilly and Intel AI
Put AI to work
8-9 Oct 2018: Training
9-11 Oct 2018: Tutorials & Conference
London, UK

The last mile on democratizing AI

Zhipeng Huang (Huawei)
16:50–17:30 Thursday, 11 October 2018
Implementing AI
 Location: Westminster Suite
Secondary topics:  Edge computing and Hardware, Platforms and infrastructure
Download slides (PDF)

Who is this presentation for?

  • Anyone who wants to build an open source cloud infrastructure for AI

Prerequisite knowledge

  • A basic understanding of the mechanics of deep learning

What you'll learn

  • Understand state-of-the-art open source IR solutions
  • See where open source RR is headed

Description

There has been a blossoming open source scene for deep learning frameworks, such as PyTorch, TensorFlow, and MXNet. However, the democratization of AI will only truly be achieved when the cloud infrastructure running these frameworks is open and better optimized.

Currently, various intermediate representation (IR) solutions like NNVM, DLVM, XLA, and nGraph help bridge the gap between the framework frontend and the hardware backend. But in order for the cloud platforms to truly be perceptive of the AI workloads, resource representation (RR) is needed to provide a mapping relationship between the resource provided by the infrastructure (GPU, FPGA, ASIC, etc.) and a given IR, which requires the resource to do the compiling.

Zhipeng Huang explains how resource representation works with various intermediate representation technologies to help achieve the democratization of AI. Zhipeng begins with a brief overview of the motivation as well as the current open source IR solutions, then provides a deep dive into how cyborg projects could help user build a open source cloud infra via OpenStack or Kubernetes for its AI application via RR techniques.

Photo of Zhipeng Huang

Zhipeng Huang

Huawei

Zhipeng Huang is an open source operation manager for Huawei. Zhipeng has been involved with various major open source communities and is now the PTL of OpenStack Cyborg project, cochair of OpenStack Public Cloud WG, and co-lead of the Kubernetes Policy WG. His current focus is open source cloud federation (OpenStack Tricircle, Ubernetes, Mesos Federation), and storage function visualization with open source software and hardware solutions.