Put AI to Work
April 15-18, 2019
New York, NY
Please log in

nGraph: Unlocking next-generation performance with deep learning compilers

Adam Straw (Intel), Adam Procter (Intel AI), Robert Earhart (Intel)
11:05am11:45am Thursday, April 18, 2019
Location: Grand Ballroom West
Average rating: ****.
(4.50, 2 ratings)

What you'll learn

  • Explore Intel's nGraph deep learning compiler


The rapid growth of deep learning in demanding large-scale real-world applications has led to a rapid increase in demand for high-performance training and inference solutions. This demand is reflected in the growth of investment in deep learning performance by major hardware manufacturers, including a proliferation of new application-specific accelerators.

But performance isn’t driven by hardware alone. In the software realm, a new class of deep learning compilers has emerged, which brings to bear both classic and novel compiler techniques in order to maximize the performance of deep learning systems. Recently developed deep learning compilers include NNVM/TVM from the University of Washington and Amazon, Glow from Facebook, XLA from Google, and nGraph from Intel. These deep learning compilers unlock a wealth of optimizations that take a view of the whole data-flow graph. This approach achieves substantial speedups over the approach favored by existing frameworks, where an interpreter orchestrates the invocation of per-op compute kernels that must be optimized specifically for the framework and hardware target.

Adam Straw, Adam Procter, and Robert Earhart offer a comprehensive overview of Intel’s nGraph deep learning compiler.

Topics include:

  • The motivation for deep learning compilers
  • Their design challenges
  • A deep dive into the design of nGraph, including the design of its intermediate representation, optimization pipelines, runtime interface, and framework integration
  • Related efforts and future directions in deep learning compiler research
Photo of Adam Straw

Adam Straw


Adam Straw is a Deep Learning Software Engineer in the Artificial Intelligence Products Group at Intel Corporation. Adam received a B.S. in Computer Engineering from Iowa State University and is currently working on a M.S. in Computer Science with a specialty in machine learning at Georgia Institute of Technology. Adam work on Intel® nGraph™ deep learning compiler with special focus on core design including current responsibilities for the nGraph quantization scheme.

Photo of Adam Procter

Adam Procter

Intel AI

Adam Procter is a deep learning software engineer in the Artificial Intelligence Products Group at Intel, where he works on the core design of the Intel nGraph deep learning compiler. He holds a PhD in computer science from the University of Missouri, where his research focused on programming language semantics, high-assurance computing, and techniques for compiling functional programming languages to reconfigurable hardware.

Photo of Robert Earhart

Robert Earhart


Rob Earhart is a deep learning software engineer in the Artificial Intelligence Products Group at Intel, where he works on PlaidML, an open source polyhedral tensor compiler that makes it pretty easy to run neural networks with good performance on a wide variety of hardware. Prior to Intel (and prior to diving into machine learning systems implementation), Rob worked on the NT kernel, was one of the original Hyper-V hypervisor engineers, and cofounded the virtual machine monitor that grew up to power Google Compute Engine.