Presented By O’Reilly and Intel AI
Put AI to work
Sep 4-5, 2018: Training
Sep 5-7, 2018: Tutorials & Conference
San Francisco, CA

Building reinforcement learning applications with Ray

Robert Nishihara (University of California, Berkeley), Philipp Moritz (University of California, Berkeley), Ion Stoica (University of California, Berkeley)
1:30pm-5:00pm Wednesday, September 5, 2018
Implementing AI
 Location: Continental 7/8
Secondary topics:  Reinforcement Learning
Average rating: ***..
(3.00, 3 ratings)

Who is this presentation for?

  • Machine learning researchers and practitioners and data scientists

Prerequisite knowledge

  • Familiarity with Python programming, basic machine learning concepts, and reinforcement learning

Materials or downloads needed in advance

  • A laptop

What you'll learn

  • Learn how to develop simple RL applications at scale with Ray and manage Ray on clusters

Description

Reinforcement learning (RL) is emerging as a promising approach to intelligently interact with continuously changing physical or virtual environments. Advances in RL research have already shown remarkable results, such as Google’s AlphaGo beating the Go world champion, and are finding their way into self-driving cars, unmanned aerial vehicles, and surgical robotics. Not surprisingly, many see RL growing rapidly into a potentially dominant area in ML over the next decade. However, the applications of RL pose a new set of requirements, the combination of which creates a challenge for existing distributed execution frameworks: computation with millisecond latency at high throughput, adaptive construction of arbitrary task graphs, and execution of heterogeneous kernels over diverse sets of resources.

Ray is a new distributed execution framework for reinforcement learning applications. Ion Stoica, Robert Nishihara, and Philipp Moritz lead a deep dive into Ray, walking you through its API and system architecture and sharing application examples, including several state-of-the-art RL algorithms.

Photo of Robert Nishihara

Robert Nishihara

University of California, Berkeley

Robert Nishihara is a fourth-year PhD student working in the University of California, Berkeley, RISELab with Michael Jordan. He works on machine learning, optimization, and artificial intelligence.

Photo of Philipp Moritz

Philipp Moritz

University of California, Berkeley

Philipp Moritz is a PhD candidate in the Electrical Engineering and Computer Sciences (EECS) Department at the University of California, Berkeley, with broad interests in artificial intelligence, machine learning, and distributed systems. He’s a member of the Statistical AI Lab and the RISELab.

Photo of Ion Stoica

Ion Stoica

University of California, Berkeley

Ion Stoica is a professor in the Electrical Engineering and Computer Sciences (EECS) Department at the University of California, Berkeley, where he researches cloud computing and networked computer systems. Previously, he worked on dynamic packet state, chord DHT, internet indirection infrastructure (i3), declarative networks, and large-scale systems, including Apache Spark, Apache Mesos, and Alluxio. He’s the cofounder of Databricks—a startup to commercialize Apache Spark—and Conviva—a startup to commercialize technologies for large-scale video distribution. Ion is an ACM fellow and has received numerous awards, including inclusion in the SIGOPS Hall of Fame (2015), the SIGCOMM Test of Time Award (2011), and the ACM doctoral dissertation award (2001).