Schedule: Reinforcement Learning sessions

Ray is a general purpose framework for programming your cluster. Robert Nishihara, Philipp Moritz, Ion Stoica, and Eric Liang lead a deep dive into Ray, walking you through its API and system architecture and sharing application examples, including several state-of-the-art AI algorithms. Read more.

Jian Chang and Sanjian Chen outline the design of the AI engine built on Alibaba’s TSDB service, which enables fast and complex analytics of large-scale time series data in many business domains. Join in to see how TSDB empowers companies across various industries to better understand data trends, discover anomalies, manage risks, and boost efficiency. Read more.

Join Danny Lange to learn how to create artificially intelligent agents that act in the physical world (through sense perception and some mechanism to take physical actions, such as driving a car). You'll discover how observing emergent behaviors of multiple AI agents in a simulated virtual environment can lead to the most optimal designs and real-world practices. Read more.

Drawing on his work building and deploying an RL-based relational query optimizer, a core component of almost every database system, Sanjay Krishnan highlights some of the underappreciated challenges to implementing deep reinforcement learning. Read more.

Digital character interaction is hard to fake, whether it’s between two characters, between users and characters, or between a character and its environment. Nevertheless, interaction is central to building immersive XR experiences, robotic simulation, and user-driven entertainment. Kevin He explains how to use physical simulation and machine learning to create interactive character technology. Read more.

Games are wonderful contained problem spaces, making them great places to explore AI—even if you're not a game developer. Paris Buttfield-Addison, Mars Geldard, and Tim Nugent teach you how to use Unity to train, explore, and manipulate intelligent agents that learn. You'll train a quadruped to walk, then train it to explore, fetch, and manipulate the world. Read more.

Machine learning models are often susceptible to adversarial deception of their input at test time, which leads to poorer performance. Alina Matyukhina investigates the feasibility of deception in source code attribution techniques in real-world environments and explores attack scenarios on users' identities in open source projects—along with possible protection methods. Read more.

Matthew Reyes casts consumer decision making within the framework of random utility and outlines a simplified scenario of optimizing preference on a social network to illustrate the steps in a company’s allocation decision, from learning parameters from data to evaluating the consequences of different marketing allocations. Read more.