Presented By O’Reilly and Intel AI
Put AI to work
8-9 Oct 2018: Training
9-11 Oct 2018: Tutorials & Conference
London, UK

Tensor2Tensor (sponsored by Google)

Ryan Sepassi (Google)
13:45–14:25 Wednesday, 10 October 2018
Sponsored, TensorFlow at AI
Location: Buckingham Room - Palace Suite

What you'll learn

  • Explore Tensor2Tensor, an open source library of datasets and models and a framework for training, evaluation, and decoding

Description

Ryan Sepassi offers an overview of Tensor2Tensor, an open source library of datasets and models and a framework for training, evaluation, and decoding, built on top of TensorFlow. Tensor2Tensor is actively used and maintained by scientists and engineers within Google Brain.

Tensor2Tensor makes it easy to try a model on many datasets and scale up from a single GPU to an entire Cloud TPU pod (512 cores). It includes the reference implementation of the “Attention Is All You Need” transformer model as well as the prototype implementation of Mesh TensorFlow, an exciting new direction for large-scale model parallelism within TensorFlow and on TPUs.

This session is sponsored by Google.

Photo of Ryan Sepassi

Ryan Sepassi

Google

Ryan Sepassi is a senior research engineer on the Google Brain team at Google, where he works on natural language processing and reinforcement learning research and infrastructure. He’s an author and maintainer of the Tensor2Tensor library.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)