14–17 Oct 2019

ROCm and Hopsworks for end-to-end deep learning pipelines

Jim Dowling (Logical Clocks)
16:5017:30 Thursday, October 17, 2019
Location: King's Suite - Sandringham
Secondary topics:  Deep Learning tools, Hardware, Machine Learning tools

Who is this presentation for?

  • Data scientists, data architects, data engineers, and CTOs

Level

Intermediate

Description

The Radeon open ecosystem (ROCm) is an open source software foundation for GPU computing on Linux. ROCm supports TensorFlow and PyTorch using MIOpen, a library of highly optimized GPU routines for deep learning.

Jim Dowling outlines how Hopsworks, an open source platform for machine learning infrastructure, enables the training and operation of deep learning models on ROCm in horizontally scalable end-to-end machine learning pipelines. He presents performance benchmarks for ROCm on new GPU hardware (AMD MI50, MI60 GPUs) and shows you how Hopsworks can enable distributed deep learning with both ROCm and Cuda on both TensorFlow and PyTorch. You’ll see a live demonstration of training and inference for an end-to-end machine learning pipeline written in a number of Jupyter notebooks orchestrated by Airflow.

Prerequisite knowledge

A basic understanding of Python and either TensorFlow or PyTorch programs

What you'll learn

  • Learn that ROCm is a viable, high-performance platform for deep learning and Hopsworks enables the development and operation of horizontally scalable deep learning pipelines using ROCm
Photo of Jim Dowling

Jim Dowling

Logical Clocks

Jim Dowling is the CEO of Logical Clocks, an associate professor at KTH Royal Institute of Technology in Stockholm, and lead architect of Hopsworks, an open source data and AI platform. He’s a regular speaker at big data industry conferences. He holds a PhD in distributed systems from Trinity College Dublin.

Leave a Comment or Question

Help us make this conference the best it can be for you. Have questions you'd like this speaker to address? Suggestions for issues that deserve extra attention? Feedback that you'd like to share with the speaker and other attendees?

Join the conversation here (requires login)

Contact us

confreg@oreilly.com

For conference registration information and customer service

partners@oreilly.com

For more information on community discounts and trade opportunities with O’Reilly conferences

aisponsorships@oreilly.com

For information on exhibiting or sponsoring a conference

Contact list

View a complete list of O'Reilly AI contacts