Presented By
O’Reilly + Cloudera
Make Data Work
March 25-28, 2019
San Francisco, CA
Please log in

On a deep journey toward five nines

1:50pm2:30pm Thursday, March 28, 2019
Average rating: ****.
(4.50, 2 ratings)

Who is this presentation for?

  • Data scientists, research engineers, and those working in alerting, monitoring, and DevOps

Level

Intermediate

Prerequisite knowledge

  • Familiarity with machine learning

What you'll learn

  • Learn how PayPal applies Seq2Seq networks to real-world time series data
  • Understand how to handle large volumes of streaming data
  • Explore orchestration using pipelines with template Jupyter notebooks

Description

At PayPal, achieving four nines of availability is the norm. In the pursuit of exponentially complex additional nines, the company has recently embarked on applying deep learning to forecasting datacenter metrics. Seq2Seq networks are ripe for application to this difficult problem, but little has been shared to the open community.

Aashish Sheshadri shines a light on how PayPal applies Seq2Seq networks to forecasting CPU and memory metrics at scale. Forecasting enables alerting flows to get a head start reducing MTTD, augment autoremidiation, and consequentially aid MTTR. Aashish also highlights how data scientists’s lives have been greatly simplified by the use of template notebooks stitched into stateful and stateless pipelines using PayPal’s open source PPExtensions and demonstrates how to use emplate notebooks as predictable execution drivers that enable abstraction and orchestration of TensorFlow distributed training and inference pipelines at scale on HPC clusters.

Photo of Aashish Sheshadri

Aashish Sheshadri

PayPal

Aashish Sheshadri is a research engineer at PayPal, where he currently ideates and applies deep learning to new avenues and actively contributes to the Jupyter ecosystem and the SEIF Project. He holds an MS in computer science from the University of Texas at Austin, where his research focused on active learning with human-in-the-loop systems.

Comments on this page are now closed.

Comments

Naitra Muralykrishnan | LEAD PRODUCT MANAGER
04/01/2019 5:35am PDT

Great content, good interaction and discussion.