Sep 9–12, 2019

Sequence to sequence modeling for time series forecasting

Arun Kejariwal (Independent), Ira Cohen (Anodot)
1:45pm2:25pm Wednesday, September 11, 2019
Location: LL21 C/D
Average rating: ****.
(4.40, 5 ratings)

Who is this presentation for?

  • Industry practitioners




S2S modeling using neural networks is increasingly becoming mainstream. In particular, it’s been leveraged for applications such as, but not limited to, speech recognition, language translation, and question answering. More recently, S2S has also been used for applications based on time series data. Specifically, people are actively exploring S2S modeling-based real-time anomaly detection and forecasting.

Arun Kejariwal and Ira Cohen provide an overview of S2S and the early use cases of S2S. They’ll walk you through how S2S modeling can be leveraged for the aforementioned use cases, visualization, real-time anomaly detection, and forecasting. You’ll learn how multilayered long short-term memory (LSTM) encodes the input time series and a deep LSTM decodes. In anomaly detection, the output is married with “traditional” statistical approaches for anomaly detection. Conceivably, any of the many variants of LSTM or recurrent neural network (RNN) alternatives of LSTM can be used to trade-off accuracy and speed. Further, given that LSTMs operate sequentially and are quite slow to train, Arun and Ira shed light on how architectures such as convolutional neural networks (CNNs) and self-attention networks (SANs) can be leveraged to achieve significant improvements in accuracy. You’ll see a concrete case study to illustrate the use of S2S for both real-time anomaly detection and forecasting for time series data.

What you'll learn

  • Learn how to leverage S2S models for real-time anomaly detection and forecasting
Photo of Arun Kejariwal

Arun Kejariwal


Arun Kejariwal is an independent lead engineer. Previously, he was he was a statistical learning principal at Machine Zone (MZ), where he led a team of top-tier researchers and worked on research and development of novel techniques for install-and-click fraud detection and assessing the efficacy of TV campaigns and optimization of marketing campaigns, and his team built novel methods for bot detection, intrusion detection, and real-time anomaly detection; and he developed and open-sourced techniques for anomaly detection and breakout detection at Twitter. His research includes the development of practical and statistically rigorous techniques and methodologies to deliver high performance, availability, and scalability in large-scale distributed clusters. Some of the techniques he helped develop have been presented at international conferences and published in peer-reviewed journals.

Photo of Ira Cohen

Ira Cohen


Ira Cohen is a cofounder and chief data scientist at Anodot, where he’s responsible for developing and inventing the company’s real-time multivariate anomaly detection algorithms that work with millions of time series signals. He holds a PhD in machine learning from the University of Illinois at Urbana-Champaign and has over 12 years of industry experience.

  • Intel AI
  • O'Reilly
  • Amazon Web Services
  • IBM Watson
  • Dataiku
  • Dell Technologies
  • Intuit
  • Gamalon
  • Hewlett Packard Enterprise
  • MapR Technologies
  • Sisu Data
  • Intuit

Contact us

For conference registration information and customer service

For more information on community discounts and trade opportunities with O’Reilly conferences

Become a sponsor

For information on exhibiting or sponsoring a conference

For media/analyst press inquires