Fueling innovative software
July 15-18, 2019
Portland, OR

AI pipelines powered by Jupyter notebooks

11:00am11:45am Tuesday, July 16, 2019
ML Ops Day
Location: E145/146
Average rating: *****
(5.00, 1 rating)

Who is this presentation for?

  • Open source AI platform architects




The Jupyter Notebook has become the de facto platform used by data scientists and AI engineers to build interactive applications and develop their AI/ML models. In this scenario, it’s very common to decompose various phases of the development into multiple notebooks to simplify the development and management of the model lifecycle.

Luciano Resende details how to schedule together these multiple notebooks that correspond to different phases of the model lifecycle into notebook-based AI pipelines and walk you through scenarios that demonstrate how to reuse notebooks via parameterization.

Prerequisite knowledge

  • Familiarity with Python and model development

What you'll learn

  • Learn to schedule and run related notebooks as pipelines and how these patterns can be used to productionalize your notebooks



Luciano Resende is a senior technical staff manager (STSM) and open source data science and AI platform architect at IBM CODAIT (formerly Spark Technology Center). He’s a member of ASF, where he’s been contributing to open source for over 10 years. He contributes to various big data-related Apache projects around the Apache Spark ecosystem as well as Jupyter ecosystem projects, building a scalable, secure, and flexible enterprise data science platform.