All Software Architecture, All the Time
June 10-13, 2019
San Jose, CA
Please log in

Architecting and deploying machine learning for private cloud

Derek Ferguson (Fitch Solutions), Laura Shornack (JPMorgan Chase)
9:00am–10:30am Thursday, June 13, 2019
Secondary topics:  Best Practice, Framework-focused
Average rating: ****.
(4.33, 3 ratings)

Who is this presentation for?

  • Architects and software engineers



Prerequisite knowledge

  • Familiarity with machine learning (any framework) and container technology

What you'll learn

  • Learn the key DevOps challenges surrounding ML solutions
  • Discover design considerations for GPU use in the cloud
  • Learn end-to-end design and setup of CI/CD for ML on a private cloud


Laura Schornack and Derek Ferguson walk you through the conception, design, and implementation of an end-to-end machine learning system for financial pattern recognition in the private cloud. Starting with just a basic theoretical knowledge of machine learning and containerization, you’ll walk away with a complete understanding of both the challenges in private cloud machine learning and the best solutions.

Laura and Derek begin by discussing the underlying machine learning concepts to be used in the solution. They describe the case—recognizing latent patterns in financial data—and introduce the technologies in the solution (TensorFlow, Kubernetes, and Kubeflow). Laura and Derek then walk you through the overall architecture of the solution, including primary stores and conduits of data into the system, backbone processing for training of the ML models, and execution capacity for predictions against these models. They conclude with a deep dive into the unique challenges around establishing a full ML solution in a private cloud.

Topics include:

  • Bringing tools primarily designed for public cloud in-house
  • Achieving optimal neural network performance in GPU-restricted environments
  • Establishing secure persistent volumes on Kubernetes for confidential data
  • Debugging complex ML models across multiple containers
  • Open source contributions in Fortune 50 enterprises
Photo of Derek Ferguson

Derek Ferguson

Fitch Solutions

Derek Ferguson is Head of Technology for Fitch Solutions, where he is responsible for the development of Fitch Connect, the flagship service from Fitch Solutions which brings together ratings, research and extensive coverage of bank fundamental data into a single platform to enable analysis. He graduated with honors from Chicago’s DePaul University , has authored best-selling software development books such as Broadband Internet Access for Dummies, and spoken at events all over the world from JavaOne to Microsoft’s TechEd.

Photo of Laura Shornack

Laura Shornack

JPMorgan Chase

Laura Schornack is an expert engineer and lead design architect for shared services at JPMorgan Chase. Previously, she worked for world-renowned organizations such as IBM and Nokia. She holds a degree in computer science from University of Illinois at Urbana-Champaign.