Put AI to Work
April 15-18, 2019
New York, NY
Please log in

Executive Briefing: Agile AI

Sarah Aerni (Salesforce Einstein)
4:05pm4:45pm Wednesday, April 17, 2019
Secondary topics:  AI in the Enterprise, Automation in machine learning and AI, Platforms and infrastructure
Average rating: *****
(5.00, 1 rating)

Who is this presentation for?

  • Product managers, engineering managers, and CTOs



Prerequisite knowledge

  • A basic understanding of the AI products space

What you'll learn

  • Learn how Salesforce enables data scientists to rapidly iterate and adopt a truly Agile methodology
  • Discover how to introduce agility into your AI organizations for shipping products


Every company needs artificial intelligence in production to stay competitive. This is hard technically and also from a process standpoint. Many engineering organizations struggle to provide their data scientists with the tools needed to effectively deploy models into production and continuously iterate. So how does Salesforce make data science an Agile partner to over 100,000 customers?

Sarah Aerni shares the nuts and bolts of the company’s platform and details the Agile process behind it. From open source autoML library TransmogrifAI and experimentation to deployment and monitoring, Sarah covers the tools that make it possible for data scientists to rapidly iterate and adopt a truly Agile methodology.

TransmogrifAI makes it easy for Salesforce’s data scientists to contribute new ways of solving challenging problems and evaluating them at scale using experimentation frameworks. The platform helps them ship the code to production to all customers simultaneously, automating the process of retraining thousands of models and shipping billions of predictions per day. And with modeling comes the need to detect issues and identify opportunities for improvements. Sarah explains how Salesforce uses alerting and monitoring to keep track of the individual models that its 100,000+ customers can build in a completely automated way and drive the company’s data science backlog. Along the way, Sarah discusses lessons learned about rapid iteration and ensuring data science innovation continues according to a truly Agile methodology.

Photo of Sarah Aerni

Sarah Aerni

Salesforce Einstein

Sarah Aerni is a director of data science at Salesforce Einstein, where she leads teams building AI-powered applications using autoML. Previously, she led teams in healthcare and life sciences at Pivotal, building models for customers, and she cofounded a company offering expert services in informatics to both academia and industry. Sarah holds a PhD in biomedical informatics from Stanford University, where she performed research at the interface of biomedicine and machine learning.