A pervasive but often overlooked problem in predictive modeling on real-life data is the problem of data or label leakage. At enterprise companies that provide ML as a service to other businesses, such as Salesforce, this problem takes on monstrous proportions as the data is populated by diverse and often unknown business processes, making it very hard for data scientists to distinguish cause from effect.
Till Bergmann explains how Salesforce—which needs to churn out thousands of customer-specific models for any given use case—tackled this problem. The automated approaches are a part of our recently open-sourced Spark-based library TransmogrifAI and extend the boundaries of what typically falls in the domain of automated machine learning.
Till Bergmann is a senior data scientist at Salesforce Einstein, building platforms to make it easier to integrate machine learning into Salesforce products, with a focus on automating many of the laborious steps in the machine learning pipeline. He holds a PhD in cognitive science from the University of California, Merced, where he studied the collaboration patterns of academics using NLP techniques.
©2019, O'Reilly Media, Inc. • (800) 889-8969 or (707) 827-7019 • Monday-Friday 7:30am-5pm PT • All trademarks and registered trademarks appearing on oreilly.com are the property of their respective owners. • firstname.lastname@example.org