Causal inference 101: Answering the crucial "why" in your analysis

Subhasish Misra (Walmart Labs)

5:25pm–6:05pm Wednesday, September 25, 2019

Location: 1A 12/14

Data Science, Machine Learning, & AI

Secondary topics: Retail and e-commerce

Average rating:

(5.00, 4 ratings)

Who is this presentation for?

Data scientists, decision scientists, data analysts, and data science managers

Level

Beginner

Description

Causal questions are ubiquitous in data science. For example, you may have questions that are deeply rooted in causality, such as whether or not changing a feature on a website led to more traffic or if digital ad exposure led to incremental purchase, did changing a feature in a website lead to more traffic or if digital ad exposure led to incremental purchase.

Randomized tests are considered to be the gold standard when addressing causal effects; however, in many cases experiments are unfeasible or unethical. In such cases, you have to rely on observational (nonexperimental)data to derive causal insights. The crucial difference between randomized experiments and observational data is that in the former, test subjects (e.g., the customers) are randomly assigned a treatment (e.g., digital advertisement exposure). This helps curb the possibility that user response (e.g., clicking on a link in the ad and purchasing the product) across the two groups of treated and nontreated subjects is different because of preexisting differences in user characteristic (e.g., demographics, geolocation, etc.) In essence, you can then attribute divergences observed posttreatment in key outcomes (e.g., purchase rate) as the causal impact of the treatment. But this treatment assignment mechanism is absent when using observational data.

Subhasish Misra explores the statistical methods available to ensure you’re able to circumvent this shortcoming and get to causality. You’ll get a practical overview of the aspects of causal inference, including the fundamental tenants of causality and measuring causal effects; the challenges involved in measuring causal effects in real-world situations; distinguishing between randomized and observational measurement approaches; an introduction to measuring casual effects with observational data using matching and its extension of propensity score-based matching with a focus on the institution and statistics behind it, tips from the trenches based on Subhasish’s experience with these techniques; and practical limitations of these approaches. Subhashish walks you through an example of how matching was applied to get causal insights regarding the effectiveness of a digital product at Walmart.

Prerequisite knowledge

A basic understanding of machine statistics and data science

What you'll learn

Discover the fundamental nuances of causal inference and analytical frameworks and implementation tools to tease out causal effects in the wild—when randomization isn't an option
Understand the differences between randomized and observational studies and the challenges in getting to causal conclusions for each

Subhasish Misra

Walmart Labs

Subhasish is a staff data scientist at Walmart Labs, where he leads efforts to create scalable machine learning solutions for Walmart’s customer base. He’s also a member of the global data science board at I-COM, a cross-industry global think tank on harnessing data and analytics for better marketing. Previously, Subhasish was at HP, WPP, and Aon and consulted for many Fortune 500 clients across multiple geographies in his 12 years of advanced analytics career. His broad expertise lies along a wide spectrum of marketing analytics, and his current data science interest areas are around modeling customer behavior and causal inference. He holds an MA in economics from the Delhi School of Economics, where econometrics was one of his focus areas.