Building causal measurement for B2B CRM
Problem Attribution could not show whether communications to employees at client companies actually changed behavior—while small samples, heterogeneity, and noisy outcomes made lift volatile.
Approach I helped lead an experimentation framework combining randomized holdouts, power analysis, regression/CUPED, principled trimming, and shrinkage where appropriate.
Impact Gave Data Science and Marketing a more credible, stable basis for deciding what to scale, change, or stop.
CUPED uses pre-treatment information to reduce unexplained variance and improve precision while targeting the same causal effect.