Building causal measurement for B2B CRM
Problem Attribution told us who got credit, not whether the communications actually changed behavior. In B2B, smaller samples, heterogeneous users, and noisy outcomes made the answer even harder to pin down.
Approach I helped build an experimentation framework around randomized holdouts, then used power analysis and methods like regression/CUPED, trimming, and shrinkage to make the estimates more stable.
Impact The result was a measurement framework Data Science and Marketing could rely on when deciding what to scale, change, or stop.
CUPED uses pre-treatment behavior to explain away some of the noise, improving precision without changing the causal question.