Hi, I’m Shan.
I’m a data scientist interested in how evidence becomes decisions.
A/B Testing Is a Decision Problem
Why A/B testing is not just a stats exercise, and how to think about experiments in terms of business decisions, risk and commercial value.
Read the articleLatest writing
Beyond peeking: Making decisions during A/B tests Imagine you are two weeks into a planned six-week e-commerce experiment. Can we roll out early and keep learning? Can we make an informed commercial decision halfway through an experiment without necessarily giving up the ability to learn from it? Fixed-power designs: How much data do we really need? We normally use historical data to estimate how many observations an experiment needs.