Metadata
- Author: Marton Trencseni
- Full Title:: Reducing Variance in a/B Testing With CUPED
- Category:: 🗞️Articles
- Document Tags:: Hypothesis testing,
- URL:: https://bytepawn.com/reducing-variance-in-ab-testing-with-cuped.html
- Finished date:: 2024-09-30
Highlights
CUPED is a variance reduction technique introduced by Deng, Xu, Kohavi and Walker. Using CUPED we can achieve lower variance in A/B testing by computing an adjusted evaluation metric using historic “before” data. (View Highlight)
CUPED is a win. It allows us to more accurately measure experimental lift if there is correlation between “before” and “after”, without degrading measurements if there is not. (View Highlight)