Metadata
- Author: Marton Trencseni
- Full Title:: Five Ways to Reduce Variance in a/B Testing
- Category:: 🗞️Articles
- Document Tags:: Hypothesis testing,
- URL:: https://bytepawn.com/five-ways-to-reduce-variance-in-ab-testing.html
- Finished date:: 2024-09-30
Highlights
it’s worth knowing that in terms of the best lift measurement (lowest variance), the most optimal split is the even split of 50%-50%, and a 20%-80% split is better than a 10%-90%. We can see this with simple math. (View Highlight)
(
- Winsorizing, ie. cutting or normalizing outliers. (View Highlight)
- Measuring a metric further down the funnel. (View Highlight)