by Annemarie KlaassenOctober 8, 2016 The traditional (and most used) approach to analyzing A/B tests is to use a so-called t-test, which is a method used in frequentist statistics. While this method is scientifically valid, it has a major drawback: if you only implement significant results, you will leave a lot of money on the … Continue reading How to Make More Money With Bayesian A/B Test Evaluation
Tag Archives: Bayesian
Bayesian vs Frequentist A/B Testing – What’s the Difference?
Alex BirkettAugust 23, 2015 There’s a philosophical statistics debate in the optimization in the world: Bayesian vs Frequentist. This is not a new debate; Thomas Bayes wrote “An Essay towards solving a Problem in the Doctrine of Chances” in 1763, and it’s been an academic argument ever since. Recently, the issue has become relevant in … Continue reading Bayesian vs Frequentist A/B Testing – What’s the Difference?