The Next Generation of Visual Website Optimizer is launching on 29th April 2014 See What's Coming

What you really need to know about mathematics of A/B split testing

Posted in A/B Split Testing on January 26th, 2010

Recently, I  published an A/B split testing case study where an eCommerce store reduced bounce rate by 20%. Some of the blog readers were worried about statistical significance of the results. Their main concern was that a value of 125-150 visitors per variation is not enough to produce reliable results. This concern is a typical by-product of having superficial knowledge of statistics which powers A/B (and multivariate) testing. I’m writing this post to provide an [...]

48 Comments »

How reliable are your split test results?

Posted in A/B Split Testing on January 1st, 2010

Visual Website Optimizer Reports

With split testing, there is always a fear at back of the mind that the results you observe are not real. This fear becomes especially prominent when you see an underdog variation beating your favorite variation by a huge margin. You may start justifying that the results may be due to chance or you have too less data. So, how do you really make sure that the test results are reliable and can be trusted? [...]

4 Comments »

I ♥ Split Testing Blog


Stay up to date

Recent Posts

Write for this blog!

We accept high quality articles related to A/B testing and online marketing. Send your proposals to contribute@wingify.com