and so should you...
Graphical visualization of dense information is perhaps the most important component for metrics-heavy apps such as Visual Website Optimizer. Accordingly, intuitive display of A/B test results is a priority for us. In the same spirit, we’re happy to introduced new test result charts. Take a look at the screenshot below and bask in awesomeness:
On the left Y-axis you can see conversion rates for control and different variations. The red series represents average conversion rate. On the right Y-axis you can see total visitors in the test and total conversions. Also, as you can see, hovering on points pops up a box summarizing that day’s performance of the variation. What is not obvious in the screenshot is that by clicking on series legends, you can switch them on and off. Plus, hovering on series legend highlights the respective series and dims all other series. How cool?
These shiny new charts are powered by an open-source library called Flot. This library is absolutely fantastic and very, very powerful. In fact, it is so powerful that we were able to implement new charts in a single day. Special thanks to @NilsFredrik of Maksimer for giving inputs for the new charts and for insisting that we should use Flot for this purpose. We owe new charts to you, Nils-Fredrik 
Do give new charts a spin and let me know your feedback. If you have any ideas on how we can improve visualization of A/B or multivariate test results, I will be very happy to hear them out. Simply leave a comment on this post and let us start a conversation.
So, do you like new charts?
Related posts:
RSS feed for comments on this post. TrackBack URL
Subscribe blog via RSS
Must say we love your new shiny charts. In your example shown you mention about A/V testing of headline titles, have you found headline titles that include a compelling Call To Action (CTA) increases conversion rates dramatically or do you find images are more effective? Great post by the way keep up the good work.
Comment by Keywords Consultants — March 25, 2010 @ 6:06 pm
[...] How to visualize A/B test results? Shiny new charts to the rescue « I love split testing – Visual… Graphical visualization of dense information is perhaps the most important component for metrics-heavy apps such as Visual Website Optimizer. (tags: a/b testing visualization analytics) [...]
Pingback by links for 2010-03-26 « Köszönjük, Emese! — March 26, 2010 @ 4:35 pm
[...] Website Optimizer has nice looking day-wise charts in the test reports which show conversion rate for variations for different days (during the time [...]
Pingback by New reporting features: test summary and cumulative charts « I love split testing – Visual Website Optimizer Blog — August 5, 2010 @ 5:57 pm