Posted in A/B Split Testing, Multivariate Testing on November 2nd, 2010
Last week I offered free conversion rate optimization advice on a popular forum (known as Hacker News). Within a single day I got 50+ requests for help. It was definitely an enriching experience analyzing and dissecting all those websites and landing pages. As I was replying and providing my feedback to those 50+ sites, I started sensing a few common issues that affected conversion rates of all those pages. Without naming any specific URL or [...]
Posted in A/B Split Testing, Multivariate Testing on October 7th, 2010
Update: there is even an official confirmation from Google’s Matt Cutts that split testing does not impact search rankings. A lot of our potential customers are concerned whether A/B or multivariate testing will have an effect on their search engine rankings. They (obviously) aren’t looking to improve their rankings by using A/B testing, rather their concerns relate to the myth that testing may negatively impact search engine optimization efforts. Broadly, there mainly two major concerns: [...]
Posted in A/B Split Testing, Multivariate Testing on September 20th, 2010
I recently got interviewed on Unbounce blog as a conversion hero. In the interview, I shared few rules-of-thumb related to A/B and multivariate testing which you may find helpful. I developed these heuristics while observing and advising hundreds of tests created by Visual Website Optimizer users. So, in this post I will paraphrase and expand on some of the things I shared in the interview. A/B or Multivariate, which test methodology to choose? Three main [...]
Posted in A/B Split Testing, Multivariate Testing on August 11th, 2010
Most A/B testing solutions, including Visual Website Optimizer, fall into a category known as client-side testing. What “client-side” means is that a variation of your test page is created (before displaying to the visitor) by doing manipulations on the browser using clever JavaScript. Your web server always sends the same default version of the page as it would normally do. Since the changes needed to display a variation happen on visitor browser (and not your [...]
Posted in A/B Split Testing, Multivariate Testing on June 28th, 2010
We recently revamped the introductory video for Visual Website Optimizer by adding a voice-over and updating it by including some new features (e.g. heatmaps). From start (entering the test page URL) to end (interpreting test results), all it takes to run your first A/B test is just 2 minutes. And you thought testing is a dark art? ;) Watch the video below: Do you think video can be improved? Please leave a comment to let [...]
Posted in Multivariate Testing, News on June 2nd, 2010
Do you know where visitors are clicking on your website homepage? Do you know which parts of your website are hotspots that attract visitor attention? You can, of course, fire up your web analytics tool and tell me that 20% visitors go to sign up page after visiting homepage but that information doesn’t tell you the whole story. First, some stats about Visual Website Optimizer homepage: 30% of visitors who come to homepage visit the [...]
Posted in A/B Split Testing, Multivariate Testing on May 11th, 2010
There are tons of A/B testing articles on the Internet. In fact, Visual Website Optimizer blog is full of them. But let’s admit it, all those guides, tips, tricks ultimately start sounding similar to each other. I decided to write a post on tips that do not have a straightforward logic and are not popularly discussed on the Internet. In fact, people usually do the opposite of what I am going to discuss in this [...]
Posted in A/B Split Testing, Multivariate Testing on April 28th, 2010
It is a myth that A/B testing can only be used for optimization and you need to fully establish a process optimizing it. In other words, many people think that A/B testing is best meant for big guys who already have an established conversion funnel, and now want to squeeze an extra 0.01% out of it. As a natural consequence to this logic, it may appear that A/B testing cannot be used at initial stages [...]
Posted in A/B Split Testing, Case Studies, Multivariate Testing on April 1st, 2010
RIPT Apparel is a Chicago-based online retailer of one-of-a-kind designer tees and wearable art. They sell one new design by a new artist every day starting at midnight CST for $10 and it is only available for a period of 24 hours. After that period, the design rests in peace forever in the T-shirt graveyard and a new one takes over its place. The sense of urgency created by limited availability of the design can [...]
Posted in A/B Split Testing, Multivariate Testing on March 23rd, 2010
Graphical visualization of dense information is perhaps the most important component for metrics-heavy apps such as Visual Website Optimizer. Accordingly, intuitive display of A/B test results is a priority for us. In the same spirit, we’re happy to introduced new test result charts. Take a look at the screenshot below and bask in awesomeness: On the left Y-axis you can see conversion rates for control and different variations. The red series represents average conversion rate. [...]
I ♥ Split Testing Blog
Stay up to date
Recent Posts
Write for this blog!
We accept high quality articles related to A/B testing and online marketing. Send your proposals to contribute@wingify.com


