Posted in News on September 1st, 2010
UPDATE: The results of this A/B test and the winner of the contest have been announced! Congrats to Subhash Surampudi for winning the contest!
In the past we have published numerous A/B testing case studies which showed how even little changes could lead to dramatic improvements in sales, downloads, and and conversions. Today, we have a fresh case study where the user was able to achieve a whopping 400% increase in conversions. Yes, read that once again: a mind-boggling 400% increase in conversions (and that too statistically significant) with just a single change. We decided that from now onwards before publishing the full case study on the blog, we will run a teaser contest.
Challenge: Guess which version is the actual winner in this A/B test.
Prize: Out of all the correct entries, one lucky person will win a full year of $249/month Visual Website Optimizer subscription!! Twelve months of our Large Agency plan is total worth $3000 (12*249).
How to enter?: Simply leave a comment on blog and/or tweet about which variation you think increased conversions by 400%. If you tweet, either use the tweet boxes belows or make sure you cc @wingify so that we can track your entry.
When will be the winner chosen?: on September 8th, along with the actual case study, we will announce the winner of this contest.
About this A/B test case study: one variation had a Security badge in the sidebar and in the other there was no such badge. One of the variations saw an increase of 400% in conversion rate (click on coupon code).
So, which version increased conversions by 400%?
– Version A: with Security badge in sidebar –
– Version B: without Secure badge in sidebar –
Remember, the prize for this contest is a full year of $249/mo Visual Website Optimizer subscription total worth $3000! So, enter take part into contest now either by tweeting your choice above or leaving a comment below. (Bonus: if you do both, your entry will be counted twice.)
Stay up to date
Latest Posts
Latest Tweets
- RT @unbounce: RT @OliGardner Do long-form sales letters still work? Even for “Professional” businesses and startups? http://t.co/IbjWzW8 ... #
- RT @JeremyReeves: Do long-form sales letters still work? http://t.co/8xo95ei7 via @wingify #
- @juhotunkelo Not yet, but we're working on it. #
- Do long-form sales letters still work? Even for “Professional” businesses and startups? http://t.co/cKI4PdRr #
- 12 Ways to Increase Online Sales http://t.co/X6m2yk8k #


28 Comments
September 1, 2010
My guess would be version A: WITH the security-badge.
If, and when, it’s announced as the winner, I would try with a more official looking badge, as compared to this cartoon-ish one
September 1, 2010
The one without the “Secure” badge gets more conversions. That “Secure” badge looks too generic and fake. It probably raises more red flags about it possibly not being secure.
September 1, 2010
My Bet is Version B
September 1, 2010
Version B
September 1, 2010
I’ll go with version B. The security shield takes the attention away from the call-to-action button.
September 1, 2010
Version A – With the security badge
People see the credit card logos and then instantly question the security of the website as to whether they should give you their credit card details. They then associate the security badge with the credit card logo and assume the website is safe to use.
September 1, 2010
Version B
September 1, 2010
B, without the badge. A single, clear call to action that is the Coupon button. No distraction of the other big colorful thing in A.
September 1, 2010
BTW, if you go look at the site, the Secure badge is on the home page but not the Coupon page. Doubt they’d keep a losing design up.
September 1, 2010
Version B FTW!
September 1, 2010
My bet is on version A: with the security badge.
We’ve just run a few test ourselves and 3 out of 4 badges boosted our conversions. I’d guess version A increased conversions by 15%.
September 1, 2010
Usually it would be the one with the secure badge, but this one doesn’t look from a reputable firm.. Even still, I’ll go with version A.
September 2, 2010
I guess version B with no security badge increased conversions by 400%. Just a gut feeling.
September 2, 2010
@Jim Jarrett
The tests are still running as both versions still appear!
September 2, 2010
I’d go with Version B. It has a clear single point of attention.
My suggestion for these teasers going forward, mention the objective for the test as well.
In this particular case, all of us are making an assumption.
Incidentally, shouldn’t you also include some information on how the traffic is being driven to the test page? If not in the teaser at least in the case study.
If I am driving traffic to the page being tested from a targeted (to the test objective) ad vs. from the home page (a more generic source), the results might be different.
Subhash
September 2, 2010
@Subhash: great point. I think you may have missed but the objective of the test was to increase clicks on ‘Coupon Code’. Yes, source of traffic is important and we will definitely include that in future case studies and teasers. Targeted v/s causal traffic will respond to the same test differently; in this case it was more or less casual traffic.
September 2, 2010
My vote is B.
Not only is the badge large and distracting, but it actually can put fear in the users mind. Here is a customer’s potential thoughts: It’s just a coupon, so why should it need to be secure?
September 3, 2010
I would be shocked if it wouldn’t be A. Customers always love secure purchase forms!
September 3, 2010
VERSION B
A single clear call to action, without taking away the required attention.
The secure code looks “fake” and could get the visitor click the back button.
Pramodh
@pramodh
September 3, 2010
Version A
As a more or less casual visitor, I am concerned about the web pages that I visit. And if there are aspects of “trust” visible, it allows us to go further.
Vaishali Hukkeri
September 3, 2010
Version B – the badge graphic takes the focus off of the call to action.
September 3, 2010
I say . . . VERSION B
I am thinking the overall copy needs some work and wonder if the +400% is in the neighborhood of less than 20 total redeemed.
“Get $12.5 Cash Back Discount On Ambren” just deesn’t read or sound right, e.g. – wouldn’t it be $12.50 (with the zero).
So I think the clip-art looking badge just adds to the overall sense of risk around the whole offer.
Although, as I have said before, “What matters is what performs best . . . not personal preference.”
September 4, 2010
Version A
September 4, 2010
Version B. It makes coupon code button in focus.
September 4, 2010
Version A
September 5, 2010
My bet: a security badge version.
September 5, 2010
I’m thinking A – with the badge
September 8, 2010
@All who participated: The results of this A/B test and the winner of the contest have been announced! Congrats to Subhash Surampudi for winning the contest!
Here is the post: http://visualwebsiteoptimizer.com/split-testing-blog/surprise-surprise-having-no-secure-icon-on-a-page-increased-conversions-by-400/
Leave a comment
RSS feed for comments on this post. TrackBack URL