Posted in A/B Split Testing on January 30th, 2013
When it comes to getting your message heard, optimizing your email marketing efforts to improve conversions is of paramount importance.
Below, I’m going to discuss a simple tactic that I’ve recently used across 3 separate industries to improve click-through rates by as much as 17%.
(Yes, you read that correctly)
It’s founded on a simple psychological principle put forward by a professor at Columbia Business School, and it deals with the human mind’s inability to make decisions when we have too many choices, causing us to have action paralysis.
Let’s dig in!
When Choice is Demotivating
Before I get into my specific results, I wanted to discuss what’s happening behind the scenes with these improvements.
Sheena Iyengar is a professor and psychological researcher at the Columbia Business School and the author of The Art of Choosing. In her most famous study called When choice is demotivating, Sheena conducted her famous “jam test” at an upscale supermarket.
In this study, Sheena compared customer interaction and actual purchases between two different types of jam displays:
- The first display featured 24 flavors of jam
- The second display featured only 6 flavors of jam
While the 24 jam display had a significantly higher “interaction” rate (more customers taking samples), it only had around 3% of customers actually making a purchase.
This is in start contrast to the 6 jam display, which had over 30% of people make a purchase!
The conclusion she drew from this research is that too many options can cause people to choose nothing instead, and that a plethora choices can actually be demotivating for customers rather than empowering.
What This Has to do With Email Marketing
I mention this study and it’s conclusions because they apply directly to how I’ve improved click-through rates for 3 separate newsletters that I work with.
My first test began a newsletter for a music site called Sophistefunk, where I was getting decent rates but nothing to get excited about:
(Screenshot from AWeber, total list size is low 5-figures)
At the time, I was using a “blog broadcast” that sent out new posts in a clump of 5-6.
It was minimally styled and updated via my RSS, you can check out a screenshot of one such broadcast below:
I thought this would be ideal for my subscribers, but I made the same fundamental error revealed in Sheena Iyengar’s study: I assumed more content would create more engagement.
Another newsletter of mine called Sparring Mind didn’t have these problems, and I surmised that this was because I only sent out emails with one action to take.
To overcome this, I tested sending out emails with only one call-to-action for my Sophistefunk newsletter, and I saw click-through rates increase dramatically, along with overall engagement!
Here are the results of the two latest broadcasts following this format:
(AWeber screen shot is below)
As you can see, click-through rates increased dramatically, and with that came better open rates and my subscribers got used to the new mailing style. It wasn’t overnight, but I’ve seen far better engagement with my list now that I only send one thing at a time.
Subscribers aren’t so willing to pass over an email if they know there will be only one action to take. They trust you to not send them too much, whereas when you send huge newsletter feeds, they will ignore it, even if they are just slightly busy (and who isn’t these days?).
It’s been discussed (many times before) how distractions can hurt conversions when it comes to web design, but from my testing, this appears to apply to many email newsletters as well: while fully featured emails (like Amazon’s) may work for some businesses, many content-centric newsletters can benefit from eliminating distractions.
Stylized vs. Plain Template
I mentioned above, I had also changed my stylized HTML emails into plain text emails, so you might be wondering if that was a confound to my results.
It turns out that HTML styling likely has a far less overall impact on click-through rates than you may think, as we recently adjusted our email newsletter at Help Scout to include only a single blog post at a time, rather than the three that we used to send.
Here is what our old newsletter looked like:
As mentioned, it included 3 different pieces of content, and although it was well designed and had some enticing article headlines, it wasn’t performing as well as it could from a content engagement standpoint (it still maintained a strong open rate).
In our most recent change, we simplified our content newsletter and cut out the other two pieces of content, including only the newest blog post:
Despite the fact that they were still both stylized, we saw nearly a double-digit percentage increase in click-through rates, and you can see below what an impact it had on our traffic from our email marketing efforts:
(Screenshot was from the first week in January, looks like it will be our best month yet when it’s all said and done).
This effect has managed to stay consistent over time. We haven’t had a significant drop in click-throughs for any recent newsletter, and we’re still maintaining the high open rates that we gained once we switched to this “single-serve” variety.
All in all, it was a pretty big change but resulted in huge improvements for all the newsletters I manage.
I will still keep on testing in the future, but I definitely advise any marketer who manages their startups newsletter to try this streamlined form and see if they get similar results.
Do you have any other interesting newsletter tests that you’ve run?
Share them with us in the comments!
Stay up to date
- @mattdanna What problem are you facing? #
- @mattdanna Throttle meaning limit them in some manner? Nope, only the test visitors are limited to 1000. #
- @alexdesigns Alex, yup, it's new (and thanks!). If you see something you don't like, let us know. We're still working on it. #
- @kodecreative The problem you're facing with Visual Website Optimizer. In case you didn't know, we're the people behind VWO :) #
- @davidshawblog Did you try firing off 2 different custom conversion goals from them? That should do the trick. #
Write for this blog!
We accept high quality articles related to A/B testing and online marketing. Send your proposals to firstname.lastname@example.org