One of the easiest, least expensive, and most overlooked ways to make e-mail efforts more effective is testing. This is true no matter what type of e-mail you send, no matter what your e-mail business goals. Through testing I've help clients realize:
With e-mail, small changes can make a big difference in results. But organizations looking to test and optimize e-mail face two challenges: figuring out what to test and maintaining an apples-to-apples test environment.
There are two different ways to approach testing, both valid. Which you use is determined by your circumstance and the results you're looking for.
If you want to get a read on how a single element will affect performance, change only that element for each test. If you want to improve performance and don't need to link the increase back to a single element, test multiple elements all at once.
Let's say your e-mail does very well overall; it meets or exceeds goals and industry benchmarks. You're just looking to get a little lift in your open rate. That's the time to test a single element.
But say your e-mail isn't doing so well. You're not meeting goals and are lagging way behind industry benchmarks. You may even be losing money every time you send. Then it's time for a major overhaul. Test a number of elements, all at once, to really pump up performance.
What to Test?
Once you've figured out whether you're testing a single element or a bunch, it's time to identify exactly what to change. You can test just about anything, the key is figuring out which tests will boost performance the most.
One of the easiest ways to get a boost is to test sending e-mail on different days and at different times. When I tested sending a client's e-mail newsletter at 12:30 p.m. versus 3:00 p.m., we saw a 7 percent increase in opens and a 10 percent increase in clicks from the earlier time slot. But don't just shift your sends to Mondays at 12:30 p.m. -- test it for yourself!
Proper test procedure is critical, particularly when you're doing day and time testing. Here are some tips:
I like to break the other tested elements into categories, based on which metric is most likely to move. If you're testing a single element, the key metric should have a domino effect on the actions that follow. A lift in open rates should translate into more clicks and more conversions. If you're testing multiple elements, this doesn't always hold. A lift in opens from one element may be offset by a decrease in clicks from another.
|Sender and subject lines||Open rate|
|Anything in e-mail body (product, offer, creative)||Click-to-open rate|
|Anything on landing page (product, offer, creative)||Click-to-conversion rate|
Next, I'll cover some tips for testing sender and subject lines, e-mail body content, and landing pages. In the meantime, figure out what you want to improve about your e-mail and which elements you should focus on to reach your goals.
Until next time,
Jeanne is off this week. Today's column ran earlier on ClickZ. Be sure to check out part two.
Want more e-mail marketing information? ClickZ E-Mail Reference is an archive of all our e-mail columns, organized by topic.
Jeanne Jennings is a leading authority and independent consultant with over 15 years of experience in the e-mail and online realm. She specializes in all aspects of e-mail marketing and publishing, from strategy through design and metrics analysis. Jeanne works with medium- to enterprise-sized organizations and is expert at helping her clients become more effective and more profitable online. She is the author of "The Email Marketing Kit: The Ultimate Email Marketer’s Bible" (SitePoint, 2007) and publisher of "The Jennings Report," a free e-mail newsletter for online marketing professionals. Visit her online at JeanneJennings.com.
June 20, 2013
1:00pm ET / 10:00am PT