Testing: The Email Program’s Equivalent of Flossing

  |  April 2, 2014   |  Comments

The world of email is changing all the time and the inbox is an increasingly dynamic place. Like it or not, testing is the only way to take the pulse of your subscribers and gain the information you need to adjust your approach for continued engagement and ROI.

For many marketers, email testing can be considered the equivalent of flossing. When someone asks if you’re doing it, you say yes (even if you’re not). Why? You know it’s beneficial, it delivers results, and that you should be doing it. However, it takes time, it can be somewhat unpleasant, and you have to remember to do it often (preferably daily) and at a time when you just want to get everything else done so you can move onto the next thing. Everyone knows the consequences of not doing it, and yet, it’s one of the easiest regimens to ignore.

This is especially ironic because the tactics that marketers feel will have the greatest impact on their programs could all benefit from testing. For example, when MarketingSherpa asked its 2013 Benchmark Survey respondents, "What new developments will affect your email marketing program in the next 12 months?" almost every answer required some element of testing to effectively optimize it. The most popular answer, the "pervasiveness of mobile smartphones and tablets," is a great case in point. If you’re concerned that your email program may not be optimized for mobile email, a logical next step would be to gather data on the types of devices your subscribers are using to access and interact with your email. If the percentage of smartphone and tablet usage is high, then testing the impact of optimizing your email creative and landing pages for mobile viewing on response rates would be essential. Likewise, if the test results were positive, an additional strategy could be to test implementing responsive design and a mobile version of your website.

Whether or not a tactic is effective and has the ability to be a game-changer for your program’s performance is all about testing. Consider social media. This channel has been particularly tricky for marketers when it comes to attributing return on investment (ROI); however, if a large percentage of your email subscribers are active on social media, then testing the addition of social icons to your email templates, as well as promoting email sign-ups on your social pages and featuring social content in your email campaigns, could be beneficial to your program’s performance.

While it all sounds simple in theory, it can be significantly more complex in practice. What can be the most overwhelming is the combination of what to test and how to get started. This shouldn’t come as a surprise: email marketers could potentially test almost everything about their programs, from subject lines, to frequency, to time of day, to campaign images, to shapes and colors of call-to-action buttons, and so much more. This seemingly endless array of possibilities in combination with the various methods of testing, as well as getting executive buy-in to spend time and resources on testing and making program changes based on testing results, can create a state similar to analysis paralysis before the data has even been gathered. So what’s an email marketer to do?

Normally, I would proceed with a list of five to 10 tips, however in my opinion there’s only one that matters: keep it simple and consistent. What I mean by that is, don’t test everything at once. Determine what you test based on the metrics that matter most to you. For example, if you care about getting subscribers to watch a product video, a subject line test will be far less impactful than a creative test to determine what format to display the video in your email creative. Likewise, only test what you know you can optimize. If you don’t have the resources or technology to stagger your email sends to various subscriber segments, don’t test time of day or day of week.

Build support for your testing efforts by socializing results and promoting the outcome of optimization efforts based on test results. Create a schedule that allows you to test often (if not every campaign, then every week) and incorporates testing steps into standard campaign production processes. This ensures that testing becomes an engrained practice (not a temporary or ad-hoc habit) essential to the health of your email program.

The world of email is changing all the time and the inbox is an increasingly dynamic place. Like it or not, testing is the only way to take the pulse of your subscribers and gain the information you need to adjust your approach for continued engagement and ROI. If you need inspiration, I like to check out the featured tests on Which Test Won. My bet is that more often than not, you’ll guess wrong, and that’s perhaps the strongest case for why testing is critical to email marketing success.

ClickZ Live New York Want to learn more?
Attend ClickZ Live New York March 30 - April 1. With over 15 years' experience delivering industry-leading events, ClickZ Live brings together over 60 expert speakers to offer an action-packed, educationally-focused agenda covering all aspects of digital marketing. Register today!


Margaret Farmakis

As vice president of professional services at email intelligence company Return Path, Margaret Farmakis oversees teams of specialists helping global brands improve the deliverability, response, revenue, and ROI of their email marketing programs. Prior to her six years at Return Path, Margaret spent 10 years producing and managing multi-channel integrated direct marketing programs for Fortune 100 companies, focusing on the financial services and technology sectors.

COMMENTSCommenting policy

comments powered by Disqus

Get ClickZ Email newsletters delivered right to your inbox. Subscribe today!




Featured White Papers

A Buyer's Guide to Affiliate Management Software

A Buyer's Guide to Affiliate Management Software
Manage your performance marketing with the right solution. Choose a platform that will mutually empower advertisers and media partners!

Google My Business Listings Demystified

Google My Business Listings Demystified
To help brands control how they appear online, Google has developed a new offering: Google My Business Locations. This whitepaper helps marketers understand how to use this powerful new tool.


    • Website Optimizer - SEO, CRO, Analytics
      Website Optimizer - SEO, CRO, Analytics (Marcel Digital) - ChicagoMarcel Digital, an award winning interactive marketing agency established in 2003...
    • Director of Marketing
      Director of Marketing (Patron Technology) - New YorkDirector of Marketing We are seeking a Director of Marketing to manage and build our marketing...
    • Senior Interactive Producer
      Senior Interactive Producer (Ready Set Rocket) - New YorkWhat You'll Do As a member of our team, the Senior Producer reports directly to our...