Home  › Email › Email Marketing

15 Types of Email Marketing Tests You Should Be Doing

  |  August 5, 2013   |  Comments

How email marketers can go beyond just testing subject lines and look at other elements that might improve response.

I was recently asked to develop a "testing protocol" for a client. The deliverable was a worksheet that would document tests for a particular send, but they wanted it to do more than just that. They wanted it to educate on the value of testing and spur these groups within their organization to truly leverage testing to their advantage.

Not a simple task.

One of my observations, both with this client (who I've been working with for more than two years) and with other clients, is the focus on subject line testing. My personal goal, with this project and in general, is to get email marketers to go beyond just testing subject lines and look at other elements that might improve response.

There are a lot of "100+ things to test in email" lists out there. But these leave me a bit flat. Many of the items they list are specific to an industry or type of email, and many aren't things that will normally drive large increases in response.

So here's my much-less-impressive sounding list of 15 types of email tests you can do, along with some narration on my personal favorites and least favorites. The list is roughly organized from what generally provides the most to least value in terms of increased performance for the long term.

  1. Lists
  2. Landing page elements (which could spur another list of 15 or more)
  3. Completely new creative (multiple elements)
  4. Preview pane view
  5. Customization (targeted content)
  6. Offer/offer copy/placement
  7. Call-to-action copy/placement
  8. General wireframe/layout
  9. General copy
  10. Personalization (data merge)
  11. Subject line
  12. From line
  13. Design (fonts/colors/images)
  14. Time of the send
  15. Day of the send

List testing tops my list of 15, because if you aren't reaching the right audience it doesn't really matter what content the email carries. This is a broad category - you can test to indentify segments of your house list, which are more and less responsive to certain offers, and use this knowledge to boost your revenue per email sent by targeting offers. See my recent case study on this.

You can also mail to third-party rental lists to not only boost your immediate performance but also grow your own house list with qualified names via opt-in. Infusing your house list with qualified names on an ongoing basis is a key to success in email. According to MarketingSherpa's 2013 Email Marketing Benchmark Survey, only 17 percent of marketers have email lists that are growing rapidly. Another 50 percent say their lists are growing slowly, and a third of respondents are seeing neutral to negative growth.

Landing page elements, which you can see could have a list of 15 or more elements of its own, is my second favorite thing to test. Email conversions tend to happen on landing pages, microsites, and web-based conversion funnels. It's important to keep readers engaged and moving toward the end goal of your email once they click through. Even a small boost in performance here, getting 5 percent or fewer of visitors to convert, can have a large impact on your bottom line. The results of many landing page tests you do can also be applied for future campaigns, in both email and other channels, producing true long-term value for the money spent.

Now on to some of the items at the bottom of my list.

I'm not a big fan of day and time send tests, nor do I pay much attention to those reports released periodically that tell you the best day and time to send email. I've found common sense to be the best guide here. For B2B email, I shoot to have it arrive during the business day based on the time zone of the recipients. For B2C email, I set send day and time based on the audience and when I imagine they'll have a few minutes to read it, which is typically late afternoon/evening or weekend days. I've done day and time testing for clients, but assuming they are starting with a "common sense" control time for their audience, I haven't seen huge, sustainable lifts.

The same is true for design, which I consider fonts, colors, and images. This is not to be confused with wireframes/layouts, which I have much higher on the list. I love good email design; but I have also found that as long as common sense is your guide, the fonts, colors, and specific images used don't tend to have a large impact on response. For me, common sense design is about using readable fonts and colors and images that compel readers to the action you want them to take. Testing magenta instead of maroon as the accent color on the email isn't something that typically provides you a large lift.

A challenge to readers: when you plan your next email test, start from the top (not the bottom) of my list of 15 and choose a type of test that you've never done before. Then build the test, see how it does, and let me know!

Until next time,


Image on home page via Shutterstock.

This column was originally published on April 1, 2013.


ClickZ Live Chicago Join the Industry's Leading eCommerce & Direct Marketing Experts in Chicago
ClickZ Live Chicago (Nov 3-6) will deliver over 50 sessions across 4 days and 10 individual tracks, including Data-Driven Marketing, Social, Mobile, Display, Search and Email. Check out the full agenda and register by Friday, Sept 5 to take advantage of Super Saver Rates!


Jeanne Jennings

Jeanne Jennings is a 20 year veteran of the online/email marketing industry, having started her career with CompuServe in the late 1980s. As Vice President of Global Strategic Services for Alchemy Worx, Jennings helps organizations become more effective and more profitable online. Previously Jennings ran her own email marketing consultancy with a focus on strategy; clients included AARP, Hasbro, Scholastic, Verizon and Weight Watchers International. Want to learn more? Check out her blog.

COMMENTSCommenting policy

comments powered by Disqus

Get ClickZ Email newsletters delivered right to your inbox. Subscribe today!



Featured White Papers

IBM: Social Analytics - The Science Behind Social Media Marketing

IBM Social Analytics: The Science Behind Social Media Marketing
80% of internet users say they prefer to connect with brands via Facebook. 65% of social media users say they use it to learn more about brands, products and services. Learn about how to find more about customers' attitudes, preferences and buying habits from what they say on social media channels.

Marin Software: The Multiplier Effect of Integrating Search & Social Advertising

The Multiplier Effect of Integrating Search & Social Advertising
Latest research reveals 68% higher revenue per conversion for marketers who integrate their search & social advertising. In addition to the research results, this whitepaper also outlines 5 strategies and 15 tactics you can use to better integrate your search and social campaigns.



    • Digital Marketing Analyst
      Digital Marketing Analyst (GovLoop) - Washington D.C.Are you passionate about audience acquisition? Love effective copy and amazingly effective...
    • Product Specialist
      Product Specialist (Agora Inc. ) - BaltimoreDescription: The Product Specialist is hyper-focused on the customer experience and ensures that our...
    • Partnerships Senior Coordinator
      Partnerships Senior Coordinator (Zappos.com, Inc.) - Las VegasZappos IP, Inc. is looking for a Partnerships Senior Coordinator! Why join us? Our...