Email Testing: Here Come the Bridesmaids

  |  April 18, 2002   |  Comments

Not testing your mailings? These case studies of email tests should be all the convincing you’ll need.

Testing should be an integral part of any email marketing campaign. You know it, I know it, and your competitors know it. If you doubt testing can improve your results, or if you aren’t sure how to go about it, today’s column is for you.

Dessy is a major retailer of bridesmaid dresses. The company was happy with its healthy Web site traffic, but return visitor traffic left something to be desired. So Dessy teamed up with Portent Interactive, a Web marketing and design company.

The first step was to revamp the Web site. Then, Dessy added a news email feature (double opt-in, of course). Visitors can sign up on the Web site for the mailings, which feature some aspect of the site or focus on special offers.

Here’s where the testing comes in. The subscriber base was split into three groups. The first two groups were relatively small, each only 10 to 15 percent of the total database. Groupings were randomly generated.

Dessy and Portent Interactive sent one version of the message to the first small group, which we’ll call Group A, then looked at the results. They sent a similar mailing to the second small group, which we’ll call Group B. Results were compared. The better-performing message went to the remaining, large group of recipients.

Test No. 1

Dessy recently promoted The ColorFinder Manhattan store, which allows Manhattan residents to buy dresses online. You can see the mailing here.

About 1,000 members in Group A received a message with the subject line: "Live in Manhattan? Buy your bridesmaid dresses online!" It received about 300 views, and 200 people clicked through to the site.

A similar message was sent to the same number of people in Group B with one change. The email itself was the same, but the subject line read: "Manhattan Residents: Buy your bridesmaid dresses online!"

Before you read on, take a guess as to which mailing performed better. No peeking below! OK, ready?

And the winner was clearly... Group A. In Group B, the mailing generated only about 150 views and 50 click-throughs to the site. Ian Lurie of Portent Interactive and I discussed the possibilities of why Group A was more responsive, but we didn’t come up with anything definitive. My hunch: I’d rather be asked a question, as in Group A’s subject line, than be told what to do, which is the feeling I got from Group B’s mailing.

When the mailing was sent to the entire database with Group A’s subject line, it generated over 500 click-throughs. Some 400 visitors explored the ColorFinder.

Test No. 2

Here’s another test Dessy conducted. The company was promoting its LookBook, a glossy publication featuring current styles and includes a complete set of swatch cards and other tools. Portent assembled an HTML mailing that included a photo.

In early January, the mailing went out to about 800 people. The graphic was relatively small, the idea being users don’t want to wait for large graphics to download. It generated about 270 opens. Fewer than 50 recipients were intrigued enough to click through to the site.

A week later, a similar mailing was sent to another 800 people. The notable difference was a larger graphic. Guess what? The bigger image seemed to be the key. About 300 people opened the message. About 100 recipients clicked through to the site -- more than double the number of the first mailing’s recipients!

Not surprisingly, Dessy sent the second mailing to the entire database, slightly less than 10,000 recipients. About 2,800 opened the mailing, just under 1,000 clicked through, and sales jumped. Before the mailing, sales averaged between two to four units per day. Afterward, Dessy sold 10 to 20 per day.

These are only a couple of the tests Dessy and Portent Interactive have conducted. They continue to test each mailing. You’ll likely come up with tests of your own. If you want to share your results, please email me.

ClickZ Live Chicago Join the Industry's Leading eCommerce & Direct Marketing Experts in Chicago
ClickZ Live Chicago (Nov 3-6) will deliver over 50 sessions across 4 days and 10 individual tracks, including Data-Driven Marketing, Social, Mobile, Display, Search and Email. Check out the full agenda and register by Friday, August 29 to take advantage of Super Saver Rates!


Heidi Anderson

Heidi is a freelance writer who covers the Internet for both consumers and businesses. She's a former editor of the E-mail Publishing Resource Center and coauthor of "Sometimes the Messenger Should Be Shot: Building a Spam-Free E-mail Marketing Program." Her work also appears in Smart Computing, PC Novice, What's Working Online, and Editor & Publisher.

COMMENTSCommenting policy

comments powered by Disqus

Get ClickZ Email newsletters delivered right to your inbox. Subscribe today!



Featured White Papers

BigDoor: The Marketers Guide to Customer Loyalty

The Marketer's Guide to Customer Loyalty
Customer loyalty is imperative to success, but fostering and maintaining loyalty takes a lot of work. This guide is here to help marketers build, execute, and maintain a successful loyalty initiative.

Marin Software: The Multiplier Effect of Integrating Search & Social Advertising

The Multiplier Effect of Integrating Search & Social Advertising
Latest research reveals 68% higher revenue per conversion for marketers who integrate their search & social advertising. In addition to the research results, this whitepaper also outlines 5 strategies and 15 tactics you can use to better integrate your search and social campaigns.


    • Sales Planner
      Sales Planner (Verve ) - New YorkAbout Verve   Verve is the leader in location powered mobile advertising. We manage one of the largest mobile...
    • Systems Analyst/Support
      Systems Analyst/Support (Agora Inc. ) - BaltimoreIRIS (Increased Revenue Intuitive Software ) is proprietary software that helps marketers...
    • Client Services Support Specialist
      Client Services Support Specialist (Agora Inc. ) - Delray Beach OVERVIEW:  This position requires a highly motivated and resourceful individual...