Resolve to Test in 2005

  |  November 30, 2004   |  Comments

Two holiday gifts to help you with that resolution.

Today I'm offering you two holiday gifts. First is a rundown of some thought-provoking marketing tests. You can benefit from the tests without having to conduct (and pay for) them. Second is a free statistical calculator to help you analyze the tests I hope you conduct in the coming year.

What Is a Picture Really Worth?

Craig Garber is a direct-response copywriter and direct-marketing consultant. He conducted a simple test on his Web site. The test boosted his already strong sign-up rate by another 5.35 percent.

The site's entrance is a "name squeeze" page, designed to get visitors to sign up for Garber's free "Tip Of The Week." People usually come to the site because they either read something he wrote and liked it or were referred by a friend or colleague.

In a side-by-side comparison, when Garber added his picture to the front page, his sign-up response went from 45.65 percent to an even 51 percent.

"When your prospects can 'see' you're a real person, they make a connection with you that increases their trust and belief in who you are and what you're offering," said Garber. "Especially online, where most people don't even give you contact information, let alone a personal glimpse into [their lives]."

As a copywriter, Garber's a firm believer in testing. He almost always has several tests going at the same time.

Should You Test Something New?

A major online banking concern begrudgingly agreed to conduct a test. It had a working marketing process that brought in new account applicants for about $35 per acquisition. The company was talked into testing a few new potential lists and sources for its email acquisition campaigns.

Much to its surprise, some of the tested lists had costs-per-acquisition of less than $20. This is a huge improvement. Sometimes you don't know until you test.

Creative Doesn't Always Create

Test results aren't always what you expect to see.

One company with a very expensive big-ticket product conducted a customer acquisition test using two different creative approaches. One approach was a standard mail piece that cost about $1 per piece to create and mail. The other was a much fancier piece of creative and was sent via FedEx. It cost about $12 a piece. Test results showed the additional expense didn't result in any response rate increase.

Is that surprising to you?

No, We Don't Need the $5 Million

My all-time favorite test result came from a direct mail campaign's data analysis. The test was conducted by a major long distance telecommunications company. Now, I've worked on projects for quite a few telecommunications companies, but this result amazed me more than any other I've seen.

The company tested two versions of a mail piece, with only one difference. The fine print of one version mentioned the company would cover the local phone company's costs for switching to the long distance company. The other version didn't mention the fee.

Results showed clearly that covering the fee did nothing to increase response rate. The implication was the company could save about $5 million in the coming year by taking the switching fee out of the current offer. Astoundingly, the campaign managers did not make the change that would save the company money. Why? The money didn't come out of their budget.

Ready to Test? Get This Tool

All marketers, especially online marketers, can and should conduct tests. Simple tests are easy to design, conduct, and analyze. You can determine whether the results are statistically significant with basic statistical analysis. My second gift to you, a free statistical significance calculator tool (scroll down a bit on the page), can help you with this analysis.

Soon we'll be making resolutions for next year. I hope your business resolutions will include a commitment to conduct more tests to improve your business.

ClickZ Live Chicago Join the Industry's Leading eCommerce & Direct Marketing Experts in Chicago
ClickZ Live Chicago (Nov 3-6) will deliver over 50 sessions across 4 days and 10 individual tracks, including Data-Driven Marketing, Social, Mobile, Display, Search and Email. Check out the full agenda and register by Friday, Oct 3 to take advantage of Early Bird Rates!


Brian Teasley Brian Teasley is the leader of Teasley, a consultancy that helpsadvertisers, marketers and advertising agencies use data and analysis toimprove their marketing campaigns. Brian has over 14 years experience inengineering and marketing, and has worked for numerous Fortune 100companies. Brian also teaches a marketing course at New York University. Heholds a M.S. degree in Applied Statistics from Iowa State University and aBA in Mathematics and a BA in Mathematics and Statistics from St. OlafCollege.

COMMENTSCommenting policy

comments powered by Disqus

Get the ClickZ Analytics newsletter delivered to you. Subscribe today!



Featured White Papers

IBM: Social Analytics - The Science Behind Social Media Marketing

IBM Social Analytics: The Science Behind Social Media Marketing
80% of internet users say they prefer to connect with brands via Facebook. 65% of social media users say they use it to learn more about brands, products and services. Learn about how to find more about customers' attitudes, preferences and buying habits from what they say on social media channels.

An Introduction to Marketing Attribution: Selecting the Right Model for Search, Display & Social Advertising

An Introduction to Marketing Attribution: Selecting the Right Model for Search, Display & Social Advertising
If you're considering implementing a marketing attribution model to measure and optimize your programs, this paper is a great introduction. It also includes real-life tips from marketers who have successfully implemented attribution in their organizations.



    • Senior Paid Search & Advertising Manager
      Senior Paid Search & Advertising Manager (Smarty Had A Party) - St. LouisCompany Description: A warm, loving, [slightly wacky] startup, we view...
    • Technical Project Manager
      Technical Project Manager (Agora Inc.) - BaltimorePublishing Services, a subsidiary of Agora Publishing in Baltimore, MD is looking for a great...
    • Financial Research Associate
      Financial Research Associate (Confidential) - BaltimoreThe Financial Research Associate will be responsible for responding to research-level customer...