Testing is the single most important skill you'll develop as an agile marketer, and the act of setting up a simple test requires you to increase your proficiency in a number of areas.
In A Day in the Life of an Agile Marketer, we presented to you a vision of the perfect agile marketer, Melanie, as she went through her day.
This perfect world vision may have made you a little sick. Who really works in a marketing environment like that?
You don't have to become this kind of über agile marketer overnight. You can "plug in" at any of several places. Testing is one place that touches on many of the agile marketer's practices including measurement, content development, and goal setting. I asked Rose Holston of Aviso Communications to answer some of the main questions marketers have when starting down the path toward implementing an agile online testing program.
Testing is the single most important skill you'll develop as an agile marketer.
Testing is not hard. Becoming a testing organization is. The act of setting up a simple test requires you to increase your proficiency in a number of areas; proficiencies that are crucial for progressive, data-driven marketing. For example, managing the IT department is an important proficiency.
To be successful, you need a plan. To execute that plan, every decision should be backed up with quantitative results that help evolve the plan. The more specific you get about the outcome you are trying to affect, the more you will learn from testing. There are three basic questions to be addressed.
Why Will I Test?
A picture is worth a thousand words.
In order to understand the power of testing, start with a picture or baseline of what is happening today. Take a snapshot of the past 30 days.
Where are visitors coming from?
When are they visiting more often?
Did they leave right away or did they visit multiple pages?
Did they take the actions I expected?
There are several easy-to-use tools and services that are useful in delivering answers.
What Do I Test?
Think about outcomes.
Once you have a baseline, or that first picture, you can make assumptions about what to change and which enhancements can be made on your website pages.
Think in terms of numbers. Analytics provide some high-level statistics that give us clues to areas that need improvement.
A bounce rate determines if a visitor leaves after viewing only one page on your site. Pages with high bounce rates may be chasing visitors away.
Like the bounce rate, the exit percentage tells us which pages visitors tend to leave from. Although visitors may be leaving a particular page in large numbers, be careful in making quick assumptions. Visitors may be getting what they were looking for.
A "conversion" is the completion of an action you want a visitor to take. This could be a downloading a paper, submitting a form, buying, etc.
How Do I Test It?
Execute the plan over and over again.
A test plan organizes your day much like a marketing plan or editorial calendar. Test planning evolves as you learn more about the behaviors of your target audience and bump up against your own resource and budget constraints. Keep in mind that test plans are an excellent tool for reporting results to the C-suite. Testing just may get you more resources and budget.
A test plan has five major components.
The "what" and "why" questions are answered by how you think the outcome may be affected.
Define the details of the test. Include images of the creative in this section.
Use of a control and treatment doesn't imply a split testing strategy, in which traffic is sent equally to two different pages. You can also do serial testing, in which you post changes one after the other, measuring the increase or decrease in performance after each. Serial testing doesn't require split testing software, though it still requires the discipline to review results and roll back to a previous version if changes reduce results.
Decide which metrics you'll use to determine if your hypothesis is true. This is your baseline picture.
Estimating how long to run a test depends on your current traffic and the number of conversions you generate. You must reach a point of statistical significance. Once you have defined a timeframe to run the test, you will record your results against the measurement plan. The test has now taken shape.
Your measurement plan and results are the picture that becomes a story that you can now put into words. At this stage, we speculate on "why" visitors reacted in the way they did.
This process documents a complete "Kaizen" exercise. Kaizen means "good change." Your goal is to define potential "good changes" that will instruct the next series of tests. On paper, your story reads like a novel, each test becomes a chapter in the book. Your expectations should be open as the purpose of your hypothesis is to prove or disprove what you think will happen.
Note: An agile marketer will always expect the unexpected.
All great efforts run into resistance. Let us know in the comments if you've tried to implement tests and what barriers you've come up against.
Join the Industry's Leading eCommerce & Direct Marketing Experts in Chicago
ClickZ Live Chicago (Nov 3-6) will deliver over 50 sessions across 4 days and 10 individual tracks, including Data-Driven Marketing, Social, Mobile, Display, Search and Email. Check out the full agenda and register by Friday, August 29 to take advantage of Super Saver Rates!
With 15 years of online marketing experience, Brian has designed the digital strategy and marketing infrastructure for a number of businesses, including his own technology consulting company, Conversion Sciences. He built his company to transform the Internet from a giant digital-brochure stand to a place where people find the answers they seek. His clients use online strategies to engage their visitors and grow their businesses. Brian has created a series of Web strategy workshops and authors the Conversion Scientist blog. Brian works from Austin, Texas, a place where life and the Internet are hopelessly intertwined.
The Marketer's Guide to Customer Loyalty
Customer loyalty is imperative to success, but fostering and maintaining loyalty takes a lot of work. This guide is here to help marketers build, execute, and maintain a successful loyalty initiative.
The Multiplier Effect of Integrating Search & Social Advertising
Latest research reveals 68% higher revenue per conversion for marketers who integrate their search & social advertising. In addition to the research results, this whitepaper also outlines 5 strategies and 15 tactics you can use to better integrate your search and social campaigns.
August 21, 2014
September 23, 2014