Testing is the single most important skill you'll develop as an agile marketer, and the act of setting up a simple test requires you to increase your proficiency in a number of areas.
In A Day in the Life of an Agile Marketer, we presented to you a vision of the perfect agile marketer, Melanie, as she went through her day.
This perfect world vision may have made you a little sick. Who really works in a marketing environment like that?
You don't have to become this kind of über agile marketer overnight. You can "plug in" at any of several places. Testing is one place that touches on many of the agile marketer's practices including measurement, content development, and goal setting. I asked Rose Holston of Aviso Communications to answer some of the main questions marketers have when starting down the path toward implementing an agile online testing program.
Testing is the single most important skill you'll develop as an agile marketer.
Testing is not hard. Becoming a testing organization is. The act of setting up a simple test requires you to increase your proficiency in a number of areas; proficiencies that are crucial for progressive, data-driven marketing. For example, managing the IT department is an important proficiency.
To be successful, you need a plan. To execute that plan, every decision should be backed up with quantitative results that help evolve the plan. The more specific you get about the outcome you are trying to affect, the more you will learn from testing. There are three basic questions to be addressed.
Why Will I Test?
A picture is worth a thousand words.
In order to understand the power of testing, start with a picture or baseline of what is happening today. Take a snapshot of the past 30 days.
Where are visitors coming from?
When are they visiting more often?
Did they leave right away or did they visit multiple pages?
Did they take the actions I expected?
There are several easy-to-use tools and services that are useful in delivering answers.
What Do I Test?
Think about outcomes.
Once you have a baseline, or that first picture, you can make assumptions about what to change and which enhancements can be made on your website pages.
Think in terms of numbers. Analytics provide some high-level statistics that give us clues to areas that need improvement.
A bounce rate determines if a visitor leaves after viewing only one page on your site. Pages with high bounce rates may be chasing visitors away.
Like the bounce rate, the exit percentage tells us which pages visitors tend to leave from. Although visitors may be leaving a particular page in large numbers, be careful in making quick assumptions. Visitors may be getting what they were looking for.
A "conversion" is the completion of an action you want a visitor to take. This could be a downloading a paper, submitting a form, buying, etc.
How Do I Test It?
Execute the plan over and over again.
A test plan organizes your day much like a marketing plan or editorial calendar. Test planning evolves as you learn more about the behaviors of your target audience and bump up against your own resource and budget constraints. Keep in mind that test plans are an excellent tool for reporting results to the C-suite. Testing just may get you more resources and budget.
A test plan has five major components.
The "what" and "why" questions are answered by how you think the outcome may be affected.
Define the details of the test. Include images of the creative in this section.
Use of a control and treatment doesn't imply a split testing strategy, in which traffic is sent equally to two different pages. You can also do serial testing, in which you post changes one after the other, measuring the increase or decrease in performance after each. Serial testing doesn't require split testing software, though it still requires the discipline to review results and roll back to a previous version if changes reduce results.
Decide which metrics you'll use to determine if your hypothesis is true. This is your baseline picture.
Estimating how long to run a test depends on your current traffic and the number of conversions you generate. You must reach a point of statistical significance. Once you have defined a timeframe to run the test, you will record your results against the measurement plan. The test has now taken shape.
Your measurement plan and results are the picture that becomes a story that you can now put into words. At this stage, we speculate on "why" visitors reacted in the way they did.
This process documents a complete "Kaizen" exercise. Kaizen means "good change." Your goal is to define potential "good changes" that will instruct the next series of tests. On paper, your story reads like a novel, each test becomes a chapter in the book. Your expectations should be open as the purpose of your hypothesis is to prove or disprove what you think will happen.
Note: An agile marketer will always expect the unexpected.
All great efforts run into resistance. Let us know in the comments if you've tried to implement tests and what barriers you've come up against.
On the heels of a fantastic event in New York City, ClickZ Live is taking the fun and learning to Toronto, June 23-25. With over 15 years' experience delivering industry-leading events, ClickZ Live offers an action-packed, educationally-focused agenda covering all aspects of digital marketing. Register today!
Want to learn more? Join us at ClickZ Live San Francisco, Aug 10-12!
Educating marketers for over 15 years, ClickZ Live brings together industry thought leaders from the largest brands and agencies to deliver the most advanced, educational digital marketing agenda. Register today and save $500!
With 15 years of online marketing experience, Brian has designed the digital strategy and marketing infrastructure for a number of businesses, including his own technology consulting company, Conversion Sciences. He built his company to transform the Internet from a giant digital-brochure stand to a place where people find the answers they seek. His clients use online strategies to engage their visitors and grow their businesses. Brian has created a series of Web strategy workshops and authors the Conversion Scientist blog. Brian works from Austin, Texas, a place where life and the Internet are hopelessly intertwined.
Hong Kong, May 5-6, 2015
Gartner Magic Quadrant for Digital Commerce
This Magic Quadrant examines leading digital commerce platforms that enable organizations to build digital commerce sites. These commerce platforms facilitate purchasing transactions over the Web, and support the creation and continuing development of an online relationship with a consumer.
Paid Search in the Mobile Era
Google reports that paid search ads are currently driving 40+ million calls per month. Cost per click is increasing, paid search budgets are growing, and mobile continues to dominate. It's time to revamp old search strategies, reimagine stale best practices, and add new layers data to your analytics.
May 6, 2015
12:00pm ET/9:00am PT