'Programizing' Site Optimization

  |  March 24, 2009   |  Comments

Building testing into an ongoing program to optimize a Web site can be a struggle.

People preach that using testing to tune and optimize Web sites is easy. They say the tools are out there and aren't terribly difficult to implement. Yet, there are some clear problems that occur if not approached the right way.

Last time, I recapped some trends from the Omniture Summit, including the move by more companies to optimize their Web sites. Tuning and improving site performance through testing (A/B, multivariate, etc) is positive because there's often a lot of low-hanging fruit.

At the summit, many conversations revolved around testing. A relatively small number of companies say it's a regular occurrence within their business, but nearly everyone says they're starting to experiment with it or plan to very soon.

Testing Factors to Consider

Let's assume a company invests (dollars and resources) in a testing tool, whether it's Omniture Test & Target, the free Google Optimizer, or other tools, and gets it implemented properly. Let's go one step further and say these companies set the tests up correctly with the correct measurements of success, statistical significance, segmentation and the like. So far so good, right?

These may seem like basics, but when most companies start experimenting with testing they spend a lot of time struggling through these few basic things. Dedicated companies will figure these things out over time, but it can be painful and time consuming.

But that isn't where most companies fail. Most companies really struggle and leave money on the table by failing to understand the difference between treating site testing as a project versus a program. Ideally, companies want to "programize" their site testing -- this means thinking of it holistically and as an ongoing initiative instead of just a series of one-off tests.

Most companies start by looking at low-hanging fruit -- things they believe might be weak areas, that customers have complained about, or what an executive doesn't like. These are all natural places to start with and often will show some return.

But as time goes on, low-hanging opportunities become fewer and farther between and less fruitful in terms of their impact. Companies begin to struggle. One of two things happens: the desire, focus, and willingness to dedicate resources starts to fizzle out or they get smart and realize they need to look at optimization differently.

Building Testing into a Program

What does it mean to move from a project view to a program view? It means looking at testing holistically and as an ongoing initiative, not just testing something, picking the winner based on the results of one or two measurements of success, and then moving onto the next thing. It means taking lessons learned from each test, understanding the why behind tests, running follow up tests, and many more things.

Here are a few things that make a successful "programized testing" initiative:

  • Testing focused on areas of the site with the greatest potential impact to the business -- focus on the areas that really matter and can drive the most value.

  • Testing focused on business goals for the Web channel -- not just things you think you can improve. It's often easy to identify things that seem easy to change, but they may fall on a portion of the site that only impacts 1/1000th of 1 percent of the site traffic and isn't related to a key conversion rate.

  • Testing paths, not just individual pages. A page is just one piece of the puzzle. To get the most lift out of your testing, consider testing along the entire path of success.

  • Understanding the true impact of tests outside of just one or two behavioral measurements. Do you know the attitudinal impact of that test you ran last week on the people that didn't convert? Do you have any idea how they were impacted? You can often tell when a company truly has programmatic testing when they don't just measure improvements to single metrics, but also tie it in to overall site satisfaction. That demonstrates that the testing plan is wrapped into larger site vision.

  • Documenting and sharing learnings from all tests throughout the organization. Well-structured tests can drive insight throughout the Web team.

  • Sharing online learnings with offline channels when applicable. This could be for offline marketing, customer service, merchandising, etc.

  • Segmenting your messaging/experience based on test results -- don't just pick one winner for each test. Look for ways when it makes sense to pick a few winners based on different audience, days of week, segments, etc.

  • Allocate resources so that you can quickly, constantly, and strategically test new ideas (again based on greatest impact to the business).

  • Perform pre-testing as a part of a larger redesign effort. Running a series of tests validating which things are broken and what customers are clamoring for as you plan out and build towards the redesign. And of course, serious companies are launching redesigns with a slew of tests built in.

Again, site optimization is a key trend we're seeing. Testing is taking off as the economy slows and as businesses must get more out of their sites with fewer resources and less money.

Take the time to really do it right. Low-hanging fruit won't last forever -- and the potential upside is much greater when you programize the process. Shoot me a note and let me know what you have done within your company to address many of these things.

ClickZ Live Chicago Join the Industry's Leading eCommerce & Direct Marketing Experts in Chicago
ClickZ Live Chicago (Nov 3-6) will deliver over 50 sessions across 4 days and 10 individual tracks, including Data-Driven Marketing, Social, Mobile, Display, Search and Email. Check out the full agenda and register by Friday, August 29 to take advantage of Super Saver Rates!

ABOUT THE AUTHOR

Jason Burby

As President of the Americas at POSSIBLE, Jason is responsible for leading the long-term stability and growth of the region. With more than 20 years experience in digital strategy, he is a long-time advocate of using data to inform digital strategies to help clients attract, convert, and retain customers. Jason supports POSSIBLE's clients and employees in driving new engagements and delivering great work that works. He is the co-author of Actionable Web Analytics: Using Data to Make Smart Business Decisions.

Follow him on Twitter @JasonBurby.

COMMENTSCommenting policy

comments powered by Disqus

Get the ClickZ Analytics newsletter delivered to you. Subscribe today!

COMMENTS

UPCOMING EVENTS

Featured White Papers

IBM: Social Analytics - The Science Behind Social Media Marketing

IBM Social Analytics: The Science Behind Social Media Marketing
80% of internet users say they prefer to connect with brands via Facebook. 65% of social media users say they use it to learn more about brands, products and services. Learn about how to find more about customers' attitudes, preferences and buying habits from what they say on social media channels.

Marin Software: The Multiplier Effect of Integrating Search & Social Advertising

The Multiplier Effect of Integrating Search & Social Advertising
Latest research reveals 68% higher revenue per conversion for marketers who integrate their search & social advertising. In addition to the research results, this whitepaper also outlines 5 strategies and 15 tactics you can use to better integrate your search and social campaigns.

WEBINARS

    Information currently unavailable

Resources

Jobs

    • Chinese Speaking Copywriter
      Chinese Speaking Copywriter (Agora Financial) - BaltimoreDo you speak Chinese? Are you interested in economics and finance or want to learn more...
    • Video/Digital Media Designer
      Video/Digital Media Designer (Confidential) - Delray BeachFull service corporate video production studio looking to hire a creative, and highly...
    • HEAD OF SALES
      HEAD OF SALES (OZONE MEDIA) - Santa Clarawww.ozonemedia.com HEAD OF SALES POSITION Reporting to the founder & CEO, Kiran Gopinath, the Head...