bad-email

Are You Suffering From OCT (Obsessive-Compulsive Testing)?

  |  August 6, 2013   |  Comments

Don't worry - there is a cure. And once cured, you can engage in more strategic CRO activities in a much healthier manner, and know when enough is enough.

Poor Ryan. He is a pay-per-click (PPC) professional who landed a big role managing paid search for a well-known brand. Being in charge of a large budget for PPC with serious performance goals tied to it was a sobering experience for him. He already knew there was more to conversion than just the paid search click, but never was it more apparent than now.

Ryan quickly moved beyond driving traffic in order to increase the site's return on investment (ROI). He assembled a small team within the company to lead the charge on conversion rate optimization (CRO). Once they started seeing results from landing page tests, Ryan became an even bigger asset to the company, as well as a CRO convert.

But something happened to Ryan over time. He became so obsessed with the idea of testing that he began to test things that had minimal impact on the company's bottom line.

Ryan was suffering from obsessive-compulsive testing (OCT): an irrational addiction to landing page testing that sends people on a continuous search for microscopic gains, while ignoring other areas of the site that could offer even greater conversion improvements.

This is not an uncommon scenario. At my company we often see online marketers, site owners, or whole conversion teams suffering from tunnel vision in a quest for perfection of their landing pages or whatever real estate they're testing.

The good news about OCT is that there is a cure. And knowing when to stop and how to do it is the first step.

What You Need to Know About Being "Done" Testing

Many of us have heard the "Testing is an ongoing activity, and you should never stop testing" line. So, let's talk about this idea of ever being "done" with regards to improving your user's experience. A website should never stop getting better, but obsessing over testing a particular page and its content is counterproductive.

There are two indicators that it's time to pull the plug on a particular test:

  1. The results consistently get worse.
  2. You start testing elements that were previously optimized.

If you conducted a test for improvements on a crappy page on your site, you'd of course expect to see a positive increase in conversions from what you learned and applied to that page. If you decided to repeat that same test but made a minor tweak, you can expect the lift will be a fraction of the first test. If this continues version after version and with minimal return, it's time to stop.

On that same note, if you become obsessed with testing the same element on a page, like a headline, and you're aimlessly testing changes of individual words just to see which one beat the other, it's time to move on.

There are two reasons for these diminishing returns. Not only are you seeing less of a lift each time you tweak the page (because the page keeps getting better), but the quality of your ideas is probably getting worse (because you have thought up all of the impactful ones already).

Add to that the fact that you're putting time and resources into something that should be called "done enough," and it's definitely not positively impacting ROI. There comes a time when good enough is best for the company.

Overcoming Obsessive-Compulsive Testing

If you find you or your team obsessing over testing every detail and your return is marginal, take these three steps to help cure that OCT addiction:

  1. Find other areas of the site you can focus on optimizing. You can identify this by following the economic value. How much value is running through that part of the site? How crappy is it? How easy is it to fix? Always prioritize your testing on what gives you the most value. It may not be the page you are fixated on currently.
  2. Get an outside perspective. Ask users to complete the task you are trying to test and get their feedback. This can give you new insights to consider (something you haven't thought of instead of testing that same old idea).
  3. Take a break from testing altogether. If you have other areas of marketing you can focus on for a while, do it. Spend some time in PPC campaigns, social media, or SEO, and you might come back to CRO with a fresh perspective and recharged batteries that help you to be more successful.

With a little support and direction, OCT can be cured. Once cured, you can engage in more strategic CRO activities in a much healthier manner - and know when enough is enough. You'll still be able to show positive ROI, but can also add efficiency, time savings, and maintaining personal sanity to your list of contributions.

Image on home page via Shutterstock.

ClickZ Live San Francisco This Year's Premier Digital Marketing Event is #CZLSF
ClickZ Live San Francisco (Aug 11-14) brings together the industry's leading practitioners and marketing strategists to deliver 4 days of educational sessions and training workshops. From Data-Driven Marketing to Social, Mobile, Display, Search and Email, this year's comprehensive agenda will help you maximize your marketing efforts and ROI. Register today!

ABOUT THE AUTHOR

Tim Ash

Tim Ash is CEO of SiteTuners.com, a landing page optimization firm that offers conversion consulting, full-service guaranteed-improvement tests, and software tools to improve conversion rates. SiteTuners' AttentionWizard.com visual attention prediction tool can be used on a landing page screenshot or mock-up to quickly identify major conversion issues. He has worked with Google, Facebook, American Express, CBS, Sony Music, Universal Studios, Verizon Wireless, Texas Instruments, and Coach.

Tim is a highly-regarded presenter at SES, eMetrics, PPC Summit, Affiliate Summit, PubCon, Affiliate Conference, and LeadsCon. He is the chairperson of ConversionConference.com, the first conference focused on improving online conversions. A columnist for several publications including ClickZ, he's host of the weekly Landing Page Optimization show and podcast on WebmasterRadio.fm. His columns can be found in the Search Engine Watch archive.

He received his B.S. and M.S. during his Ph.D. studies at UC San Diego. Tim is the author of the bestselling book, "Landing Page Optimization."

Connect with Tim on Google+.

COMMENTSCommenting policy

comments powered by Disqus

Get the ClickZ Analytics newsletter delivered to you. Subscribe today!

COMMENTS

UPCOMING EVENTS

Featured White Papers

BigDoor: The Marketers Guide to Customer Loyalty

The Marketer's Guide to Customer Loyalty
Customer loyalty is imperative to success, but fostering and maintaining loyalty takes a lot of work. This guide is here to help marketers build, execute, and maintain a successful loyalty initiative.

Marin Software: The Multiplier Effect of Integrating Search & Social Advertising

The Multiplier Effect of Integrating Search & Social Advertising
Latest research reveals 68% higher revenue per conversion for marketers who integrate their search & social advertising. In addition to the research results, this whitepaper also outlines 5 strategies and 15 tactics you can use to better integrate your search and social campaigns.

WEBINARS

    Information currently unavailable

Jobs

    • Interactive Product Manager
      Interactive Product Manager (Western Governors University) - Salt Lake CityWestern Governors University, one of the 20 largest universities...
    • SEO Senior Analyst
      SEO Senior Analyst (University of Phoenix (Apollo Education Group)) - San FranciscoSEO Senior Analyst   Position Summary...
    • SEM & Biddable Media Manager
      SEM & Biddable Media Manager (Kepler Group LLC) - New YorkAs an Optimization & Innovation Manager at Kepler Group, you will be on the bleeding...