bad-email

Are You Suffering From OCT (Obsessive-Compulsive Testing)?

  |  August 6, 2013   |  Comments

Don't worry - there is a cure. And once cured, you can engage in more strategic CRO activities in a much healthier manner, and know when enough is enough.

Poor Ryan. He is a pay-per-click (PPC) professional who landed a big role managing paid search for a well-known brand. Being in charge of a large budget for PPC with serious performance goals tied to it was a sobering experience for him. He already knew there was more to conversion than just the paid search click, but never was it more apparent than now.

Ryan quickly moved beyond driving traffic in order to increase the site's return on investment (ROI). He assembled a small team within the company to lead the charge on conversion rate optimization (CRO). Once they started seeing results from landing page tests, Ryan became an even bigger asset to the company, as well as a CRO convert.

But something happened to Ryan over time. He became so obsessed with the idea of testing that he began to test things that had minimal impact on the company's bottom line.

Ryan was suffering from obsessive-compulsive testing (OCT): an irrational addiction to landing page testing that sends people on a continuous search for microscopic gains, while ignoring other areas of the site that could offer even greater conversion improvements.

This is not an uncommon scenario. At my company we often see online marketers, site owners, or whole conversion teams suffering from tunnel vision in a quest for perfection of their landing pages or whatever real estate they're testing.

The good news about OCT is that there is a cure. And knowing when to stop and how to do it is the first step.

What You Need to Know About Being "Done" Testing

Many of us have heard the "Testing is an ongoing activity, and you should never stop testing" line. So, let's talk about this idea of ever being "done" with regards to improving your user's experience. A website should never stop getting better, but obsessing over testing a particular page and its content is counterproductive.

There are two indicators that it's time to pull the plug on a particular test:

  1. The results consistently get worse.
  2. You start testing elements that were previously optimized.

If you conducted a test for improvements on a crappy page on your site, you'd of course expect to see a positive increase in conversions from what you learned and applied to that page. If you decided to repeat that same test but made a minor tweak, you can expect the lift will be a fraction of the first test. If this continues version after version and with minimal return, it's time to stop.

On that same note, if you become obsessed with testing the same element on a page, like a headline, and you're aimlessly testing changes of individual words just to see which one beat the other, it's time to move on.

There are two reasons for these diminishing returns. Not only are you seeing less of a lift each time you tweak the page (because the page keeps getting better), but the quality of your ideas is probably getting worse (because you have thought up all of the impactful ones already).

Add to that the fact that you're putting time and resources into something that should be called "done enough," and it's definitely not positively impacting ROI. There comes a time when good enough is best for the company.

Overcoming Obsessive-Compulsive Testing

If you find you or your team obsessing over testing every detail and your return is marginal, take these three steps to help cure that OCT addiction:

  1. Find other areas of the site you can focus on optimizing. You can identify this by following the economic value. How much value is running through that part of the site? How crappy is it? How easy is it to fix? Always prioritize your testing on what gives you the most value. It may not be the page you are fixated on currently.
  2. Get an outside perspective. Ask users to complete the task you are trying to test and get their feedback. This can give you new insights to consider (something you haven't thought of instead of testing that same old idea).
  3. Take a break from testing altogether. If you have other areas of marketing you can focus on for a while, do it. Spend some time in PPC campaigns, social media, or SEO, and you might come back to CRO with a fresh perspective and recharged batteries that help you to be more successful.

With a little support and direction, OCT can be cured. Once cured, you can engage in more strategic CRO activities in a much healthier manner - and know when enough is enough. You'll still be able to show positive ROI, but can also add efficiency, time savings, and maintaining personal sanity to your list of contributions.

Image on home page via Shutterstock.

ClickZ Live Chicago Join the Industry's Leading eCommerce & Direct Marketing Experts in Chicago
ClickZ Live Chicago (Nov 3-6) will deliver over 50 sessions across 4 days and 10 individual tracks, including Data-Driven Marketing, Social, Mobile, Display, Search and Email. Check out the full agenda and register by Friday, Oct 3 to take advantage of Early Bird Rates!

ABOUT THE AUTHOR

Tim Ash

Tim Ash is CEO of SiteTuners.com, a landing page optimization firm that offers conversion consulting, full-service guaranteed-improvement tests, and software tools to improve conversion rates. SiteTuners' AttentionWizard.com visual attention prediction tool can be used on a landing page screenshot or mock-up to quickly identify major conversion issues. He has worked with Google, Facebook, American Express, CBS, Sony Music, Universal Studios, Verizon Wireless, Texas Instruments, and Coach.

Tim is a highly-regarded presenter at SES, eMetrics, PPC Summit, Affiliate Summit, PubCon, Affiliate Conference, and LeadsCon. He is the chairperson of ConversionConference.com, the first conference focused on improving online conversions. A columnist for several publications including ClickZ, he's host of the weekly Landing Page Optimization show and podcast on WebmasterRadio.fm. His columns can be found in the Search Engine Watch archive.

He received his B.S. and M.S. during his Ph.D. studies at UC San Diego. Tim is the author of the bestselling book, "Landing Page Optimization."

Connect with Tim on Google+.

COMMENTSCommenting policy

comments powered by Disqus

Get the ClickZ Analytics newsletter delivered to you. Subscribe today!

COMMENTS

UPCOMING EVENTS

Featured White Papers

IBM: Social Analytics - The Science Behind Social Media Marketing

IBM Social Analytics: The Science Behind Social Media Marketing
80% of internet users say they prefer to connect with brands via Facebook. 65% of social media users say they use it to learn more about brands, products and services. Learn about how to find more about customers' attitudes, preferences and buying habits from what they say on social media channels.

An Introduction to Marketing Attribution: Selecting the Right Model for Search, Display & Social Advertising

An Introduction to Marketing Attribution: Selecting the Right Model for Search, Display & Social Advertising
If you're considering implementing a marketing attribution model to measure and optimize your programs, this paper is a great introduction. It also includes real-life tips from marketers who have successfully implemented attribution in their organizations.

Resources

Jobs

    • Recent Grads: Customer Service Representative
      Recent Grads: Customer Service Representative (Agora Financial) - BaltimoreAgora Financial, one of the nation's largest independent publishers...
    • Managing Editor
      Managing Editor (Common Sense Publishing) - BaltimoreWE’RE HIRING: WE NEED AN AMAZING EDITOR TO POLISH WORLD-CLASS CONTENT   The Palm...
    • Senior Paid Search & Advertising Manager
      Senior Paid Search & Advertising Manager (Smarty Had A Party) - St. LouisCompany Description: A warm, loving, [slightly wacky] startup, we view...