Prioritize Usability Testing and Web Analytics

  |  February 18, 2005   |  Comments

How do you justify Web analytics and usability tests? What role does each play in conversion?

If you've performed usability tests and tried to reconcile those results with your current site metrics, you've probably been left scratching your head. Usability respondents find something wrong on a particular page, yet the same "problem" isn't evident in the site analytics.

This leaves you with a rather big question: How do you justify Web analytics and usability, and what role does each play in the conversion equation?

Measuring Oranges and Apples

Although both attempt to measure a site's ability to convert, Web analytics and usability testing actually measure two entirely distinct aspects of a site.

Web analytics measure visitor intent and persuasive momentum, as well as the site's ability to move visitors through a conversion scenario. Usability examines the site's interface and process barriers that keep visitors from accomplishing a conversion task. Usability is:

The ability to effectively implement knowledge concerning the human-computer interface to remove any obstacles impeding the experience and process of online interactions.

Usability Tests Do Only So Much

Well-known online usability expert Jakob Neilson points out in his latest newsletter:

One downside of users' [participants'] tendency to engage strongly is that they sometimes work harder on tasks in a test session than they would at home. If the user says, "I would stop here," you can bet that they'd probably stop a few screens earlier if they weren't being tested.

A usability test can't measure two key factors in the conversion process: persuasive momentum and individual motivation. A visitor's willingness to click through to a site and participate in its conversion processes is directly tied to her intent and motivations and the relevance of the product or service to her needs.

We've all endured poorly executed sites or shopping experiences because we felt it was the only way to meet our needs. We've also bailed out of sites because we just didn't have a high enough intent to purchase or were aware of an easier-to-use site.

In usability tests, respondents can't fake a visitor's real-time persuasive momentum, but they can indicate how well the site may be doing in allowing visitors to complete a task.

Combine Apples and Oranges for a Clearer Picture

According to Neilson, "In usability studies, participants easily pretend that the scenario is real and that they're really using the design." However, it's much harder for participants to fake a need they don't have. If you disliked pungent cheese and were asked to shop for the best Roquefort, could you simulate the actions a true cheese lover would take?

Web analytics, on the other hand, track actual actions taken on your site from very large sample groups. They provide a true measure of activity and persuasive momentum.

Couple usability testing with Web analytics for a more holistic picture of what is (or isn't) happening on your site.

Web analytics provide the most accurate and objective measure of how individuals interact with a site. Usability studies provide insight into what's happening in particular instances.

Who, What, Where?

Generally speaking, use Web analytics to determine where to make site changes and usability tests to determine what to test.

A usability test reveals users have a problem on page 2 of a checkout process, while analytics reveal a much higher drop-off on page 3. On further investigation, we determined the following:

  • On this site, there was a high intent to purchase (indicated by a very short path from the home page to the shopping cart page). Even though visitors weren't completing checkout, they were willing to go one step further than usability testers.

  • Usability testers discovered some unmet customer expectations in the process. Users were looking for certain elements, possibly clicking as far as page 3 to find them. When they didn't find them, they abandoned the site.

In another case, we evaluated a mass merchant's Web site during a conversion assessment. One category page was losing almost 92 percent of visitors. No usability test could have found or solved the problem if analytics hadn't indicated there was a problem in the first place. The solution required swapping one image. Result? A daily increase of tens of thousands of dollars in revenue. The return on investment (ROI) is the result of taking action on the assessment.

Usability Testing Tips

Start respondents at whatever drives your traffic (e.g., a search engine) rather than at your site. You'll glean data other usability testers might ignore. You can gauge testers' first impression of your site relative to other choices, a situation much closer to real life. You may even find visitors have a hard time getting past an entry page or even the search engine results page.

Usability testing needn't cost a fortune. Morae is a usability lab on CD-ROM; it's revolutionized our approach to usability testing.

An Explosive, One-Two Optimization Punch

Visitors don't make decisions in a vacuum. They participate in multiple conversion scenarios, whether you plan them or not. They move through your site in the context of those scenarios, and their decisions are affected.

Usability tests can show where technology or interfaces can stand improvement, but only Web analytics can measure how well a site addresses a visitor's needs.

Using both Web analytics and usability testing correctly makes for an explosive, one-two optimization punch.

Meet Bryan at Search Engine Strategies in New York City, February 28-March 3.

ClickZ Live Toronto On the heels of a fantastic event in New York City, ClickZ Live is taking the fun and learning to Toronto, June 23-25. With over 15 years' experience delivering industry-leading events, ClickZ Live offers an action-packed, educationally-focused agenda covering all aspects of digital marketing. Register today!

ClickZ Live San Francisco Want to learn more? Join us at ClickZ Live San Francisco, Aug 10-12!
Educating marketers for over 15 years, ClickZ Live brings together industry thought leaders from the largest brands and agencies to deliver the most advanced, educational digital marketing agenda. Register today and save $500!

ABOUT THE AUTHOR

Bryan Eisenberg

Bryan Eisenberg is co-founder and chief marketing officer (CMO) of IdealSpot. He is co-author of the Wall Street Journal, Amazon, BusinessWeek, and New York Times best-selling books Call to Action, Waiting For Your Cat to Bark?, and Always Be Testing, and Buyer Legends. Bryan is a keynote speaker and has keynoted conferences globally such as Gultaggen, Shop.org, Direct Marketing Association, MarketingSherpa, Econsultancy, Webcom, the Canadian Marketing Association, and others for the past 10 years. Bryan was named a winner of the Marketing Edge's Rising Stars Awards, recognized by eConsultancy members as one of the top 10 User Experience Gurus, selected as one of the inaugural iMedia Top 25 Marketers, and has been recognized as most influential in PPC, Social Selling, OmniChannel Retail. Bryan serves as an advisory board member of several venture capital backed companies such as Sightly, UserTesting, Monetate, ChatID, Nomi, and BazaarVoice. He works with his co-author and brother Jeffrey Eisenberg. You can find them at BryanEisenberg.com.

COMMENTSCommenting policy

comments powered by Disqus

Get the ClickZ Analytics newsletter delivered to you. Subscribe today!

COMMENTS

UPCOMING EVENTS

Featured White Papers

Gartner Magic Quadrant for Digital Commerce

Gartner Magic Quadrant for Digital Commerce
This Magic Quadrant examines leading digital commerce platforms that enable organizations to build digital commerce sites. These commerce platforms facilitate purchasing transactions over the Web, and support the creation and continuing development of an online relationship with a consumer.

Paid Search in the Mobile Era

Paid Search in the Mobile Era
Google reports that paid search ads are currently driving 40+ million calls per month. Cost per click is increasing, paid search budgets are growing, and mobile continues to dominate. It's time to revamp old search strategies, reimagine stale best practices, and add new layers data to your analytics.

WEBINARS

Resources

Jobs

    • GREAT Campaign Project Coordinator
      GREAT Campaign Project Coordinator (British Consulate-General, New York) - New YorkThe GREAT Britain Campaign is seeking an energetic and creative...
    • Paid Search Senior Account Manager
      Paid Search Senior Account Manager (Hanapin Marketing) - BloomingtonHanapin Marketing is hiring a strategic Paid Search Senior Account Manager...
    • Paid Search Account Manager
      Paid Search Account Manager (Hanapin Marketing) - BloomingtonHanapin Marketing is hiring an experienced Paid Search Account Manager to...