Home  › Media › Publishing

One-Day Usability Testing

  |  October 5, 2000   |  Comments

Usability testing can start at $30,000 and takes at least a few weeks, if not longer. Not an option for companies trying to rush a product to launch on a limited budget. Luckily, 80 percent of what you would learn from these studies can be gained in less than a day. Rule of thumb: You can get solid feedback on a user interface after observing 5 to 10 potential customers trying to use it. You can test more, but additional testing seldom raises significant issues not identified by the first 10 customers.

If outsourced, usability testing usually starts at approximately $30,000 and takes at least a few weeks, if not longer. Not an option for most companies trying to rush a product to launch on a limited budget. Luckily, 80 percent of what you would learn from these studies can be gained in less than a day.

The rule of thumb, which I have experienced to be true, is that you can usually get solid feedback on a user interface after observing 5 to 10 potential customers trying to use it. If you have time to test with more people, it will help you feel more comfortable with the results of your testing. However, additional testing seldom raises significant issues that the first 10 people did not identify.

Finding Subjects

So, where do you find the guinea pigs? There are four sources of people for testing that can usually be tapped on short notice and who are willing to spend an hour playing with your product in exchange for pizza.

  1. New hires: The last 10 people you hired probably know about as much about your company as a random person picked off the street. Ask your HR department if you can add usability testing as part of the orientation process under the guise that you are helping new hires learn about the products. If you are looking for feedback on existing products, you might even be able to get some feedback from candidates during the interview process.

  2. Neighborhood companies: If you are in an area with a lot of Internet or technology companies, it should be easy to find a few peers among your neighbors who would be more than willing to do a testing trade. They spend an hour with your product in exchange for an hour in the future when they need to get some testing done. This is also a great way to build awareness about your products and your company and to attract employees (not that I would recommend stealing employees from your neighbors).

  3. Existing customers: Oddly enough, a lot of customers enjoy being involved in the development process. In exchange for a T-shirt or pizza, they will gladly visit your office and spend an hour with you. Why don't you give a real-world example here to add credibility?

  4. Friends and family: Although she may not be in your demographic, your grandmother may be the best resource for usability testing. If you can build an interface that makes sense to someone with minimal Internet experience, you will probably appeal to 99 percent of the U.S. population. Note that this can backfire if you have to spend the first hour explaining how to use a mouse.

Running the Tests

Given that you have already spent time and put in the effort to get the subjects and schedule a conference room, you might as well invest an extra hour or two to make sure that you are prepared. Avoid doing improvisational testing (that is, sitting down with a subject and winging it as you go). Here are a few tips on how to prepare for your tests.

  1. Use scenarios: As part of the product-development process, you should have already identified how you expect customers to use your new product. Ask your subjects to attempt to do a few of these tasks. Have them try to buy a product from your catalog, register for your new service, or change their payment method within their account.

  2. Have customers verbalize their thoughts: You can learn a lot from simply watching someone use your product. However, the results of your testing are significantly enhanced if you ask the subjects to verbalize their thoughts as they navigate. This is a good way to avoid making assumptions about why a subject did not go down the path that you intended. You might also catch some random comments that change your thinking about a feature or design.

  3. Keep yourself honest: Try to always have more than one member of your product team involved in the testing. This decreases the likelihood that you will misread the actions or comments of the subject. This is especially important if you are invested in having the results turn out a certain way - you might be under a tight deadline and not want to see that your product needs major changes or have your ego tied up in a feature or page layout. Another approach would be to videotape the test and invite your entire product team to watch and comment.

  4. Test the total product: If you spent the time to catch your subjects, milk it for all it is worth. Try to get feedback on more than just the features, placement of buttons, and page flow. Ask about the impression they got from the marketing pages, their expectations for email communication after they use the product, their reaction to different pricing strategies, etc.

ClickZ Live San Francisco This Year's Premier Digital Marketing Event is #CZLSF
ClickZ Live San Francisco (Aug 11-14) brings together the industry's leading practitioners and marketing strategists to deliver 4 days of educational sessions and training workshops. From Data-Driven Marketing to Social, Mobile, Display, Search and Email, this year's comprehensive agenda will help you maximize your marketing efforts and ROI. Register today!

ABOUT THE AUTHOR

COMMENTSCommenting policy

comments powered by Disqus

Get ClickZ Media newsletters delivered right to your inbox. Subscribe today!

COMMENTS

UPCOMING EVENTS

Featured White Papers

BigDoor: The Marketers Guide to Customer Loyalty

The Marketer's Guide to Customer Loyalty
Customer loyalty is imperative to success, but fostering and maintaining loyalty takes a lot of work. This guide is here to help marketers build, execute, and maintain a successful loyalty initiative.

Marin Software: The Multiplier Effect of Integrating Search & Social Advertising

The Multiplier Effect of Integrating Search & Social Advertising
Latest research reveals 68% higher revenue per conversion for marketers who integrate their search & social advertising. In addition to the research results, this whitepaper also outlines 5 strategies and 15 tactics you can use to better integrate your search and social campaigns.

WEBINARS

    Information currently unavailable

Jobs

    • Internet Marketing Campaign Manager
      Internet Marketing Campaign Manager (Straight North, LLC) - Fort MillWe are looking for a talented Internet Marketing Campaign Manager to join the...
    • Online Marketing Coordinator
      Online Marketing Coordinator (NewMarket Health) - BaltimoreWant to learn marketing from the best minds in the business? NewMarket Health, a subsidiary...
    • Call Center Manager
      Call Center Manager (Common Sense Publishing) - Delray BeachWanted: Dynamic Call Center Manager with a Proven Track Record of Improving Response...