Beta — We’re reformatting our articles to work with the new site, but this is one hasn’t been done yet; it may contain formatting issues. No need to report this. We’re working on it.

Six Steps to Ensure a Successful Usability Test

by Janice (Ginny) Redish
on January 18, 2005

In the early days of usability testing, most design teams waited until the end of production to test. They were doing what they thought of as "validation." They hoped users would sail through the tasks and their design would emerge as a resounding success. Designers equated success in the usability test with success in the design.

If you wait until the end to do usability testing, however, you are almost certain to find serious problems in the product. And then you have the frustration of neither time nor resources to fix the problems.

This type of end-of-process, validation testing (also known as "summative" testing) has a legitimate place in the usability specialist’s toolkit. However, it should not be the only usability testing that you do. Why not? Because to complete the design process with a design free of problems, you have to find – and fix – the problems during the process. Testing while the product is being planned, designed, and developed is called "formative" testing.

Success:  Finding the problems that need fixing

Instead of thinking of success as a perfect design, you should think of success in a usability test as learning what you need to know. The goal of formative, diagnostic testing is to find the critical problems that prevent users from completing their tasks.

Timing is critical. You want to learn about your design’s problems during the usability test, not when it fails after it is released. It’s that eventual failure that you are working to avoid. Formative usability testing is the way to achieve success by finding and fixing problems early.

Six tips to successful usability testing

  1. Start early. When you find problems early in the design process, you
    save time and money that would have gone into taking the product down
    a poor pathway.
  2. Select issues that uncover problems if they exist. Don’t
    shy away from controversial issues. Those issues are exactly what usability
    testing is good at resolving.
  3. Select user tasks that uncover the biggest
    problems. As you consider what to ask participants to do during the
    usability test, focus on tasks that:

    • are critical
    • are done frequently
    • have serious consequences if done incorrectly
    • you or managers, designers, developers, writers are worried about
  4. Find
    participants who really represent users, especially users you are concerned
    about. If what you learn isn’t believable – because the
    users aren’t like the people the product is meant for – developers
    may not act on what you learn.
  5. Watch and listen carefully. Be alert, not
    only to the problems participants are having, but to the likely causes
    of those problems. Listen for the words participants use when they
    can’t find what they need. The design may be using the wrong vocabulary.
    Watch where participants look for items on a web page. The page design
    may be confusing participants.
  6. Help the designers and developers to see
    that uncovering problems is not a sign of failure. No one does a perfect
    job the first time. Users always surprise us. It’s much better to find
    out about the problems with a few users in a usability test than later
    when the design is being reviewed and is out there in the marketplace.

Is success only about problems?

No. Success in usability testing is learning what you need to know. That includes finding out both what is working well and what is not working well.

It’s important to record the positives as well as the problems – and to tell those who haven’t seen the usability test about both. And that brings us to another important aspect of successful usability testing: communicating the results in a way that makes the design’s team members – the managers, designers, developers, writers, and other contributors – eager to help fix the problems.

If the team members don’t understand what happened in the test and how it should affect the outcome of the design, they won’t make the necessary changes or will possibly change the wrong thing. A successful usability test results in design improvements.

Focusing on formative tests–with an eye toward identifying problems
and bringing the issues to the team–is the secret to successful
usability testing.

If you’re thinking of conducting your own usability tests, you will
definitely want to check out the UIE Virtual Seminar Archived Recording of Demystifying Usability Tests, by UIE’s Christine Perfetti. Christine shares everything you need to know to begin conducting effective usability tests.