Heuristic Evaluation
What is a heuristic evaluation?The goal of heuristic evaluation is to find usability problems early in the design of a Web site so that improvements can be made as part of the iterative design process. Heuristic evaluations usually are conducted by a small set (one to three) of evaluators. The evaluators independently examine a user interface and judge its compliance with a set of usability principles. The result of this analysis is a list of potential usability issues or problems. The usability principles, also referred to as usability heuristics, are taken from published lists. Ideally, each potential usability problem is assigned to one or more heuristics to help facilitate fixing the problem. As more evaluators are involved, more true problems are found. Some evaluators try to estimate the degree to which each usability issue potentially could impede user performance or acceptance. This is done to help set priorities for making revisions to the system. However, judging the severity of proposed usability issues has been shown to be very difficult to do. What is a heuristic?Molich and Nielsen (1990) wrote a paper that contains a set of heuristics still in popular use:
Nielsen (1994), after evaluating several sets of heuristics, concluded that a better set of heuristics may be:
Gerhardt-Powals (1996) proposed a set of research-based heuristics:
Theoretically, the heuristics are related to criteria that, if improved, could make a positive difference in the product's usability. Unfortunately, the "usability problems" identified in a heuristic evaluation differ substantially from those obtained in performance testing. Only the Gerhardt-Powals set of heuristics has been validated. If other sets of heuristics are used, designers should first ensure that the evaluation actually would lead to improved Web site performance or acceptance. How does it differ from an expert review?In an expert review, the heuristics are assumed to have been previously learned and internalized by the evaluators. That is to say, evaluators do not use a clear-cut set of heuristics. As a result, the expert review tends to be less formal, and usually there is no requirement to assign a specific heuristic to each potential problem. What are the advantages of a heuristic review?The method can provide some quick and relatively inexpensive feedback to designers. Feedback can be obtained early in the design process. Assigning the correct heuristic can help suggest the best corrective measures to designers. What are the disadvantages of a heuristic review?Using this type of evaluation to identify usability problems is very difficult, research shows that it may result in only a 50% hit rate, and a 20% miss rate. Results are not based on observations of user behavior, and will result in suggesting changes to the Web site that are not required (about a 50% false positive rate). If the wrong heuristics are assigned to potential problems, it will mislead designers into applying the wrong solutions to the problems. ReferencesGerhardt-Powals, J., Cognitive engineering principles for enhancing human-computer performance, International Journal of Human-Computer Interaction, 8(2), 189-211, (1996). Molich, R. and Nielsen, J., Improving a human- computer dialogue, Communications of the ACM, 33(3), 338-348, (1990). Nielsen, J., Enhancing the explanatory power of usability heuristics, CHI'94 Conference Proceedings, (1994). |
|