|
|||||||
Analyze the Results
What data will you have?At the end of the usability test, you will probably have several types of data.
What do you do with quantitative data?Consider using a spreadsheet for the quantitative data. A spreadsheet allows you to quickly see patterns in the data. It allows you to use formulas to calculate information that you might want to share, such as:
If you find that different participants had very different results, those differences may correlate with some of the demographic factors you captured through the screening questionnaire or through the participant profile questions that you asked at the beginning of the sessions. You may want to add columns to your spreadsheet for each participant's answers to demographic questions. Then you can sort by demographics and see if the other data correlate with specific demographic features. What do you do with qualitative data?Read through all the notes carefully looking for patterns. In addition to the spreadsheet for quantitative data, you might open a second spreadsheet for problems. Each row would be the description of one problem. Each column would represent one of the participants. You can then put a "yes" or a 1 for each participant who had the problem. Have a column for notes/comments as you will probably have comments that you want to make as you go through the data to remind you of what a participant did or as an insight for your report. Also, have a column to indicate which task/scenario the information in that row of the spreadsheet came from so that you can report by task/scenario if that would be useful to the development team. When you begin to analyze the data, be as specific as you can about what the participant did. A good problem statement, like a good note, tells what the participant did and contrasts that with what the participant should have done.
Good problem statement: Clicked on link to Research instead of Clinical Trials. As you accumulate these problem statements look for patterns because, in the end, you probably want to report on patterns with the specific statements as examples of the pattern. How do you know what are the most important results?As you review the results, consider:
Local versus global problemsThe scenarios you use in a usability test are only sampling the site. You are not testing every possible pathway or reaching every page. What you learn may affect pathways and pages that you did not see in the test. For example, if you find in one scenario that participants in your usability test cannot find what they need in the content because the page they come to is so dense with text that they do not want to read it, you could say that specific page has problems and needs to be fixed. But you should also consider how many other pages in the site are equally dense with text. If you had chosen a scenario that led to those other pages, how likely is it that you would have gotten the same results? Your finding may have implications for many other pages. Overly dense text may be a global problem within the site. Levels of severitySome problems contribute more to participants being unable to complete the scenarios than others. Many groups note the severity of the problems they identify on a three-point or four-point scale. One possible scale would be:
Next stepsWhen you have analyzed the data, you are ready to Prepare the Usability Test Report. |
|