ITS Audio Quality Research Program |
Listening ExperimentsThe Audio Quality Research Program periodically conducts listening experiments to support various research efforts. These experiments provide information on the perceived quality that results from various coding and transmission schemes and impairments. The Program is well equipped to conduct these experiments. The laboratory facility includes two sound-isolated rooms. Other equipment includes digital audio tape recorders, compact disk players, digital audio encoders and decoders, a spectrum analyzer, signal generators, level meters, mixers, amplifiers, processors, speakers, and microphones. Workstations equipped with 24-bit digital-to-analog and analog-to-digital converters provide for additional signal conversion and processing flexibilities.Listening experiments are the most direct way to measure perceived speech or audio quality. (Listening experiments are also known as subjective tests.) These experiments take many forms, but always include the presentation of an auditory stimulus, and the recording of a subject's response. The subject is often referred to as the "listener." It is important that the experimental environment be closely controlled, especially with regard to background noise. Sound isolated rooms are often used to gain the required level of control. The auditory stimuli are often short (5 to 30 second) passages of speech or music. Stimuli may be played through loudspeakers, headphones, telephone handsets, or other devices, as appropriate for a given experiment. The type of experiment also determines the listener responses that are recorded. As with all human subject experiments, variability of responses across subjects is to be expected. Analysis of listening experiments often involves measures of central tendency and measures of dispersion, both of which are inherently linked to the number of subjects in the experiment. For some specific classes of listening experiments, the International Telecommunication Union (ITU) has provided guidance for the experimenter. Some of the relevant Recommendations include:
Other important considerations in the design and conduct of listening experiments include: the selection of subjects (hearing acuity, age, sex, prior knowledge, expectations), subject fatigue, selection of auditor stimuli (age, sex, language of speakers, types of music or other stimuli, appropriate balance of auditory stimuli), and the randomization of auditory stimuli to prevent order effects. Additional discussion is available in a slide show titled " Quality Assessment of Digitally Coded Speech." |