Abstract
J.L. Esposito, P.C. Campanelli, J. Rothgeb, and A.E. Polivka (1991) "Determining Which Questions
Are Best: Methodologies for Evaluating Survey Questions," Proceedings
of the Section on Survey Research Methods, American Statistical
Association, 46-55.
Various techniques have been developed over the years to
pretest new survey questions or to evaluate the effectiveness
of preexisting questions. As part of the current effort to
redesign the Current Population Survey (CPS), researchers
from Census and BLS are using a variety of methods to
evaluate questions designed to elicit accurate labor force
data and to assess the quality of interviewer-respondent
interactions. These methods include: (a) the coding of
interviewer and respondent behavior, (b) debriefing
respondents to obtain additional information about how they
view CPS questions/concepts, and (c) debriefing interviewers
on how respondents react to and understand CPS
questions/concepts, and (d) comparing item nonresponse rates
and response distributions for different versions of the same
survey questions. This paper describes the advantages and
disadvantages of each of these techniques. The discussion is
illustrated with selected results from a CATI/RDD test.
To receive a copy of this paper (usually within 3-5 days), please contact Jim Esposito by phone or voice mail (202-691-6368), by e-mail (Esposito.Jim@bls.gov), or by mailing your request to:
James L. Esposito
Bureau of Labor Statistics
Postal Square Building, Room 4985
2 Massachusetts Avenue, N.E.
Washington, DC, 20212
Last Modified Date: July 19, 2008
|