Skip Navigation
Lister Hill Center Logo  

Search Tips
About the Lister Hill Center
Innovative Research
Publications and Lectures
Training and Employment
LHNCBC: Document Abstract
Year: 2007Adobe Acrobat Reader
Download Free Adobe Acrobat Reader
LHNCBC-2007-044
Inter-observer Agreement in the Evaluation of Digitized Cervical Images
Jeronimo J, Massad S, Castle PE, Schiffman M, NIH/ASCCP Research Group
American Journal of Obstetrics and Gynecology. Vol. 197, Issue 1, July 2007
Background: Observational agreement between clinicians has been evaluated in several medical specialties with very different levels of concordance. Previous reports have shown lack of agreement among colposcopists. Methods: Twenty expert colposcopists evaluated 939 digitized images of the uterine cervix obtained after the application of 5% acetic acid during the ASCUS-LSIL Triage Study. Pictures were distributed among the evaluators such that each expert had images with similar visual diagnoses taken from women with similar HPV DNA test results. Each evaluated 112 pictures. Twenty images were graded by all the colposcopists. McNemar's chi square tests were used to compare ratings of lesion presence, lesion number, and diagnosis. Factors associated with diagnosis were determined using logistic regression. Results: Frequency of diagnoses varies widely among evaluators with the greatest variability for normal/metaplasia diagnosis. Despite the wide variability of diagnoses, it is possible to create up to three groups of evaluators who tended to resemble each other in their diagnosis. Discussion: We conclude that colposcopic diagnosis using static images is irreproducible and might reflect similar problems in clinical practice. We recommend that researchers question the use of colposcopic images as a reference standard for teaching and evaluating the presence or severity of disease.