Skip navigation
Skip Navigation
small header image
Click for menu... About NAEP... Click for menu... Subject Areas... Help Site Map Contact Us Glossary NewsFlash
Sample Questions Analyze Data State Profiles Publications Search the Site
NAEP Technical Documentation
The Nation's Report Card (home page)

Table of Contents  |  Search Technical Documentation  |  References

NAEP Analysis and Scaling → Estimation of NAEP Score Scales → Treatment of Items in NAEP to Avoid Violations of Assumptions → Results of NAEP DIF Analyses → Results of NAEP DIF Analyses for the Geography National Main Assessment in 2001 (Accommodations Not Permitted [R2])

Results of NAEP DIF Analyses for the Geography National Main Assessment in 2001 (Accommodations Not Permitted [R2])

For dichotomously scored items, NAEP categorizes each item into one of three categories:

  • "A" (items exhibiting no DIF),
  • "B" (items exhibiting a week indication of DIF), or
  • "C" (items exhibiting a strong indication of DIF).

A plus sign (+) indicates that items are differentially easier for the focal group (female, Black, or Hispanic students) than for the reference group (male or White students) after making an adjustment for the overall level of proficiency in the two groups; a minus sign (-) indicates that items are differentially more difficult for the focal group than for the reference group. For polytomously scored items, NAEP categorizes items into "AA", "BB" or "CC" categories and the plus or minus sign has the same interpretation as dichotomously scored items. After reviewing "C" and "CC" items, subject-area specialists decided that no items were biased, so none were deleted from the scales for this reason.

Number of dichotomously scored items by grade and severity of differential item functioning, geography national main assessment (accommodations not permitted [R2]): 2001
Grade DIF category Analysis
Male/female White/Black White/Hispanic
4 C- 0 0 0
B- 0 1 1
A 31 30 30
B+ 0 0 0
C+ 0 0 0
8 C- 0 0 0
B- 0 0 0
A 33 31 31
B+ 0 2 2
C+ 0 0 0
12 C- 0 1 0
B- 2 1 0
A 32 31 34
B+ 1 2 1
C+ 0 0 0
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2001 Geography Assessment.

Items identified as "C" items in at least one comparison, geography national main assessment (accommodations not permitted [R2]): 2001
Block Item Scale Grade Comparison Group favored
G4 G039301 Environment and society 12 White/Black White
NOTE: For each grade for which an item was administered, three comparisons were performed: Male/female, White/Black, and White/Hispanic. “C” means a strong indication of DIF for dichotomously scored items. No items were identified as being biased, so none were deleted from the NAEP scales.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2001 Geography Assessment.

Number of polytomously scored items by grade and severity of differential item functioning, geography national main assessment (accommodations not permitted [R2]): 2001
Grade DIF category Analysis
Male/female White/Black White/Hispanic
4 CC- 0 0 0
BB- 0 2 0
AA 13 9 13
BB+ 0 2 0
CC+ 0 0 0
8 CC- 0 1 0
BB- 0 2 2
AA 13 9 10
BB+ 0 1 1
CC+ 0 0 0
12 CC- 0 1 1
BB- 1 0 2
AA 8 9 10
BB+ 3 2 0
CC+ 1 1 0
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2001 Geography Assessment.

Items identified as "CC" items in at least one comparison, by block and item, geography national main assessment (accommodations not permitted [R2]): 2001
Block Item Scale Grade Comparison Group favored
G4 G038801 Environment and society 12 Male/female Female
G039201 Environment and society 12 White/Black White
G039201 Environment and society 12 White/Hispanic White
G6 G034801 Spatial dynamics and connections 12 White/Black Black
G035001 Environment and society 8 White/Black White
NOTE: For each grade for which an item was administered, three comparisons were performed: Male/female, White/Black, and White/Hispanic. “CC” means a strong indication of DIF for polytomously scored items. No items were identified as being biased, so none were deleted from the NAEP scales.
SOURCE: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics, National Assessment of Educational Progress (NAEP), 2001 Geography Assessment.


Last updated 14 July 2008 (DR)

Printer-friendly Version

1990 K Street, NW
Washington, DC 20006, USA
Phone: (202) 502-7300 (map)