Variation in Populations

In considering the estimates in the tables and figures shown in this volume and on the NCES website, it is important to keep in mind that there may be considerable variation among the members of a population in the characteristic or variable represented by the population estimate. For example, the estimated average combined reading literacy score of 4th-graders in the United States in 2006 was 540 (see table 18-1). In reality, many U.S. students scored above 540 points, and many scored below 540 points. Likewise, not all faculty salaries, benefits, and total compensation at postsecondary institutions were the same at each type of institution in 2006–07 (indicator 42). Because of this variation, there may be considerable overlap among the members of two populations that are being compared. Although the difference in the estimated means of the two populations may be statistically significant, many members of the population with the lower estimated mean may be above the estimated mean of the other population, and vice versa. For example, some percentage of young adults with a high school diploma or equivalent have higher earnings than young adults with a bachelor’s degree or higher (indicator 20). The extent of such overlap is not generally considered in the indicators in this volume. Estimates of the extent of variation in such population characteristics can be computed from the NCES survey datasets or are available in published reports. For example, estimates of the variation in students’ assessment scores can be found using the NAEP Data Explorer or in the appendixes to most NAEP reports.