Student Learning in Mathematics and Science
- Performance as Students Progress Through Elementary School
- Mathematics Performance as Students Progress Through High School
- Performance of 4th, 8th, and 12th Grade Students Since the 1990s
- International Comparisons of Mathematics and Science Performance
- Summary
This section presents indicators of student performance in mathematics and science from two types of studies: longitudinal studies and repeating cross-sectional studies. Longitudinal studies follow the same group of students over time; for example, from kindergarten through fifth grade. These studies can show achievement gains in a particular subject from grade to grade. Repeating cross-sectional studies provide a snapshot of how certain students perform in a particular year and then take another snapshot of a similar group of students in a later year; for example, comparing fourth graders in 1990 to fourth graders in 2005.
Performance as Students Progress Through Elementary School
The Early Childhood Longitudinal Study (ECLS) followed a group of students who entered kindergarten in fall 1998 until spring 2004, when most were in fifth grade.[2] The 2006 volume of Science and Engineering Indicators provided data from ECLS through third grade (NSB 2006). Those indicators showed that mathematics achievement differences among subpopulations already existed when students entered kindergarten. Although all groups made gains by third grade, some gaps widened over the 4-year period (Rathbun, West, and Germino Hausken 2004). This volume updates those indicators of early mathematics learning to fifth grade. It also presents the first longitudinal data from ECLS on science learning, from third through fifth grade.
Mathematics: Fifth Grade Performance
The ECLS mathematics assessments provide indicators of student proficiency in nine specific skill areas that represent a progression of skills and knowledge (see sidebar "Mathematics Skills Areas for Elementary Grade Students"). This volume of Science and Engineering Indicators focuses on the skill areas assessed in fifth grade, whereas the 2006 volume focused on the lower-order skill areas assessed in kindergarten through third grade.
By the end of fifth grade, almost all students (92%) could solve simple multiplication and division problems, and about three-quarters demonstrated understanding of place value in integers to the hundreds place
Mathematics: Achievement Gaps During Elementary School
Fifth grade mathematics performance was related to several student background factors (Princiotta, Flanagan, and Germino Hausken 2006). For each of the mathematics skill levels mentioned above, lower proportions of black and Hispanic students were proficient compared with their white and Asian peers
Although many of these mathematics achievement differences were evident when these children started kindergarten, the ECLS data suggest that at least some gaps widened as students progressed through elementary school, and that other gaps, such as those between boys and girls, emerged that were not present when students started school (Princiotta, Flanagan, and Germino Hausken 2006; Rathbun, West, and Germino Hausken 2004). Changes in achievement gaps are most easily summarized by examining average scale scores, which place students on a continuous ability scale based on their overall performance. Results indicate that all demographic groups gain mathematical skills and knowledge during elementary school but the rate of progress varies.
Gender Gaps. Boys and girls started kindergarten at the same overall mathematics performance level
Race/Ethnicity Gaps. Gaps between white and black students and between white and Hispanic students existed when students started kindergarten and they widened over time. In mathematics, from kindergarten to fifth grade, white students posted a gain of 93 points; Hispanics, a gain of 89 points; and blacks, a gain of 80 points
Mother's Education and Family Income Gaps. Students whose mothers had higher levels of education entered kindergarten with higher average mathematics scores than their peers whose mothers attained less formal education and these gaps increased as students progressed through elementary school
Other research suggests that widening achievement gaps as students progress through school are, at least in part, a result of differential learning growth and loss during the summer (Alexander, Entwisle, and Olson 2001; Borman and Boulay 2004; Cooper et al. 1996). For example, although lower- and upper-income primary grade students made similar gains in mathematics during the school year, lower-income students experienced declines in mathematics skills during summer breaks, whereas higher-income students experienced gains (Alexander, Entwisle, and Olson 2001). These findings have been attributed to greater ability among higher-income parents to provide their children with mathematically stimulating materials and activities during the summer.
Science: Performance Gains and Gaps From Third to Fifth Grade
ECLS began assessing students in science in the third grade and tested those students' science knowledge again in fifth grade (Princiotta, Flanagan, and Germino Hausken 2006; Rathbun, West, and Germino Hausken 2004). The science assessments placed equal emphasis on life science, earth and space science, and physical science, asking students to demonstrate understanding of the physical and natural world, make inferences, and understand relationships. Assessments also required students to interpret scientific data, form hypotheses, and develop plans to investigate scientific questions. ECLS science assessments were not designed to measure proficiency in specific skill areas and therefore do not lend themselves to proficiency levels; results are instead summarized by average scale scores.
Gains in science skills and knowledge between third and fifth grade were seen across each demographic group, but performance gaps persisted
Third graders whose mothers had more formal education performed better in science than did their peers with mothers who were less educated, and students who lived above the poverty threshold did better in science than those who lived below it
Mathematics Performance as Students Progress Through High School
Another longitudinal study, the Education Longitudinal Study (ELS), provides indicators of student learning during high school by following a nationally representative sample of students who were in 10th grade in 2002 (NCES 2007a). These students were assessed again in 2004 in 12th grade. ELS includes an assessment of student performance in mathematics, which provides information both on specific skills and on overall mathematics performance. The specific skills are divided into levels representing a progression of mathematics skills: (1) simple arithmetical operations with whole numbers; (2) simple operations with decimals, fractions, powers, and roots; (3) simple problem solving requiring the understanding of low-level mathematical concepts; (4) understanding of intermediate-level mathematical concepts and multistep solutions to word problems; and (5) complex multistep word problems and advanced mathematics material (NCES 2007a).
In 2004, almost all 12th grade students (96%) were proficient in simple arithmetical operations with whole numbers and 79% were also proficient in simple operations with decimals, fractions, roots, and powers
Each demographic subgroup examined improved in mathematics skills from 10th to 12th grade, but achievement disparities were evident. The ECLS data reviewed in the previous section found that boys and girls entered kindergarten with similar overall mathematics performance, but by the fifth grade, boys demonstrated slightly higher performance. This small gender gap favoring boys was also observed in the 10th and 12th grades in ELS, with the gap holding steady between those 2 years
Substantial differences among racial/ethnic groups were found in mathematics achievement at grade 10, with white and Asian/Pacific Islander students posting higher average scores than black and Hispanic students, and Hispanic students scoring slightly higher than black students
The mathematics skill gaps observed in kindergarten (and found to be greater in fifth grade) between students whose mothers had lower levels of education compared with students whose mothers were more educated were evident among ELS 10th graders
Performance of 4th, 8th, and 12th Grade Students Since the 1990s
The two longitudinal studies described above showed that students start school with different levels of knowledge and skills and that some of those differences grow as the same students move through the educational system. Notably, none of the achievement gaps reviewed above between historically privileged and underprivileged groups narrowed during elementary or high school.
Another type of assessment, a well-known repeating cross-sectional study, provided indicators that showed a somewhat more positive trend. As will be detailed below, fourth and eighth grade students in 2005 (including most subgroups) performed better on mathematics tests on average than fourth and eighth graders a decade and a half earlier. However, fewer gains were observed in science and substantial achievement gaps among subgroups of students in these grades persisted in both mathematics and science.
The National Assessment of Educational Progress (NAEP), also known as the "Nation's Report Card," has charted the academic performance of U.S. students in the upper elementary and secondary grades since 1969. Previous Science and Engineering Indicators reports described trends in mathematics and science results dating back to the first NAEP assessments.[5] This volume focuses on more recent trends, from 1990 to 2005 for mathematics (grades 4 and 8) and from 1996 to 2005 for science (grades 4, 8, and 12) (NCES 2006a, b). Twelfth graders were assessed in mathematics in 2005 but the assessment was not comparable with previous NAEP assessments, and therefore trend data are not available for grade 12 mathematics.[6]
The NAEP assessments are based on frameworks developed through a national consensus process that involves educators, policymakers, assessment and curriculum experts, and the public. The frameworks are then approved by the National Assessment Governing Board (NAGB) (NCES 2006a, 2007b). The mathematics grades 4 and 8 assessments contain five broad content strands (number sense, properties, and operations; measurement; geometry and spatial sense; data analysis, statistics and probability; and algebra and functions). The mathematics grade 12 assessment contains four content strands that are similar to the grade 4 and 8 strands, but with measurement and geometry collapsed together. The science framework includes a content dimension divided into three major fields of science: earth, life, and physical.
Student performance on the NAEP is measured with scale scores as well as achievement levels. Scale scores place students on a continuous ability scale based on their overall performance. For grades 4 and 8, the mathematics scales range from 0 to 500 across the two grades. For grade 12, the mathematics scale ranges from 0 to 300. For science, the scales range from 0 to 300 for each of the three grades.
Achievement levels are set by NAGB based on recommendations from panels of educators and members of the public, and describe what students should know and be able to do at the basic, proficient, and advanced levels for each grade (NCES 2006b and 2007b). The basic level represents partial mastery, proficient represents solid academic performance, and advanced represents superior performance on assessments measuring mastery of knowledge and skills for each grade level. This review of NAEP results focuses on the percentage of students deemed proficient (for more detailed definitions of the proficient levels, see Science and Engineering Indicators 2006, pp. 1–13 and 1–14 [NSB 2006 and NCES 2007b]).
Disagreement exists about whether NAEP has appropriately defined these levels. A study commissioned by the National Academy of Sciences judged the process used to set these levels "fundamentally flawed" (Pellegrino, Jones, and Mitchell 1998), and NAGB acknowledges that considerable controversy remains over setting achievement levels (Bourque and Byrd 2000). However, both the National Center for Education Statistics (NCES) and NAGB believe the levels are useful for understanding trends in achievement. They warn readers to use and interpret the levels with caution (NCES 2006b).
In this section, NAEP results are examined in various ways, including changes in average scale scores and in the proportion of students reaching the proficient level both overall and among various subgroups of students. In addition, achievement gaps between demographic subpopulations and changes in those gaps are reviewed.
Examining a set of measures reveals more about student performance than does examining just one measure (Barton 2004). For example, without examining changes in achievement for high-, middle-, and low-achieving students, it would be impossible to know whether a rise in average scores resulted from increased scores among one or a few groups of students, or whether it reflected broader improvements.
Mathematics Performance From 1990 to 2005
The average mathematics scores of fourth and eighth grade students have steadily increased since 1990 (the first year in which the current assessment was given), including small improvements during the more recent period 2003–05 (NCES 2006a)
Examining trends for students at the lower, middle, and higher ranges of performance can uncover whether overall trends are driven by changes in only one or two of these groups. However, NAEP mathematics results indicate that the overall increase in mathematics performance was not driven by students at any one performance level
The percentage of students reaching the proficient level for their grade also rose
Mathematics Performance From 2005 to 2007
The NAEP 2007 fourth and eighth grade mathematics assessment results were released too late to incorporate more than a brief summary in this volume. Both fourth and eighth grade students registered continued improvements in mathematics achievement between 2005 and 2007 (Lee, Grigg, and Dion 2007). Improvements occurred across all performance percentiles and income levels in both grades. Among fourth graders, scores increased for whites, blacks, Hispanics, and Asians/Pacific Islanders but no significant increase could be reported for American Indians/Alaska Natives because of insufficient sample size. Among eighth graders, whites, blacks, and Hispanic students improved their scores but Asians/Pacific Islanders and American Indians/Alaska Natives registered no gain. The percentage of students scoring at or above proficient in both grades increased from 36% to 39% among fourth graders and 30% to 32% among eighth graders.
Although most groups showed improved performance from 2005 to 2007, performance gaps were resistant to improvement. In the fourth grade, the white-black and white-Hispanic gaps did not change between 2005 and 2007. In the eighth grade, the white-black gap decreased but the white-Hispanic gap remained about the same.
Science Performance From 1996 to 2005
Since 1996, the first year the current NAEP science assessment was given, average scores increased for 4th graders, held steady for 8th graders, and declined for 12th graders
The proportion of students reaching the proficient level for their grade in science did not change for grades 4 and 8, and declined slightly for grade 12
Changes in Achievement Gaps Since the 1990s
The longitudinal studies outlined in the beginning of this chapter reveal racial/ethnic gaps in mathematics and science performance as students start kindergarten, some of which grow as students progress through elementary and high school. NAEP, with snapshots of three grades over time, paints a slightly different picture. Since 1990, the white-black gap in mathematics achievement decreased among fourth graders and held steady for eighth graders
In 2005, boys in grades 4, 8, and 12 performed slightly better than girls in both mathematics and science
International Comparisons of Mathematics and Science Performance
Two assessments help compare mathematics and science performance in the United States to other countries: the Trends in International Mathematics and Sciences Study (TIMSS) and the Program for International Student Assessment (PISA). Results from the most recent administration of these assessments are included in more detail in Science and Engineering Indicators 2006 and are only summarized here.
In 2003, U.S. students scored above international averages on the TIMSS assessment and below international averages on the PISA assessment, differences that may be explained, in part, by each test's focus and the set of countries participating in each assessment (Neidorf et al. forthcoming). TIMSS tests primary and middle grade students on curriculum-based knowledge and skills. PISA tests 15-year-olds on their ability to apply scientific and mathematical concepts and thinking skills to real-world problems. Although TIMSS includes results from 46 industrialized and developing countries, PISA results reported here include 30 countries, all of which are industrialized.
According to TIMSS data, U.S. fourth and eighth graders performed above the international average in mathematics and science in 2003 (Gonzales et al. 2004). However, because TIMSS includes many developing countries in its international average, it also can be helpful to compare U.S. performance to two similarly industrialized countries, the United Kingdom and Japan. Japan outperformed U.S. fourth and eighth graders in both mathematics and science. The United Kingdom outperformed U.S. fourth graders in both subjects, but had insufficient numbers participating in eighth grade to make a comparison. According to PISA results, U.S. 15-year-olds performed below the average for industrialized countries in both mathematics and science (Lemke et al. 2004). Of 30 participating industrialized nations, 20 outperformed the United States in mathematics and 15 outperformed it in science (see sidebar "Achievement Negatively Correlated With Confidence in Learning Across Countries/Economies").
Summary
Two national longitudinal studies found that students enter kindergarten with varied mathematics knowledge and skills, and all groups made gains during elementary and high school but at different rates. The result is that most mathematics achievement gaps remain, or have grown, by the time students graduate from high school. The national longitudinal data for science report achievement gaps in third grade (the first time students are assessed) and gains among all groups from third to fifth grade, but also no narrowing and even some widening of the achievement gaps over this 2-year period.
Repeating cross-sectional studies of mathematics and science performance provide different types of indicators. In 2005, students in grades 4 and 8 posted higher mathematics scores than students in those same grades in 1990. The pattern of higher scores was widespread, occurring among males and females, across racial/ethnic groups, for students from financially advantaged and disadvantaged families, and for students in the lower, middle, and higher ranges of performance. Additionally, some achievement gaps narrowed. In science, average scores increased for fourth grade students, held steady for eighth graders, and declined for 12th graders between 1996 (the first year the assessments were given) and 2005. Trends in percentile scores suggest the increase in overall science scores of fourth graders were driven by improved scores among lower- and middle-performing students.
Despite the gains made in mathematics (and to a lesser extent, science) from the 1990s to 2005, most 4th, 8th, and 12th graders do not perform at levels considered proficient for their grade. Just more than one-third of fourth graders reached the proficient level in mathematics in 2005, and the rates were lower for mathematics at grades 8 and 12, and at all three grades for science. International comparisons of student mathematics and science performance indicate U.S. students perform below average in mathematics and science for industrialized countries.
Notes
[2] In the 2004 followup for the ECLS kindergarten class of fall 1998, 86% of cohort members were in fifth grade, 14% were in a lower grade, and less than 1% were in a higher grade. For the sake of simplicity, students in the ECLS followups are referred to by the expected grade; that is, they are referred to as first graders in the spring 2000 assessment, as third graders in the spring 2003 assessment, and as fifth graders in the spring 2004 assessment.
[3] The poverty status variable in ECLS is based on information provided by the parent. The variable is derived from household income and total number of household members (Princiotta, Flanagan, and Germino Hausken 2006). Federal poverty thresholds are used to define households below the poverty level. For example, if a household contained two members, and the household income was lower than $12,015, the student was considered to be living below the poverty threshold.
[4] Socioeconomic status was based on five equally weighted components: father's education, mother's education, family income, father's occupational prestige score, and mother's occupational prestige score.
[5] NAEP consists of three assessment programs. The long-term trend assessment is based on nationally representative samples of 9-, 13-, and 17-year-olds. It has remained the same since it was first given in 1969 in science and 1973 in mathematics, permitting analyses of trends over three decades. A second testing program, the national or main NAEP, assesses national samples of 4th, 8th, and 12th grade students. The national assessments are updated periodically to reflect contemporary standards of what students should know and be able to do in a subject. The third program, the state NAEP, is similar to the national NAEP but involves representative samples of students from participating states.
[6] These recent trends are based on data from the national NAEP program. The current national mathematics assessment for grades 4 and 8 was first administered in 1990 and was given again in 1992, 1996, 2000, 2003, and 2005. In 2003, only fourth and eighth grade students were assessed. The current grade 12 mathematics assessment has only been administered once: in 2005. Trend analyses for grade 12 mathematics are therefore not available. The current national science assessment was first administered in 1996 and was given again in 2000 and 2005.
[7] Although the NAEP program collects information about eligibility for the free or reduced-price lunch program for grade 12 students, it does not report these data. Because other reasons for not applying for school lunch programs (including food preferences, ability to buy lunch outside school, and wanting to avoid embarrassment) generally increase with student age, program eligibility becomes an increasingly unreliable indicator of poverty at higher grade levels. For example, approximately 35%–45% of fourth grade and 30%–40% of eighth grade public school students have been eligible in recent years for the subsidized lunch program. In contrast, only about 15%–25% of 12th grade public school students have been eligible (determined using the online NAEP Data Explorer tool at http://www.nces.ed.gov/nationsreportcard/naepdata/). The relatively low percentage of grade 12 students noted as eligible for the program raises concerns that it is not a reliable indicator of low family income for these students.
[8] Insufficient sample size in 1990 for Asian/Pacific Islanders and American Indians/Alaska Natives precluded calculation of reliable estimates for this group. Increases in average scores for Asian/Pacific Islanders in grades 4 and 8 were observed between 2003 and 2005. Scores increased for grade 4 American Indians/Alaska Natives between 2003 and 2005, but not for grade 8 American Indians/Alaska Natives.