skip to main content skip to footer

Analysis of Differential Item Functioning in the NAEP History Assessment NAEP

Author(s):
Zwick, Rebecca J.; Ercikan, Kadriye
Publication Year:
1988
Report Number:
RR-88-66
Source:
ETS Research Report
Document Type:
Report
Page Count:
31
Subject/Key Words:
Achievement Tests, Item Analysis, National Assessment of Educational Progress (NAEP), United States History

Abstract

The Mantel-Haenszel approach for investigating differential item functioning (DIF) was applied to U.S. history items that were administered as part of the National Assessment of Educational Progress (NAEP). On some items, Black, Hispanic, and female examinees performed more poorly than other students, conditional on number-right score. It was hypothesized that this resulted in part from the fact that ethnic and gender groups differed in their exposure to the material included in the assessment. Supplementary Mantel-Haenszel analyses were undertaken in which the number of historical periods studied, as well as score, was used as a conditioning variable. Contrary to expectation, the additional conditioning did not lead to a reduction in the number of DIF items. Both methodological and substantive explanations for this unexpected result were explored. (31pp.)

Read More