skip to main content skip to footer

Variance Estimation for NAEP Data Using a Resampling-Based Approach: An Application of Cognitive Diagnostic Models NAEP GDM

Author(s):
Hsieh, Chueh-an; Xu, Xueli; von Davier, Matthias
Publication Year:
2010
Report Number:
RR-10-26
Source:
ETS Research Report
Document Type:
Report
Page Count:
17
Subject/Key Words:
National Assessment of Educational Progress (NAEP), Jackknife Estimation, General Diagnostic Model (GDM), Variance Estimation, Plausible Values Approach

Abstract

This paper presents an application of a jackknifing approach to variance estimation of ability inferences for groups of students, using a multidimensional discrete model for item response data. The data utilized to demonstrate the approach come from the National Assessment of Educational Progress (NAEP). In contrast to the operational approach used in NAEP, where plausible values are used to make ability inferences, the approach presented in this paper reestimates all parameters of the model, and makes ability inferences based on replicate samples of the jackknife without using plausible values. Results of the standard errors are presented for estimates of group means, total means, and other statistics used in official reporting by NAEP. Differences in results between this approach and the operational approach are discussed.

Read More