skip to main content skip to footer

Assessing Fit of Models With Discrete Proficiency Variables in Educational Assessment MCMC PPMC

Author(s):
Sinharay, Sandip; Almond, Russell G.; Yan, Duanli
Publication Year:
2004
Report Number:
RR-04-07
Source:
ETS Research Report
Document Type:
Report
Page Count:
49
Subject/Key Words:
Bayesian Methods, Bayesian Residual, Item Fit, Markov Chain Monte Carlo (MCMC), Model Fit, Person-Fit, Posterior Predictive Model Checking (PPMC) Method

Abstract

This work is a continuation of the recent work by Yan, Mislevy, and Almond (2003) on this data set. Two diagnostic tools that prove useful are Bayesian residual plots and an analog of the item characteristic curve (ICC) plots. A two-type statistic based on the latter plot shows some promise, but more work is required to establish the null distribution of the statistic. On the basis of the identified problems with the model used by Mislevy (1995), the suggested diagnostics are helpful to hypothesize an improved model that seems to fit better.

Read More