skip to main content skip to footer

Dealing With Uncertainty About Item Parameters: Expected Response Functions IRT ERF

Author(s):
Mislevy, Robert J.; Sheehan, Kathleen M.; Wingersky, Marilyn S.
Publication Year:
1994
Report Number:
RR-94-28-ONR
Source:
ETS Research Report
Document Type:
Report
Page Count:
53
Subject/Key Words:
Office of Naval Research, Bayesian Statistics, Item Parameter Estimation, Item Response Theory (IRT)

Abstract

It is a common practice in item response theory (IRT) to treat estimates of item parameters, say ^B, as if they were the known, true quantities, B. However, ignoring the uncertainty associated with item parameters can lead to biases and overconfidence in subsequent inferences such as ability estimation, especially when item-calibration samples are small. This paper demonstrates how to incorporate uncertainty about B with Lewis's "expected response function" (ERFs), pointwise expected values of item response conditional on examinee proficiency averaged over posterior distributions of item parameters. This paper presents ERFs, outlines procedures for computing them and using them in practical work, and gives an illustration with data from the National Assessment of Educational Progress. Advantages of approximating ERFs response curves with members of familiar parametric families of IRT curves are noted. (53pp.)

Read More