skip to main content skip to footer

Missing Responses and IRT Ability Estimation: Omits, Choice, Time Limits, and Adaptive Testing IRT

Author(s):
Mislevy, Robert J.; Wu, Pao-Kuei
Publication Year:
1996
Report Number:
RR-96-30-ONR
Source:
ETS Research Report
Document Type:
Report
Page Count:
53
Subject/Key Words:
Office of Naval Research, Ability Identification, Adaptive Testing, Item Choice, Item Response Theory (IRT), Omitted Responses, Parameter Estimation, Timed Tests

Abstract

The basic equations of item response theory (IRT) provide a foundation for inferring examinees' abilities from responses to different test items. In practice, examinees do not generally provide a response to all items for reasons that may or may not have been intended by the test administrator, and that may or may not be related to their ability. The mechanisms that produce missingness must be taken into account if correct inferences are to be drawn. Using concepts introduced by Rubin (1976), we discuss the implications for Bayesian and direct likelihood ability parameter estimation that are entailed by alternate test forms, targeted testing, adaptive testing, time limits, omitted responses, and examinee choice of tasks. Attention is focused on whether, in each case, the mechanism for missingness is "ignorable," and, in those cases in which it is not, how it can be modeled. (53pp.)

Read More