An Analysis of Similarities in Item Functioning Within Antonym and Analogy Variant Families

Author(s):
Scrams, David J.; Mislevy, Robert J.; Sheehan, Kathleen M.
Publication Year:
2002
Report Number:
RR-02-13
GREB-95-17aP
Source:
Document Type:
Subject/Key Words:
Computerized adaptive testing expected response function item calibration item response theory item variants

Abstract

This study examined the potential advantages of using item variants -- sets of related test items based on a common template or schema -- to offset the increased item-production demands associated with continuous computer-based testing in high-stakes assessments. Empirical results showed that the calibrated difficulty parameters of analogy and antonym item variants that had been used in operational administrations of the Graduate Record Examinations (GRE) General Test were very similar. Results of a simulation study that considered precision losses within a linear testing framework projected precision losses of less than 10% for estimating examinee abilities from responses to variants when using expected response functions based just on variant-family information, compared to using true item response theory parameters for individual items.

Read More