angle-up angle-right angle-down angle-left close user menu open menu closed search globe bars phone store

An Analysis of Similarities in Item Functioning Within Antonym and Analogy Variant Families

Author(s):
Scrams, David J.; Mislevy, Robert J.; Sheehan, Kathleen M.
Publication Year:
2002
Report Number:
GREB-97-17aP, RR-02-13
Source:
ETS Research Report
Document Type:
Report
Page Count:
14
Subject/Key Words:
Computerized Adaptive Testing (CAT) Expected Response Function Graduate Record Examination (GRE) Item Calibration Item Response Theory (IRT) Item Varients

Abstract

This study examined the potential advantages of using item variants -- sets of related test items based on a common template or schema -- to offset the increased item-production demands associated with continuous computer-based testing in high-stakes assessments. Empirical results showed that the calibrated difficulty parameters of analogy and antonym item variants that had been used in operational administrations of the Graduate Record Examinations (GRE) General Test were very similar. Results of a simulation study that considered precision losses within a linear testing framework projected precision losses of less than 10% for estimating examinee abilities from responses to variants when using expected response functions based just on variant-family information, compared to using true item response theory parameters for individual items.

Read More