Items by Design: The Impact of Systematic Feature Variation on Item Statistical Characteristics

Author(s):
Enright, Mary K.; Morley, Mary; Sheehan, Kathleen M.
Publication Year:
1999
Report Number:
RR-99-20, GREB-95-15R
Source:
Document Type:
Subject/Key Words:
Algebra data analysis item analysis item characteristics mathematics skills reasoning ability word problems mathematics

Abstract

This study investigated the impact of systematic item feature variation on item statistical characteristics and the degree to which such information could be used as collateral information to supplement examinee performance data and reduce pretest sample size. Two families of word problem variants for the quantitative section of the Graduate Record Examinations® (GRE®) General Test were generated by systemically creating item variants. However, questions of how best to manage variants in item pools and to implement statistical procedures that use collateral information must still be resolved.

Read More