skip to main content skip to footer

Equating of Mixed-Format Tests in Large-Scale Assessments CR MC

Author(s):
Kim, Sooyeon; Walker, Michael E.; McHale, Frederick J.
Publication Year:
2008
Report Number:
RR-08-26
Source:
ETS Research Report
Document Type:
Report
Page Count:
26
Subject/Key Words:
Equating, Anchor Test Study, Multiple-Choice Items, Constructed-Response Items, Large-Scale Assessment

Abstract

This study examined variations of the nonequivalent-groups equating design for mixed-format tests—tests containing both multiple-choice (MC) and constructed-response (CR) items—to determine which design was most effective in producing equivalent scores across the two tests to be equated. Four linking designs were examined: (a) an anchor with only MC items; (b) a mixed-format anchor containing both MC and CR items; (c) a mixed-format anchor incorporating CR item rescoring; and (d) a hybrid combining single-group and equivalent-groups designs, thereby avoiding the need for an anchor test. Designs using MC items alone or those using a mixed anchor without CR item rescoring resulted in much larger bias than the other two design approaches. The hybrid design yielded the smallest root mean squared error value.

Read More