skip to main content skip to footer

The Pseudo-Equivalent Groups Approach as an Alternative to Common-Item Equating PE

Author(s):
Kim, Sooyeon; Lu, Ru
Publication Year:
2018
Report Number:
RR-18-02
Source:
ETS Research Report
Document Type:
Report
Page Count:
15
Subject/Key Words:
Pseudo-Equivalent Groups, Common Item Equating, Poststratification Equating (PE), Equipercentile Linking, Chain Equipercentile Equating, Background

Abstract

The purpose of this study was to evaluate the effectiveness of linking test scores by using test takers’ background data to form pseudoequivalent groups (PEG) of test takers. Using 4 operational test forms that each included 100 items and were taken by more than 30,000 test takers, we created 2 half-length research forms that had either 20 (strong anchor) or 10 (weak anchor) items in common. Because the 2 research forms were assembled from a single form that had been administered in a large-scale operational testing setting, we obtained the direct equating function between the 2 research forms through the single-group design and treated it as a criterion or true equating function between the 2 research forms. We equated the 2 research forms in a common-item design using the poststratification equipercentile (PSE) and chained equipercentile (CHEQ) methods, and then compared the common-item results to the results derived from the PEG linking. Because the new and reference groups differed substantially in ability, by study design, the CHEQ method produced more accurate results than did the PSE method in both the strong and weak anchor conditions. CHEQ using 10 common items was as effective as PSE using 20 common items. PSE using 10 common items produced the least accurate results among the five methods. The PEG linking produced more accurate results compared to the PSE method using the weak anchor.

Read More