skip to main content skip to footer

Population Invariance and the Equatability of Tests: Basic Theory and the Linear Case

Author(s):
Dorans, Neil J.; Holland, Paul W.
Publication Year:
2000
Report Number:
RR-00-19
Source:
ETS Research Report
Document Type:
Report
Page Count:
37
Subject/Key Words:
Statistical Analysis, Equated Scores, Item Analysis, Test Theory, Test Construction

Abstract

Equating functions are supposed to be population invariant by definition. But when two tests are not equatable, it is possible that the linking functions, used to connect the scores of one to the scores of the other, are not invariant across different populations of examinees. The authors introduce two root-mean-square difference measures of the degree to which linking function are different for different subpopulations. The authors also introduce the system of "parallel-linear" linking functions for multiple subpopulations and show that, for this system, their measure of population invariance can be easily computed from the standardized mean differences between the scores of the subpopulations on the two tests. For the parallel- linear case, the authors develop a correlation-based upper bound on their measure.

Read More