ETS Contributions to the Quantitative Assessment of Item, Test, and Score Fairness

Author(s):
Dorans, Neil J.
Publication Year:
2013
Report Number:
RR-13-27, SPC-13-04
Source:
ETS Research Report
Document Type:
Report
Page Count:
47
Subject/Key Words:
fairness, differential prediction, differential item functioning, score equity assessment, ETS, quantitative methods

Abstract

Quantitative fairness procedures have been developed and modified by ETS staff over the past several decades. ETS has been a leader in fairness assessment, and its efforts are reviewed in this report. The first section deals with differential prediction and differential validity procedures that examine whether test scores predict a criterion, such as performance in college, across different subgroups in a similar manner. The bulk of this report focuses on item level fairness, or differential item functioning, which is addressed in the various subsections of the second section. In the third section, I consider research pertaining to whether tests built to the same set of specifications produce scores that are related in the same way across different gender and ethnic groups. Limitations with the approaches reviewed here are discussed in the final section.

Read More