angle-up angle-right angle-down angle-left close user menu open menu closed search globe bars phone store

Development of a SIBTEST Bundle Methodology for Improving Test Equity With Applications for GRE Test Development

Author(s):
Stout, William; Bolt, Dan; Froelich, Amy Goodwin; Habing, Brian; Hartz, Sarah; Roussos, Louis
Publication Year:
2003
Report Number:
GRE Board Report 98-15P, GREB-98-15P, RR-03-06
Source:
ETS Research Report
Document Type:
Report
Page Count:
76
Subject/Key Words:
Differential Bundle Functioning Differential Item Functioning (DIF) General Test (GRE) Multidimensionality-Based DIF Paradigm SIBTEST Test Development Test Equity

Abstract

The purpose of this study was to develop a differential-item-functioning (DIF)/impact methodology capable of accurately isolating underlying, conceptually-based causes of DIF (differing item performances across examinee groups that are matched on ability) and impact (differing item performances across examinee groups that are not matched on ability) using data from the quantitative section of two administrations of the Graduate Record Examinations (GRE) General Test. Analyses indicate that the "SIBTEST bundle methodology" that was developed in the study for GRE quantitative forms is effective and, as such, is exportable to various Educational Testing Service (ETS) settings. This methodology should help improve test equity of future GRE quantitative forms, as well as test development and standardized tests in general. The developed methodology elevates statistically based DIF analyses from the mere screening of already manufactured items to the modification of test specifications and subsequent test test construction processes.

Read More