Development of a SIBTEST Bundle Methodology for Improving Test Equity With Applications for GRE Test Development
- Author(s):
- Stout, William; Bolt, Dan; Froelich, Amy Goodwin; Habing, Brian; Hartz, Sarah; Roussos, Louis
- Publication Year:
- 2003
- Report Number:
- GRE Board Report 98-15P, GREB-98-15P, RR-03-06
- Source:
- ETS Research Report
- Document Type:
- Report
- Page Count:
- 76
- Subject/Key Words:
- Differential Bundle Functioning Differential Item Functioning (DIF) General Test (GRE) Multidimensionality-Based DIF Paradigm SIBTEST Test Development Test Equity
Abstract
The purpose of this study was to develop a differential-item-functioning (DIF)/impact methodology capable of accurately isolating underlying, conceptually-based causes of DIF (differing item performances across examinee groups that are matched on ability) and impact (differing item performances across examinee groups that are not matched on ability) using data from the quantitative section of two administrations of the Graduate Record Examinations (GRE) General Test. Analyses indicate that the "SIBTEST bundle methodology" that was developed in the study for GRE quantitative forms is effective and, as such, is exportable to various Educational Testing Service (ETS) settings. This methodology should help improve test equity of future GRE quantitative forms, as well as test development and standardized tests in general. The developed methodology elevates statistically based DIF analyses from the mere screening of already manufactured items to the modification of test specifications and subsequent test test construction processes.
Read More
- Request Copy (specify title and report number, if any)
- http://dx.doi.org/10.1002/j.2333-8504.2003.tb01898.x