An Investigation of Approaches to Computerizing the GRE Subject Tests

Stocking, Martha L.; Smith, Robert; Swanson, Len
Publication Year:
Report Number:
Document Type:
Subject/Key Words:
Computer-based testing computerized adaptive testing linear on the fly testing achievement tests simulation studies


In this project, the authors explored the application of two common, computer-based test (CBT) designs, computerized adaptive testing (CAT) and linear-on-the-fly testing (LOFT) to two Graduate Record Examinations (GRE) Subject Tests chosen to represent the range of different test structures: the GRE Mathematics Test and the GRE Biology Test. The results were mixed. Some variations proved adequate in meeting minimum psychometric requirements. However, no variation proved adequate in the implementation of a complete test blueprint, nor did any variation provide strong support for meeting test security requirements in an environment of unrestricted continuous testing. The conversion of the GRE Subject Tests from paper-and- pencil administration to a computer-based testing format seems viable only if pretesting is implemented, item writing is expanded, test length is reduced, classification schemes are improved, and the roles of test specialists and the Committees of Examiners are substantially revised.

Read More


Find a Publication

Advanced Search

Closing the Achievement Gap

Closing the Achievement GapLearn more about ETS's commitment to closing the achievement gap through rigorous research, thought-provoking forums and more.