An Investigation of Approaches to Computerizing the GRE Subject Tests

Author(s):
Stocking, Martha L.; Smith, Robert; Swanson, Len
Publication Year:
2000
Report Number:
RR-00-04
GREB-93-08P
Source:
Document Type:
Subject/Key Words:
Computer-based testing computerized adaptive testing linear on the fly testing achievement tests simulation studies

Abstract

In this project, the authors explored the application of two common, computer-based test (CBT) designs, computerized adaptive testing (CAT) and linear-on-the-fly testing (LOFT) to two Graduate Record Examinations (GRE) Subject Tests chosen to represent the range of different test structures: the GRE Mathematics Test and the GRE Biology Test. The results were mixed. Some variations proved adequate in meeting minimum psychometric requirements. However, no variation proved adequate in the implementation of a complete test blueprint, nor did any variation provide strong support for meeting test security requirements in an environment of unrestricted continuous testing. The conversion of the GRE Subject Tests from paper-and- pencil administration to a computer-based testing format seems viable only if pretesting is implemented, item writing is expanded, test length is reduced, classification schemes are improved, and the roles of test specialists and the Committees of Examiners are substantially revised.

Read More