A Comparison of Open-Ended and Multiple-Choice Question Formats for the Quantitative Section of the Graduate Record Examinations General Test

Bridgeman, Brent
Publication Year:
Report Number:
Document Type:
Subject/Key Words:
Test format constructed response item types


Free-response counterparts to a set of items from the quantitative section of the Graduate Record Examinations General Test were developed. Examinees responded to these items by gridding numerical answers on a machine-readable answer sheet in essentially the same way social security numbers are now gridded. In addition, the answer grid included special symbols for a negative sign (-), a decimal point (.), a division sign (/), and a variable (k). The test section with the special answer sheet was administered at the end of a regular GRE administration. Correct and incorrect answers chosen in the multiple-choice format were compared with the answers generated in the free-response format. Three- parameter item characteristic curves were compared, as were correlational patterns with other test scores and undergraduate grade point average. Format by gender and format by ethnicity (Asian American, Black, Hispanic, and White) interactions were explored with analyses of covariance. Despite the format differences noted for individual items, total scores for the multiple-choice and free-response tests demonstrated remarkably similar correlational patterns, and there were no significant interactions of test format with either gender or ethnicity.

Read More


Find a Publication

Advanced Search

Closing the Achievement Gap

Closing the Achievement GapLearn more about ETS's commitment to closing the achievement gap through rigorous research, thought-provoking forums and more.