The Convergent Validity of Expert System Scores for Complex Constructed-Response Quantitative Items

Bennett, Randy E.; Sebrechts, Marc M.; Rock, Donald A.
Publication Year:
Report Number:
GREB-88-07bP (1991)
Applied Psychological Measurement, 1991, 15(3), 227-239.
Document Type:
Subject/Key Words:
Computer software constructed responses evaluation methods expert systems scoring validity studies


This study investigated the convergent validity of expert-system scores for four mathematical constructed-response item formats. A five-factor model was posed comprised of four constructed-response format factors and a GRE General Test quantitative factor. Confirmatory factor analysis was used to test the fit of this model and to compare it with several alternatives. The five-factor model fit well, although a solution comprised of two highly correlated dimensions--GRE-quantitative and constructed-response--represented the data almost as well. These results extend the meaning of the expert system's constructed-response scores by relating them to a well-established quantitative measure and by indicating that they signify the same underlying proficiency across item formats.

Read More


Find a Publication

Advanced Search

Closing the Achievement Gap

Closing the Achievement GapLearn more about ETS's commitment to closing the achievement gap through rigorous research, thought-provoking forums and more.