angle-up angle-right angle-down angle-left close user menu open menu closed search globe bars phone store

The Convergent Validity of Expert System Scores for Complex Constructed-Response Quantitative Items

Author(s):
Bennett, Randy Elliot; Sebrechts, Marc M.; Rock, Donald A.
Publication Year:
1991
Report Number:
RR-91-12
Source:
ETS Research Report
Document Type:
Report
Page Count:
50
Subject/Key Words:
Computer Software Constructed Responses Evaluation Methods Expert Systems General Test (GRE) Graduate Record Examinations (GRE) Graduate Record Examinations Board Scoring Validity Studies

Abstract

This study investigated the convergent validity of expert-system scores for four mathematical constructed-response item formats. A five-factor model was posed comprised of four constructed-response format factors and a GRE General Test quantitative factor. Confirmatory factor analysis was used to test the fit of this model and to compare it with several alternatives. The five-factor model fit well, although a solution comprised of two highly correlated dimensions--GRE-quantitative and constructed-response--represented the data almost as well. These results extend the meaning of the expert system's constructed-response scores by relating them to a well-established quantitative measure and by indicating that they signify the same underlying proficiency across item formats.

Read More