skip to main content skip to footer

Comparing the Validity of Automated and Human Essay Scoring GREB GRE CBT

Author(s):
Powers, Donald E.; Burstein, Jill; Chodorow, Martin; Fowles, Mary E.; Kukich, Karen
Publication Year:
2000
Report Number:
RR-00-10, GREB-98-08aR
Source:
ETS Research Report
Document Type:
Report
Page Count:
23
Subject/Key Words:
Graduate Record Examinations Board, GRE Writing Assessment, Writing Skills, Graduate Record Examinations (GRE), Validity, Automated Scoring, Essay Scoring, Computer-Based Testing (CBT), Automated Scoring and Natural Language Processing

Abstract

Analyses revealed significant, but modest, correlations between the nontest indicators and each of the two methods of scoring. That automated and human scores exhibited reasonably similar relations with the nontest indicators was taken as evidence that the two methods of scoring reflect similar aspects of writing proficiency. These relations were, however, somewhat weaker for automated scores than for scores awarded by humans.

Read More