skip to main content skip to footer

Comparing the Validity of Automated and Human Essay Scoring GREB GRE CBT

Powers, Donald E.; Burstein, Jill; Chodorow, Martin; Fowles, Mary E.; Kukich, Karen
Publication Year:
Report Number:
RR-00-10, GREB-98-08aR
ETS Research Report
Document Type:
Page Count:
Subject/Key Words:
Graduate Record Examinations Board, GRE Writing Assessment, Writing Skills, Graduate Record Examinations (GRE), Validity, Automated Scoring, Essay Scoring, Computer-Based Testing (CBT), Automated Scoring and Natural Language Processing


Analyses revealed significant, but modest, correlations between the nontest indicators and each of the two methods of scoring. That automated and human scores exhibited reasonably similar relations with the nontest indicators was taken as evidence that the two methods of scoring reflect similar aspects of writing proficiency. These relations were, however, somewhat weaker for automated scores than for scores awarded by humans.

Read More