skip to main content skip to footer

Stumping E-Rater: Challenging the Validity of Automated Essay Scoring GREB GRE

Powers, Donald E.; Burstein, Jill; Chodorow, Martin; Fowles, Mary E.; Kukich, Karen
Publication Year:
Report Number:
RR-01-03, GREB-98-08bP
ETS Research Report
Document Type:
Page Count:
Subject/Key Words:
Graduate Record Examinations Board, Writing Evaluation, Electronic Essay Rater (E-rater), Graduate Record Examinations (GRE), Validity, Scoring, Automated Scoring, Automation, Essay Tests, Test Scoring Machines, Automated Scoring and Natural Language Processing


The study provides information on ways in which e-rater, and perhaps other automated essay scoring systems, may fail to provide accurate evaluations, if used as the sole method of scoring in high-stakes assessments. The results suggest possible avenues for improving automated scoring methods.

Read More