skip to main content skip to footer

Stumping E-Rater: Challenging the Validity of Automated Essay Scoring GREB GRE

Author(s):
Powers, Donald E.; Burstein, Jill; Chodorow, Martin; Fowles, Mary E.; Kukich, Karen
Publication Year:
2001
Report Number:
RR-01-03, GREB-98-08bP
Source:
ETS Research Report
Document Type:
Report
Page Count:
44
Subject/Key Words:
Graduate Record Examinations Board, Writing Evaluation, Electronic Essay Rater (E-rater), Graduate Record Examinations (GRE), Validity, Scoring, Automated Scoring, Automation, Essay Tests, Test Scoring Machines, Automated Scoring and Natural Language Processing

Abstract

The study provides information on ways in which e-rater, and perhaps other automated essay scoring systems, may fail to provide accurate evaluations, if used as the sole method of scoring in high-stakes assessments. The results suggest possible avenues for improving automated scoring methods.

Read More