Stumping E-Rater: Challenging the Validity of Automated Essay Scoring GREB GRE
- Author(s):
-
Powers, Donald E.;
Burstein, Jill;
Chodorow, Martin;
Fowles, Mary E.;
Kukich, Karen
- Publication Year:
- 2001
- Report Number:
-
RR-01-03
- Source:
-
ETS Research Report
- Document Type:
- Report
- Page Count:
- 44
- Subject/Key Words:
-
Graduate Record Examinations Board,
Writing Evaluation,
Electronic Essay Rater (E-rater),
Graduate Record Examinations (GRE),
Validity,
Scoring,
Automated Scoring,
Automation,
Essay Tests,
Test Scoring Machines,
Automated Scoring and Natural Language Processing
Abstract
The study provides information on ways in which e-rater, and perhaps other automated essay scoring systems, may fail to provide accurate evaluations, if used as the sole method of scoring in high-stakes assessments. The results suggest possible avenues for improving automated scoring methods.
Read More
