skip to main content skip to footer

Construct Validity of e-rater in Scoring TOEFL Essays TOEFL AES

Author(s):
Attali, Yigal
Publication Year:
2007
Report Number:
RR-07-21
Source:
ETS Research Report
Document Type:
Report
Page Count:
22
Subject/Key Words:
Validity, Test of English as a Foreign Language (TOEFL), Electronic Essay Rater (E-rater), Automated Essay Scoring (AES)

Abstract

The equal-weights e-rater score showed the same high reliability but significantly lower correlation with essay length. It is also aligned with the 3-factor hierarchical (word use, grammar, and discourse) structure that was discovered in the factor analysis. Both e-rater scores also successfully replicate human score differences between countries and prompts.

Read More