skip to main content skip to footer

Use of e-rater in Scoring of the TOEFL iBT Writing Test TOEFL iBT

Author(s):
Haberman, Shelby J.
Publication Year:
2011
Report Number:
RR-11-25
Source:
ETS Research Report
Document Type:
Report
Page Count:
13
Subject/Key Words:
Test of English as a Foreign Language (TOEFL), Internet Based Testing (iBT), Electronic Essay Rater (E-rater), Classical Test Theory (CTT), Reliability, Validity, Writing Assessment, Automated Scoring and Natural Language Processing

Abstract

Alternative approaches are discussed for use of e-rater to score the TOEFL iBT Writing test. These approaches involve alternate criteria. In the 1st approach, the predicted variable is the expected rater score of the examinee's 2 essays. In the 2nd approach, the predicted variable is the expected rater score of 2 essay responses by the examinee on a parallel form. This 2nd approach is related to prediction of the expected rater score of 2 essay responses on an actual form taken later by an examinee. The relationship of e-rater scores to scores on other TOEFL sections is also considered. These alternative approaches suggest somewhat different procedures for scoring.

Read More