Use of e-rater® in Scoring of the TOEFL iBT® Writing Test

Author(s):
Haberman, Shelby J.
Publication Year:
2011
Report Number:
RR-11-25
Source:
Document Type:
Subject/Key Words:
classical test theory, reliability, validity

Abstract

Alternative approaches are discussed for use of e-rater® to score the TOEFL iBT® Writing test. These approaches involve alternate criteria. In the 1st approach, the predicted variable is the expected rater score of the examinee's 2 essays. In the 2nd approach, the predicted variable is the expected rater score of 2 essay responses by the examinee on a parallel form. This 2nd approach is related to prediction of the expected rater score of 2 essay responses on an actual form taken later by an examinee. The relationship of e-rater scores to scores on other TOEFL® sections is also considered. These alternative approaches suggest somewhat different procedures for scoring.

Read More