skip to main content skip to footer

Investigating the Value of TOEFL iBT Section Scores TOEFL TOEFL iBT

Author(s):
Sawaki, Yasuyo; Sinharay, Sandip
Publication Year:
2013
Report Number:
RR-13-35
Source:
ETS Research Report
Document Type:
Report
Page Count:
113
Subject/Key Words:
Score Dependability, Dimensionality, Factor Analysis, Generalizability Theory, Reliability, Subscore Analysis, Score Profile, TOEFL iBT, Test of English as a Foreign Language (TOEFL)

Abstract

In contrast, the CFAs conducted separately for the 3 L1 groups as well as a multiple-group confirmatory factor analyses (CFAs) identified a correlated 4-factor model with reading, listening, speaking, and writing factors as the best representation of the structure of the entire test for all examinees as well as for the 3 L1 groups. Reliability of the observed section scores for norm-referenced score interpretations and the dependability of classification decisions made based on different cut scores were generally satisfactory while they were also found to be relatively low in some circumstances. Based on the mixed results concerning the value-added information the TOEFL iBT section scores provide, recommendations for future research directions and some key issues of consideration for high-stakes decision making based on the section scores were summarized.

Read More