skip to main content skip to footer

Automated Scoring of Spontaneous Speech Using SpeechRater v1.0 TOEFL TPO

Author(s):
Xi, Xiaoming; Higgins, Derrick; Zechner, Klaus; Williamson, David M.
Publication Year:
2008
Report Number:
RR-08-62
Source:
ETS Research Report
Document Type:
Report
Page Count:
102
Subject/Key Words:
Automated Scoring, Speech Recognition, SpeechRater, Test of English as a Foreign Language (TOEFL), TOEFL Practice Online (TPO), Validity, Automated Scoring and Natural Language Processing

Abstract

This report presents the results of a research and development effort for SpeechRater Version 1.0 (v1.0), an automated scoring system for the spontaneous speech of English language learners used operationally in the Test of English as a Foreign Language (TOEFL) Practice Online assessment (TPO). The report includes a summary of the validity considerations and analyses that drive both the development and the evaluation of the quality of automated scoring. These considerations include perspectives on the construct of interest, the context of use, and the empirical performance of the SpeechRater in relation to both the human scores and the intended use of the scores. The outcomes of this work have implications for short- and long-term goals for iterative improvements to SpeechRater scoring.

Read More