angle-up angle-right angle-down angle-left close user menu open menu closed search globe bars phone store

Automated Scoring of Spontaneous Speech Using SpeechRater v1.0

Author(s):
Xi, Xiaoming; Higgins, Derrick; Zechner, Klaus; Williamson, David M.
Publication Year:
2008
Report Number:
RR-08-62
Source:
ETS Research Report
Document Type:
Report
Page Count:
102
Subject/Key Words:
Automated Scoring Automated Scoring and Natural Language Processing Speech Recognition SpeechRater Test of English as a Foreign Language (TOEFL) TOEFL Practice Online (TPO) Validity

Abstract

This report presents the results of a research and development effort for SpeechRater Version 1.0 (v1.0), an automated scoring system for the spontaneous speech of English language learners used operationally in the Test of English as a Foreign Language (TOEFL) Practice Online assessment (TPO). The report includes a summary of the validity considerations and analyses that drive both the development and the evaluation of the quality of automated scoring. These considerations include perspectives on the construct of interest, the context of use, and the empirical performance of the SpeechRater in relation to both the human scores and the intended use of the scores. The outcomes of this work have implications for short- and long-term goals for iterative improvements to SpeechRater scoring.

Read More