skip to main content skip to footer

Non-Scorable Response Filters for Speech Scoring Systems

Yoon, Su-Youn; Higgins, Derrick; Zechner, Klaus; Xie, Shasha; Jeon, Je Hun; Evanini, Keelan
Patent Issued:
Mar 24, 2015
Patent Number:
ETS Patent
Document Type:
Family ID:
Subject/Key Words:
Patent, Active Patent, Non-Native Speakers, Automatic Speech Recognition, Automated Scoring of Speech, Automated Scoring and Natural Language Processing, Spoken Language Assessment, Speech Sample, Acoustic Features, Filtering Models


A method for scoring non-native speech includes receiving a speech sample spoken by a non-native speaker and performing automatic speech recognition and metric extraction on the speech sample to generate a transcript of the speech sample and a speech metric associated with the speech sample. The method further includes determining whether the speech sample is scorable or non-scorable based upon the transcript and speech metric, where the determination is based on an audio quality of the speech sample, an amount of speech of the speech sample, a degree to which the speech sample is off-topic, whether the speech sample includes speech from an incorrect language, or whether the speech sample includes plagiarized material. When the sample is determined to be non-scorable, an indication of non-scorability is associated with the speech sample. When the sample is determined to be scorable, the sample is provided to a scoring model for scoring.

Read More