skip to main content skip to footer

End-To-End Neural Network Based Automated Speech Scoring

Suendermann-Oeft, David; Chen, Lei; Tao, Jidong; Ghaffarzadegan, Shabnam; Qian, Yao
Patent Issued:
Mar 02, 2021
Patent Number:
ETS Patent
Document Type:
Family ID:
Subject/Key Words:
Patent, Active Patent, Automated Scoring, Neural Networks, Linear Regression, Automated Scoring of Speech, Automatic Speech Recognition


A system for end-to-end automated scoring is disclosed. The system includes a word embedding layer for converting a plurality of ASR outputs into input tensors; a neural network lexical model encoder receiving the input tensors; a neural network acoustic model encoder implementing AM posterior probability, word duration, mean value of pitch and mean value of intensity based on a plurality of cues; and a linear regression module, for receiving concatenated encoded features from the neural network lexical model encoder and the neural network acoustic model encoder.

Read More