skip to main content skip to footer

Computer-Implemented Systems and Methods for Automatically Generating an Assessment of Oral Recitations of Assessment Items

Tao, Jidong; Chen, Lei; Lee, Chong Min
Patent Issued:
May 29, 2018
Patent Number:
ETS Patent
Document Type:
Family ID:
Subject/Key Words:
Patent, Active Patent, Automated Item Generation, Computer-Based Testing (CBT), Computer-Implemented, Recitation, Spoken Language Assessment, Automatic Speech Recognition, Test Scoring, Automated Scoring and Natural Language Processing, Feedback, Neural Networks


Provide automatic assessment of oral recitations during computer based language assessments using a trained neural network to automate the scoring and feedback processes without human transcription and scoring input by automatically generating a score of a language assessment. Providing an automatic speech recognition ("ASR") scoring system. Training multiple scoring reference vectors associated with multiple possible scores of an assessment, and receiving an acoustic language assessment response to an assessment item. Based on the acoustic language assessment automatically generating a transcription, and generating an individual word vector from the transcription. Generating an input vector by concatenating an individual word vector with a transcription feature vector, and supplying an input vector as input to a neural network. Generating an output vector based on weights of a neural network; and generating a score by comparing an output vector with scoring vectors.

Read More