Targeted Content Feedback In Spoken Language Learning And Assessment
- Author(s):
- Wang, Xinhao; Zechner, Klaus; Hamill, Christopher
- Patent Issued:
- Mar 11, 2025
- Patent Number:
- 12,249,324
- Source:
- ETS Patent
- Document Type:
- Patent
- Family ID:
- 94878837
- Subject/Key Words:
- Patent, Active Patent, Machine Learning, Automated Feedback, Spoken Language Assessment, Diagnostic Feedback, Corpus Analysis
Abstract
Data is received by an automated spoken language learning and assessment system that includes a passage of text comprising a response to stimulus material. Thereafter, at least one machine learning model is used to detect absent key points within the passage of text and/or location spans of key points in the passage of text. The at least one machine learning model can be trained using a corpus with annotated key points and a span for each key point. In addition, each of the detected key points is scored by at least one key point quality model to result in a corresponding key point score. Diagnostic feedback targeting content development skills is then determined based on the detecting and using the key point scores. Data can then be provided which characterizes such diagnostic feedback. Related apparatus, systems, techniques and articles are also described.