skip to main content skip to footer

A Multimodal Dialog System for Language Assessment: Current State and Future Directions ELL SDS

Author(s):
Suendermann-Oeft, David; Ramanarayanan, Vikram; Yu, Zhou; Qian, Yao; Evanini, Keelan; Lange, Patrick; Wang, Xinhao; Zechner, Klaus
Publication Year:
2017
Report Number:
RR-17-21
Source:
ETS Research Report
Document Type:
Report
Page Count:
9
Subject/Key Words:
Multimodal Processing, Spoken dialog systems (SDSs), Language Assessment, Language Learning, Speech Recognition, Speech Scoring, English Language Learners (ELL), Elementary Secondary Education, SpeechRater

Abstract

We present work in progress on a multimodal dialog system for English language assessment using a modular cloud-based architecture adhering to open industry standards. Among the modules being developed for the system, multiple modules heavily exploit machine learning techniques, including speech recognition, spoken language proficiency rating, speaker recognition, and the scoring of behaviors in multimodal data streams.

Read More