skip to main content skip to footer

Computer-Implemented Systems and Methods for Evaluating Speech Dialog System Engagement Via Video

Ramanarayanan, Vikram; Suendermann-Oeft, David; Lange, Patrick; Ivanov, Alexei V.; Evanini, Keelan; Qian, Yao; Tsuprun, Eugene; Molloy, Hillary
Patent Issued:
Mar 17, 2020
Patent Number:
ETS Patent
Document Type:
Family ID:
Subject/Key Words:
Patent, Active Patent, Spoken Dialog System (SDS), Video Evaluation, Video, Multimodal Presentation Assessment, Audio-Lingual Methods, Automatic Speech Recognition, Computer-Implemented


Systems and methods are provided providing a spoken dialog system. Output is provided from a spoken dialog system that determines audio responses to a person based on recognized speech content from the person during a conversation between the person and the spoken dialog system. Video data associated with the person interacting with the spoken dialog system is received. A video engagement metric is derived from the video data, where the video engagement metric indicates a level of the person's engagement with the spoken dialog system.

Read More