Computer-Implemented Systems and Methods for Evaluating Speech Dialog System Engagement Via Video
- Author(s):
- Ramanarayanan, Vikram; Suendermann-Oeft, David; Lange, Patrick; Ivanov, Alexei V.; Evanini, Keelan; Qian, Yao; Tsuprun, Eugene; Molloy, Hillary
- Patent Issued:
- Mar 17, 2020
- Patent Number:
- 10,592,733
- Source:
- ETS Patent
- Document Type:
- Patent
- Family ID:
- 69778907
- Subject/Key Words:
- Patent, Active Patent, Spoken Dialog System (SDS), Video Evaluation, Video, Multimodal Presentation Assessment, Audio-Lingual Methods, Automatic Speech Recognition, Computer-Implemented
Abstract
Systems and methods are provided providing a spoken dialog system. Output is provided from a spoken dialog system that determines audio responses to a person based on recognized speech content from the person during a conversation between the person and the spoken dialog system. Video data associated with the person interacting with the spoken dialog system is received. A video engagement metric is derived from the video data, where the video engagement metric indicates a level of the person's engagement with the spoken dialog system.