Systems and Method for Automated Scoring of a Summary-Writing Task
- Author(s):
- Madnani, Nitin; Burstein, Jill
- Patent Issued:
- Feb 21, 2017
- Patent Number:
- 9,576,249
- Source:
- ETS Patent
- Document Type:
- Patent
- Family ID:
- 51532871
- Subject/Key Words:
- Patent, Active Patent, Automated Scoring and Natural Language Processing, Summary Writing, Subject-Matter Knowledge, Comprehension, Summary Reports, Multi-Word Sequences, Numerical Analysis
Abstract
In accordance with the teachings described herein, systems and methods are provided for measuring a user's comprehension of subject matter of a text. A summary generated by the user is received, where the summary summarizes the text. The summary is processed to determine a first numerical measure indicative of a similarity between the summary and a reference summary. The summary is processed to determine a second numerical measure indicative of a degree to which a single sentence of the summary summarizes an entirety of the text. The summary is processed to determine a third numerical measure indicative of a degree of copying in the summary of multi-word sequences present in the text. A numerical model is applied to the first numerical measure, the second numerical measure and the third numerical measure to determine a score for the summary indicative of the user's comprehension of the subject matter of the text.