skip to main content skip to footer

Systems and Method for Automated Scoring of a Summary-Writing Task

Author(s):
Madnani, Nitin; Burstein, Jill
Patent Issued:
Feb 21, 2017
Patent Number:
9,576,249
Source:
ETS Patent
Document Type:
Patent
Family ID:
51532871
Subject/Key Words:
Patent, Active Patent, Automated Scoring and Natural Language Processing, Summary Writing, Subject-Matter Knowledge, Comprehension, Summary Reports, Multi-Word Sequences, Numerical Analysis

Abstract

In accordance with the teachings described herein, systems and methods are provided for measuring a user's comprehension of subject matter of a text. A summary generated by the user is received, where the summary summarizes the text. The summary is processed to determine a first numerical measure indicative of a similarity between the summary and a reference summary. The summary is processed to determine a second numerical measure indicative of a degree to which a single sentence of the summary summarizes an entirety of the text. The summary is processed to determine a third numerical measure indicative of a degree of copying in the summary of multi-word sequences present in the text. A numerical model is applied to the first numerical measure, the second numerical measure and the third numerical measure to determine a score for the summary indicative of the user's comprehension of the subject matter of the text.

Read More