skip to main content skip to footer

Systems and Methods for Automated Scoring of Textual Responses to Picture-Based Items

Author(s):
Somasundaran, Swapna; Chodorow, Martin; Tetreault, Joel R.
Patent Issued:
Dec 05, 2017
Patent Number:
9,836,985
Source:
ETS Patent
Document Type:
Patent
Family ID:
53882752
Subject/Key Words:
Patent, Active Patent, Automated Scoring and Natural Language Processing, Constructed Responses, English Language Proficiency, Pictures, Grammatical Error Detection

Abstract

Systems and methods are provided for measuring a user's English language proficiency. A constructed response generated by a user is received, the constructed response being based on a picture. The constructed response is processed to determine a first numerical measure indicative of a presence of one or more grammar errors in the constructed response. The constructed response is processed to determine a second numerical measure indicative of a degree to which the constructed response describes a subject matter of the picture. The constructed response is processed to determine a third numerical measure indicative of a degree of awkward word usage in the constructed response. A model is applied to the first, second, and third numerical measures to determine a score for the constructed response indicative of the user's English language proficiency. The model includes first, second, and third variables with associated first, second, and third weighting factors, respectively.

Read More