Systems and Methods for Automated Scoring of Textual Responses to Picture-Based Items
- Author(s):
- Somasundaran, Swapna; Chodorow, Martin; Tetreault, Joel R.
- Patent Issued:
- Dec 05, 2017
- Patent Number:
- 9,836,985
- Source:
- ETS Patent
- Document Type:
- Patent
- Family ID:
- 53882752
- Subject/Key Words:
- Patent, Active Patent, Automated Scoring and Natural Language Processing, Constructed Responses, English Language Proficiency, Pictures, Grammatical Error Detection
Abstract
Systems and methods are provided for measuring a user's English language proficiency. A constructed response generated by a user is received, the constructed response being based on a picture. The constructed response is processed to determine a first numerical measure indicative of a presence of one or more grammar errors in the constructed response. The constructed response is processed to determine a second numerical measure indicative of a degree to which the constructed response describes a subject matter of the picture. The constructed response is processed to determine a third numerical measure indicative of a degree of awkward word usage in the constructed response. A model is applied to the first, second, and third numerical measures to determine a score for the constructed response indicative of the user's English language proficiency. The model includes first, second, and third variables with associated first, second, and third weighting factors, respectively.