Systems and Methods for Evaluating Susceptibility of Automated Scoring Engines to Gaming Behavior
- Author(s):
- Higgins, Derrick; Bejar, Isaac I.; Heilman, Michael; Futagi, Yoko; Flor, Michael
- Patent Issued:
- Apr 09, 2019
- Patent Number:
- 10,255,820
- Source:
- ETS Patent
- Document Type:
- Patent
- Family ID:
- 51621207
- Subject/Key Words:
- Patent, Active Patent, Automated Scoring and Natural Language Processing, Gaming Behavior, Constructed Response
Abstract
Systems and methods are provided for determining a susceptibility of a computer-implemented automated scoring engine to gaming strategies. A plurality of responses to a prompt are provided to a computer-implemented automated scoring engine to receive a first set of scores. A first transformation is performed on each of the plurality of responses to generate a first set of transformed responses. The first set of transformed responses is provided to the computer-implemented automatic scoring engine to receive a second set of scores, and a gaming susceptibility metric is determined based on the first set of scores and the second set of scores.