skip to main content skip to footer

Systems and Methods for Evaluating Susceptibility of Automated Scoring Engines to Gaming Behavior

Higgins, Derrick; Bejar, Isaac I.; Heilman, Michael; Futagi, Yoko; Flor, Michael
Patent Issued:
Apr 09, 2019
Patent Number:
ETS Patent
Document Type:
Family ID:
Subject/Key Words:
Patent, Active Patent, Automated Scoring and Natural Language Processing, Gaming Behavior, Constructed Response


Systems and methods are provided for determining a susceptibility of a computer-implemented automated scoring engine to gaming strategies. A plurality of responses to a prompt are provided to a computer-implemented automated scoring engine to receive a first set of scores. A first transformation is performed on each of the plurality of responses to generate a first set of transformed responses. The first set of transformed responses is provided to the computer-implemented automatic scoring engine to receive a second set of scores, and a gaming susceptibility metric is determined based on the first set of scores and the second set of scores.

Read More