Defining Personalized Writing Burst Measures of Translation Using Keystroke Logs
- Author(s):
- Zhang, Mo; Hao, Jiangang; Deane, Paul; Li, Chen
- Patent Issued:
- Dec 07, 2021
- Patent Number:
- 11,195,431
- Source:
- ETS Patent
- Document Type:
- Patent
- Family ID:
- 78818823
- Subject/Key Words:
- Patent, Active Patent, Automated Scoring, Human Scoring, Keystroke Log, Cluster Analysis, Test Score Reliability, Feedback
Abstract
Systems and methods for defining and using an optimal burst boundary threshold to assess the reliability of a manual/automatic writing score are presented. Keystroke data, including inter-key interval data, such as inter-word interval data, may be gathered from writings. Clustering analyses may be performed on the inter-key interval data to determine an optimal number of bursts for the writings. An optimal burst boundary may be determined from the optimal number of bursts. Other burst-related measures and statistics, including the average and maximum burst lengths, may be determined from the writings based on the optimal burst boundary threshold. A score may be received for each of the writings. A validation indication metric may be generated for each of the writings based on the received score and the optimal burst boundary threshold. The resulting measures and statistics may be used or applied in different ways and provide personalized feedback as learning analytics.