skip to main content skip to footer

Exploring the Feasibility of Using Writing Process Features to Assess Text Production Skills CBAL

Author(s):
Deane, Paul; Zhang, Mo
Publication Year:
2015
Report Number:
RR-15-26
Source:
ETS Research Report
Document Type:
Report
Page Count:
18
Subject/Key Words:
Cognitively Based Assessment of, for, and as Learning (CBAL), Writing Process, Keystroke Log, Factor Structure, Writing, Writing Assessment, Writing Quality

Abstract

(d) If we train a predictive model on one prompt, how well do its predictions generalize to the other prompts of the same or different genre? The results of the study indicate that keystroke log features vary considerably in stability across testing occasions and display somewhat different patterns of feature–human correlation across genres and topics. However, using the most stable features, we can obtain moderate to strong prediction of human essay scores, and those models generalize reasonably well across prompts though more strongly within than across writing genres.

Read More