angle-up angle-right angle-down angle-left close user menu open menu closed search globe bars phone store

Model Analysis and Model Creation: Capturing the Task-Model Structure of Quantitative Item Domains

Deane, Paul; Graf, Edith Aurora; Higgins, Derrick; Futagi, Yoko; Lawless, Rene
Publication Year:
Report Number:
ETS Research Report
Document Type:
Page Count:
Subject/Key Words:
Automated Scoring and Natural Language Processing Evidence Centered Design (ECD) Item Modeling Model Creator NAEP 2000 Mathematics Assessment


This study focuses on the relationship between item modeling and evidence-centered design (ECD); it considers how an appropriately generalized item modeling software tool can support systematic identification and exploitation of task-model variables, and then examines the feasibility of this goal, using linear-equation items as a test case. The first half of the study examines task-model structures for linear equations and their relevance to item difficulty within ECD. The second half of the study presents prototype software, a Model Creator system for pure math items, designed to partially automate the creation of variant item models reflecting different combinations of task-model variables. The prototype is applied to linear equations but is designed to generalize over a range of pure mathematical content types.

Read More