skip to main content skip to footer

GRE Automated-Editing-Task Phase II Report: Item Analyses, Revisions, Validity Study, and Taxonomy Development GRE GREB

Author(s):
Breland, Hunter M.; Kukich, Karen; Hemat, Lisa
Publication Year:
2001
Report Number:
RR-01-12
Source:
ETS Research Report
Document Type:
Report
Page Count:
56
Subject/Key Words:
Graduate Record Examinations Board, Graduate Record Examinations (GRE), GRE Writing Assessment, Automation, Essays

Abstract

Two automated editing tasks developed in a Phase I study were subjected to item analyses, revised, and then used in a computer-based test administration at a local college. The data collected in the administration were compared with questionnaire data obtained from students to examine the construct validity of the tasks. In a second approach to construct validation, a taxonomy of writing skills was developed and compared to the skills assessed by the editing tasks. Data analyses indicate that total editing score correlates more strongly with self-reported English grades than with self-reported mathematics grades, and that total editing score correlates positively with student self-assessments of their writing skill, recent grades on writing assignments, and college grade point average. A review of the task elements against the taxonomy indicates that the editing tasks assess important writing skills not assessed by free-response essays.

Read More