angle-up angle-right angle-down angle-left close user menu open menu closed search globe bars phone store

Aligning TextEvaluator Scores With the Accelerated Text Complexity Guidelines Specified in the Common Core State Standards

Author(s):
Sheehan, Kathleen M.
Publication Year:
2015
Report Number:
RR-15-21
Source:
ETS Research Report
Document Type:
Report
Page Count:
22
Subject/Key Words:
Automated Scoring and Natural Language Processing Common Core State Standards (CCSS) SourceRater Text Analysis Text Complexity TextEvaluator

Abstract

The TextEvaluator text analysis tool is a fully automated text complexity evaluation tool designed to help teachers, curriculum specialists, textbook publishers, and test developers select texts that are consistent with the text complexity guidelines specified in the Common Core State Standards. This paper documents the procedure used to align the TextEvaluator reporting scale with the Common Core text complexity scale and provides score ranges for use when placing texts into grade bands. Three evaluations of the proposed score ranges are reported: one implemented with respect to the set of 168 exemplar texts provided in Appendix B of the Common Core State Standards, one implemented with respect to a set of 10 career texts, and one implemented with respect to a set of 59 texts selected from textbooks assigned in first-year, credit-bearing college courses. Results suggest that the proposed ranges can help users determine an appropriate grade band placement for any text that has been evaluated by TextEvaluator, including informational, literary, and mixed texts.

Read More