Evaluation of a Condition-Adaptive Test of Reading Comprehension for Students With Reading-Based Learning Disabilities

Author(s):
Stone, Elizabeth; Cook, Linda; Laitusis, Cara
Publication Year:
2013
Report Number:
RR-13-20
Source:
ETS Research Report
Document Type:
Report
Page Count:
35
Subject/Key Words:
Accessibility (For Disabled) Condition-Adaptive Test Learning Disabilities Multistage Testing (MST) Reading Aloud to Others Reading Comprehension Routing Accuracy Routing Test Testing Accommodations

Abstract

This study presents secondary analyses on a 2-stage test of reading comprehension for students with reading-based learning disabilities (RLD). The present paper describes student perceptions of the test and its features as well as analyses focused on the routing test and associated cut score. The routing test contained typical state assessment content and was designed to route the RLD participants into 1 of 2 accessible 2nd-stage tests, 1 accommodated and 1 not accommodated, and we refer to this structure as condition-adaptive. The accommodated test was presented with a read-aloud accommodation, and an oral reading fluency subtest was also administered as part of that test to evaluate decoding skill that may have been masked by the read-aloud accommodation. This design allowed for componentwise measurement of reading proficiency at the 2nd stage with the goal of creating an accessible tailored test that would provide more comparable accommodated and nonaccommodated test scores for possible use for accountability. Overall, student perceptions differed depending on which 2nd-stage test was taken, but most students indicated that they tried as hard on this field test as they did on other tests, and many expressed a preference for the read-aloud accommodation. We found that routing test length was more strongly correlated with 2nd-stage test performance for the higher performing RLD students, that relatively similar routing decisions could be made using a shorter routing test made up of a smaller subset of the available passages, and that the percentage of students routed into each 2nd-stage test was sensitive to perturbations of the cut score. 

Read More