skip to main content skip to footer

Articulation of Cut Scores in the Context of the Next-Generation Assessments PARCC SBAC CCSS STAAR

Author(s):
Kannan, Priya; Sgammato, Adrienne
Publication Year:
2017
Report Number:
RR-17-34
Source:
ETS Research Report
Document Type:
Report
Page Count:
19
Subject/Key Words:
Cut Scores, Next Generation Assessment, Logistic Regression, Achievement Levels, Partnership for Assessment of Readiness for College and Careers (PARCC), SMARTER Balanced Assessment Consortium (SBAC), Common Core State Standards (CCSS), Bias Reduction, State of Texas Assessments of Academic Readiness (STAAR), Simulation Studies, Elementary Secondary Education

Abstract

Logistic regression (LR)-based methods have become increasingly popular for predicting and articulating cut scores. However, the precision of predictive relationships is largely dependent on the underlying correlations between the predictor and the criterion. In two simulation studies, we evaluated the impact of varying the underlying grade-level correlations on the resultant bias in cut scores articulated using the LR method. In Study 1, we compared different articulation methods (LR and equipercentile smoothing), and in Study 2, we evaluated different criteria for linking (e.g., adjacent grade or end of course). The collective results indicate that as correlations became smaller, cut scores articulated using LR-based predictions became increasingly biased when compared to a true value obtained under perfect correlation. The predicted values are significantly biased for lower achievement levels, irrespective of the linking criteria used. Results from these studies suggest that the LR method must be used with caution, particularly when articulating cut scores for multiple achievement levels.

Read More