skip to main content skip to footer

Pass-Fail Reliability for Tests With Cut Scores: A Simplified Method

Author(s):
Breyer, F. Jay; Lewis, Charles
Publication Year:
1994
Report Number:
RR-94-39
Source:
ETS Research Report
Document Type:
Report
Page Count:
34
Subject/Key Words:
Alpha Coefficient, Cutting Scores, Pass Fail Grading, Reliability Formulas, Test Reliability

Abstract

A single-administration classification reliability index is described that estimates the probability of consistently classifying examinees to mastery or nonmastery states as if those examinees had been tested with two alternate forms. The procedure is applicable to any test used for classification purposes, subdividing that test into two half-tests, each with a cut score, where the sum of the two half-test cut scores is equal to the cut score for the total test. The application of this pass-fail consistency index to binary scored objective tests, nonbinary scored performance tests, and tests containing both binary and nonbinary scored questions is presented. A calculation example is provided together with look-up tables. (34pp.)

Read More