skip to main content skip to footer

Reducing Type-2 Sampling Errors in the Estimation of Test Reliability

Author(s):
Lord, Frederic M.
Publication Year:
1955
Report Number:
RB-55-15
Source:
ETS Research Bulletin
Document Type:
Report
Page Count:
16
Subject/Key Words:
Error of Measurement, Reliability Formulas, Split-Half Test Reliability, Test Reliability, Type II Errors

Abstract

The formula and derivation are given for the sampling variance of the "random-halves" reliability coefficient when items, rather than examinees, are sampled. When the number of test items is large, this sampling variance is found to be larger than the Kuder-Richardson formula-20 coefficient by a factor equal to the number of test items. The usual matched-halves reliability coefficient will likewise usually have a large sampling variance, since it likewise is based on an arbitrary split of the test items. An adaptation of the Jackson-Ferguson "battery reliability coefficient," used as an estimate of the matched-forms reliability of the test, avoids this relatively large sampling variance.

Read More