skip to main content skip to footer

Generalization of SAT Validity Across Colleges SAT

Author(s):
Boldt, Robert F.
Publication Year:
1986
Report Number:
RR-86-24, CBR-86-03
Source:
ETS Research Report
Document Type:
Report
Page Count:
16
Subject/Key Words:
College Entrance Examinations, Scholastic Aptitude Test (SAT), Selective Admission, Test Theory, Test Validity

Abstract

This study, which focused on the validity of the SAT-V and SAT-M, used data from 99 validity studies that were conducted by the Validity Study Service of the College Board. In addition to test validities based on first-year college averages, validities for each college were also estimated for two other groups-applicants for admission to the colleges, and all SAT takers. Substantial validity generalization was found: the assumption that applicant pool validities were all equal, together with sampling variance and the effects of selection, accounted for 36 percent and 34 percent of the variation of the SAT-V and SAT-M validities, respectively. The hypothesis of equal validity in pools like those of all SAT takers, plus sampling variance and the effects of selection, accounted for 53 percent and 33 percent of the variation of the SAT-verbal and SAT-mathematical validities, respectively. However, significant institutional uniqueness remains, though part of that uniqueness consists of variation in the reliability of first-year college average. For these data, substantial validity was the rule. The average validities were quite high, rising to .55 for either SAT-V or SAT-M true scores for all SAT takers, and 95 percent of the observed validities were above .13 for SAT-V and .10 for SAT-M. Values below these may be owing to accidents of sampling, computing errors, or criterion defects, and it should be noted that 95 percent is a conservative standard. Studies with slightly higher validities may be questioned as well, perhaps repeated, and the criterion examined carefully. (16pp.)

Read More