skip to main content skip to footer

An Empirical Study of the Broad Range Tailored Test of Verbal Ability PSAT

Kreitzberg, Charles B.; Jones, Douglas H.
Publication Year:
Report Number:
ETS Research Report
Document Type:
Page Count:
Subject/Key Words:
Computer Assisted Testing, Educational Innovation, Individualized Tests, Preliminary Scholastic Aptitude Test (PSAT), Test Administration, Verbal Ability


The Broad-Range Tailored Test (BRTT) is a computerized adaptive test. Each testee responds to 25 items; at the conclusion of the test the computer calculates a verbal ability score for the individual. The test was designed to yield a verbal ability score from the fifth grade level to the graduate school level. Two forms of the BRTT were administered to 146 high school students. Analyses revealed that the BRTT was more reliable than the Preliminary Scholastic Aptitude Test (PSAT) for a number of scores derived from the data, confirming theoretical expectations regarding the increased efficiency of adaptive, as compared to conventional tests. Of nine observed scores and score transformations, the most useful score was the expected proportion correct over the entire item pool. The accuracy of the BRTT was in accord with theoretical expectation. Student response to the computerized testing procedure was generally quite favorable. Students found the Human-Computer Interface easy to use and less fatiguing than a long pencil-and-paper test. These results suggest that computerized adaptive testing is ready to take the first steps out of the laboratory environment and find its place in the educational community. (Author/BW). (250pp.)

Read More