skip to main content skip to footer

Comparison of Multistage Tests With Computerized Adaptive and Paper-and-Pencil Tests PPT CAT MST IRT

Author(s):
Rotou, Ourania; Patsula, Liane N.; Steffen, Manfred
Publication Year:
2007
Report Number:
RR-07-04
Source:
ETS Research Report
Document Type:
Report
Page Count:
26
Subject/Key Words:
Paper and Pencil Tests (PPT), Computerized Adaptive Testing (CAT), Multistage Testing (MST), Item Response Theory (IRT), Calibration, Reliability

Abstract

This study investigates the measurement precision of MST compared to CAT and compared to P&P test for the one-, two-, and three-parameter logistic (1-, 2-, and 3PL) models when the test is completely set-based. Results showed that MST performed better for the 2- and 3PL models than an equivalent-length p&P test in terms of reliability and conditional standard of error of measurement. In addition, findings showed that MST performed better for the 1- and 2PL models than for an equivalent-length CAT test. For the 3PL model, MST and CAT performed about the same.

Read More