skip to main content skip to footer

Simulating the Use of Disclosed Items in Computerized Adaptive Testing

Author(s):
Stocking, Martha L.; Ward, William C.; Potenza, Maria T.
Publication Year:
1997
Report Number:
RR-97-10
Source:
ETS Research Report
Document Type:
Report
Page Count:
50
Subject/Key Words:
Adaptive Testing, Computer Assisted Testing, Disclosed Tests, Item Pools, Performance Factors, Scores, Simulation, Test Design

Abstract

Regular use of questions previously made available to the public (disclosed) may provide one way to meet the requirement for large numbers of questions in a continuous testing environment, that is, an environment in which testing is offered at test taker convenience throughout the year rather than on a few prespecified test dates. First, it must be shown that such use has effects on test scores small enough to be acceptable. In this study simulations are used to explore the use of disclosed items under a worst case scenario which assumes that disclosed items are always answered correctly. Some item pool and test designs were identified in which the use of disclosed items produces effects on test scores that may be viewed as negligible.

Read More