skip to main content skip to footer

Applying Multiphase Sampling to Selecting Testlets With Constraints on Item Blocks IRT

Author(s):
Qian, Jiahe; Gu, Lixiong; Li, Shuhong
Publication Year:
2019
Report Number:
RR-19-03
Source:
ETS Research Report
Document Type:
Report
Page Count:
14
Subject/Key Words:
Testlets, Item Blocks, Multiphase Sampling, Test Security, Test Assembly, Sample Size, Constraints on Parameters, Parallel Test Forms, Item Response Theory (IRT)

Abstract

In assembling testlets (i.e., test forms) with a pool of new and used item blocks, test security is one of the main issues of concern. Strict constraints are often imposed on repeated usage of the same item blocks. Nevertheless, for an assessment administering multiple testlets, a goal is to select as large a sample of testlets as possible. In this study, the algorithm of multiphase sampling was applied to selecting and augmenting the sample of testlets to be administered. Several topics related to the algorithm are discussed, such as the termination of the algorithm, the dynamics of sample size, and the effectiveness of the algorithm. A real database of testlets was used in the study.

Read More