Effectiveness of Item Response Theory (IRT) Proficiency Estimation Methods Under Adaptive Multistage Testing IRT MST
- Author(s):
- Kim, Sooyeon; Moses, Tim P.; Yoo, Hanwook
- Publication Year:
- 2015
- Report Number:
- RR-15-11
- Source:
- ETS Research Report
- Document Type:
- Report
- Page Count:
- 21
- Subject/Key Words:
- Item Response Theory (IRT), Multistage Testing (MST), Proficiency, Routing Accuracy, Computerized Adaptive Tests
Abstract
We found that the choice of Bayesian (prior) and non-Bayesian (no prior) estimators was of more practical significance than the choice of number-correct versus item-pattern scoring. For the extreme proficiency levels, the decrease in standard error compensated for the increase in bias in the Bayesian estimates, resulting in smaller total error. Possible score changes caused by the use of different proficiency estimators would be nonnegligible, particularly for the extreme proficiency level examinees. The impact of misrouting at Stage 1 was minimal under the MST design used in this study.
Read More
- Request Copy (specify title and report number, if any)
- http://dx.doi.org/10.1002/ets2.12057