skip to main content skip to footer

Estimating Ability With Three Item Response Models When the Models Are Wrong and Their Parameters are Inaccurate IRT

Author(s):
Jones, Douglas H.; Kaplan, Bruce A.; Wainer, Howard
Publication Year:
1984
Report Number:
RR-84-26, PSRTR-84-46
Source:
ETS Research Report
Document Type:
Report
Page Count:
55
Subject/Key Words:
United States Air Force Human Resources Laboratory, Armed Services Vocational Aptitude Battery., Goodness of Fit, Item Response Theory (IRT), Mathematical Models, Maximum Likelihood Statistics, Statistical Analysis

Abstract

How accurately ability is estimated when the test model does not fit the data is considered. To address this question, this study investigated the accuracy of the maximum likelihood estimator of ability for the one-, two- and three-parameter logistic (PL) mod- els. The models were fitted into generated item characteristic curves derived from the Armed Services Vocational Aptitude Battery. Results indicated that the 3-PL model is the least biased, but that for lower abilities it had both the highest mean square error and was the most fragile with respect to sampling fluctuations of the parameter estimates. It is recommended that the current practice of utilizing some method of restricting the variability of parameters continue to be employed (such as Bayesian priors, robust estimation, or fixing some parameters to be constant). (AUTHOR/BS). (55pp.)

Read More