skip to main content skip to footer

The Feasibility of Using Item Response Theory as a Psychometric Model for the GRE Aptitude Test GREB GRE IRT

Author(s):
Kingston, Neal M.; Dorans, Neil J.
Publication Year:
1982
Report Number:
RR-82-12, GREB-79-12P (1982)
Source:
ETS Research Report
Document Type:
Report
Page Count:
147
Subject/Key Words:
Graduate Record Examinations Board, Aptitude Tests, Equated Scores, Graduate Record Examinations (GRE), Item Response Theory (IRT), Mathematical Models, Psychometrics, Test Theory, Test Wiseness

Abstract

The feasibility of using Item Response Theory (IRT) as a psychometric model for the Graduate Record Examination (GRE) Aptitude Test was addressed by assessing the reasonableness of the assumptions of item response theory for GRE item types and examinee populations. Items from four forms and four administrations of the GRE Aptitude Test were calibrated using the three-parameter logistic item response model. Three equating methods were compared in this research: equipercentile equating, linear equating, and item response theory true score equating. Various data collection designs (for both IRT and non-IRT methods) and several item parameter linking procedures (for the IRT equatings) were employed. The IRT methods produced quantitative scaled score means and standard deviations that were higher and lower, respectively, than those produced by the linear and equipercentile methods. The most notable finding in the analytical equatings was the sensitivity of the precalibration design (used only for the IRT equating method) to practice effects on analytical items, particularly for the analysis of explanations item type. Since the precalibration design is the data collection method most appealing (for administrative reasons) for equating the GRE Aptitude Test in a test disclosure environment, this sensitivity might present a problem for any equating method. (PN). (147pp.)

Read More