skip to main content skip to footer

Differential Item Functioning: Its Consequences DIF EAP

Author(s):
Lee, Yi-Hsuan; Zhang, Jinming
Publication Year:
2010
Report Number:
RR-10-01
Source:
ETS Research Report
Document Type:
Report
Page Count:
25
Subject/Key Words:
Differential Item Functioning (DIF), Total Score, Expected a Posteriori (EAP), Reliability

Abstract

This report examines the consequences of differential item functioning (DIF) using simulated data. Its impact on total score, item response theory (IRT) ability estimate, and test reliability was evaluated in various testing scenarios created by manipulating the following four factors: test length, percentage of DIF items per form, sample sizes of different examinee groups, and types of responses. The results indicate that the greatest score difference was observed between the examinee groups on forms with DIF items, and the magnitude was less than 2 points on the 0-60 total score scale and .15 on the IRT ability scale. The influence on reliability was rather limited.

Read More