skip to main content skip to footer

Managing the Influence of DIF From Big Items: The 1988 Advanced Placement History Test as an Example AP DIF

Author(s):
Lukhele, Robert; Wainer, Howard
Publication Year:
1996
Report Number:
RR-96-21
Source:
ETS Research Report
Document Type:
Report
Page Count:
30
Subject/Key Words:
Advanced Placement Program (AP), Constructed-Response Items, Differential Item Functioning (DIF), History Tests, Item Characteristics, Weighted Scores

Abstract

Building tests out of large items brings with it a number of problems. One major problem is that it is often too difficult and too expensive to extensively pretest large items. Thus the sorts of screening for flaws that are pro forma for multiple choice items is not often done for large items. In addition, since there are so few large items on an operational test, not counting an entire item that is found to be flawed in an operational administration may be tantamount to aborting that administration. In this paper we examine the efficacy of the alternative of continuous item weighting. This alternative is illustrated on data from the 1988 administration of the College Board's Advanced Placement History Test.

Read More