angle-up angle-right angle-down angle-left close user menu open menu closed search globe bars phone store

Constructed-Response (CR) Differential Item Functioning (DIF) Evaluations for TOEIC Speaking and Writing Tests

Author(s):
Moses, Tim P.
Publication Year:
2013
Source:
Powers, Donald E. (ed.) The Research Foundation for the TOEIC Tests: A Compendium of Studies: Volume II. Princeton, NJ: Educational Testing Service, Sep 2013, p10.1-10.19
Document Type:
Chapter
Page Count:
20
Subject/Key Words:
Constructed Response Items Differential Item Functioning (DIF) English as a Foreign Language (EFL) English as a Second Language (ESL) English Language Assessment (ELA) English Language Proficiency English Language Skills Speaking Skills Test of English for International Communication (TOEIC) Test-Taker Performance Writing Skills

Abstract

SUMMARY: Differential item functioning (DIF) is a statistical procedure used to identify items or tasks that are unexpectedly biased in some way, inappropriately favoring one group of test takers over another. One of the challenges for speaking and writing tests is the lack of proven, practical DIF techniques that can be used to analyze performance-based or "constructed-response" tests. This paper investigates several such techniques and illustrates how research is being conducted to ensure the fairness of score interpretations.

Read More