skip to main content skip to footer

Item Performance Across Native Language Groups on the Test of English as a Foreign Language TOEFL

Author(s):
Alderman, Donald L.; Holland, Paul W.
Publication Year:
1981
Report Number:
RR-81-16, TOEFL-RR-09
Source:
ETS Research Report
Document Type:
Report
Page Count:
112
Subject/Key Words:
College Board, Graduate Record Examinations Board, English Tests, Item Analysis, Language Proficiency, Native Speakers, Test Validity, Test of English as a Foreign Language (TOEFL)

Abstract

The Test of English as a Foreign Language™ (TOEFL®) was examined for instances in which the item performance of examinees with comparable scores differed according to their native languages. A chi-square procedure, sensitive to deviations of less than 10% from the expected frequencies of correct item responses across several language groups, revealed significant differences on seven-eights of the TOEFL items. Reviewers familiar with particular languages could attribute the relative advantage or disadvantage of those language groups on a specific item to linguistic similarities or dissimilarities with the English language. Reviewers could not, however, identify which items would exhibit differential performance across groups based upon inspection of a test form and answer key alone. These findings suggest that examinees' performance on given items in a test of proficiency in a second language will vary according to linguistic contrasts with their native language and that statistical procedures will be necessary for identifying items with exaggerated or unexplained differences across language groups. Four appendices provide a large number of statistical tables and graphs.

Read More