skip to main content skip to footer

Native Language, English Proficiency, and the Structure of the Test of English as a Foreign Language TOEFL

Author(s):
Oltman, Philip K.; Stricker, Lawrence J.; Barrows, Thomas S.
Publication Year:
1988
Report Number:
RR-88-26, TOEFL-RR-27
Source:
ETS Research Report
Document Type:
Report
Page Count:
44
Subject/Key Words:
College Board, Construct Validity, English (Second Language), Language Dominance, Language Proficiency, Language Tests, Test of English as a Foreign Language (TOEFL)

Abstract

Responses on the TOEFL® test may reflect both the influence of the examinees' native language and their level of English proficiency. The aim of this study was to appraise the effect of these examinee variables on the structure of the test. The interrelations among TOEFL items, using all of the information provided by the various responses to the items (the four alternatives, omitted, and not reached), were analyzed by three-way multidimensional scaling for samples of examinees systematically varying in native language and level of English proficiency. Four dimensions were identified: three corresponded to the sections of the test, and the fourth was an end-of-test phenomenon. The dimensions were predominantly defined by easy items and were most salient for low-scoring examinees. The salience of the dimensions did not differ for the various language groups, except for the end-of-test dimension. Major conclusions were the TOEFL's construct validity is supported, the test's interpretation varies with the examinees' English proficiency, easy and difficult items differ in their potential for diagnosis and global screening, and the dimensionality of the TOEFL and of competence in English depend on the examinees' English proficiency.

Read More