Native Language, English Proficiency, and the Structure of the Test of English as a Foreign Language™
- Oltman, Philip K.; Stricker, Lawrence J.; Barrows, Thomas S.
- Publication Year:
- Report Number:
- RR-88-26, TOEFL-RR-27
- Journal of Applied Psychology, 1990, 75(1), 21-27.
- Document Type:
- Subject/Key Words:
- Construct validity English as a second language language dominance language proficiency language tests
Responses on the TOEFL® test may reflect both the influence of the examinees' native language and their level of English proficiency. The aim of this study was to appraise the effect of these examinee variables on the structure of the test. The interrelations among TOEFL items, using all of the information provided by the various responses to the items (the four alternatives, omitted, and not reached), were analyzed by three-way multidimensional scaling for samples of examinees systematically varying in native language and level of English proficiency. Four dimensions were identified: three corresponded to the sections of the test, and the fourth was an end-of-test phenomenon. The dimensions were predominantly defined by easy items and were most salient for low-scoring examinees. The salience of the dimensions did not differ for the various language groups, except for the end-of-test dimension. Major conclusions were the TOEFL's construct validity is supported, the test's interpretation varies with the examinees' English proficiency, easy and difficult items differ in their potential for diagnosis and global screening, and the dimensionality of the TOEFL and of competence in English depend on the examinees' English proficiency.