Effects of Language of Administration on a Self-Assessment of Language Skills

Roever, Carsten; Powers, Donald E.
Publication Year:
Report Number:
RM-04-06, TOEFL-MS-27
Document Type:
Subject/Key Words:
Self-assessment score anchoring new TOEFL® test validation questionnaire


Self-assessments of English language skills have proven useful in a variety of settings. One threat to the validity of such assessments, however, is that responses may differ in meaning according to whether the assessment is administered in English or in the respondent's native language. This study investigated the effect of administering a self-assessment of English language skills in English versus in the self-assessor's native language. Study participants—115 volunteers located at test sites in Germany, Mexico, Korea, and Taiwan—completed self-assessments in both their native languages and English. The results revealed comparable responses in both languages in terms of reliability, level, and variation. Most important, the correlations between self-assessment scales given in English and those given in participants' native languages were virtually perfect when corrected for attenuation due to unreliability.

Read More


Find a Publication

Advanced Search

Closing the Achievement Gap

Closing the Achievement GapLearn more about ETS's commitment to closing the achievement gap through rigorous research, thought-provoking forums and more.