skip to main content skip to footer

The Relationship Between Computer Familiarity and Performance on Computer-based TOEFL Test Tasks TOEFL ANCOVA PPT

Taylor, Carol; Jamieson, Joan; Eignor, Daniel; Kirsch, Irwin S.
Publication Year:
Report Number:
ETS Research Report
Document Type:
Page Count:
Subject/Key Words:
Test of English as a Foreign Language (TOEFL), Computer Assisted Testing, Language Proficiency, Test Bias, Analysis of Covariance (ANCOVA), Computer Literacy, Paper and Pencil Tests (PPT)


The examinees in Phase II were largely representative of those in Phase I, who were representative of the general TOEFL test-taking population. The effect of computer familiarity after adjustments for language ability was examined by performing a series of analyses of covariance (ANCOVAs), using TOEFL paper-and-pencil test score as the covariate. These analyses were followed by a series of ANCOVAs involving the computer familiarity variable and a number of other variables: gender, reason for taking the TOEFL test, times the TOEFL test had been taken, and location where the TOEFL test was taken. After controlling for language ability, the researchers found no meaningful relationship between level of computer familiarity and level of performance on computerized language tasks among TOEFL examinees who had completed the computer tutorial.

Read More