skip to main content skip to footer

Using Multilevel Analysis to Monitor Test Performance Across Administrations

Author(s):
Wei, Youhua; Qu, Yanxuan
Publication Year:
2014
Report Number:
RR-14-29
Source:
ETS Research Report
Document Type:
Report
Page Count:
18
Subject/Key Words:
Multilevel Analysis, Background, Test Performance, Quality Control, Prediction, Test Administrations

Abstract

Based on the data of 330,091 examinees’ test scores and their background information collected from 254 administrations of an English-speaking test, the study found: (a) at the individual examinee level, examinees’ background had statistically significant relationships with their test performance, and the relationships varied across administrations; however, the prediction of individuals’ test scores based on their background variables was not strong, and (b) at the administration level, group composition had strong relationships with administration means; the prediction of administration means based on group composition variables was fairly strong.The results suggest that multilevel analysis has potential application in understanding and monitoring test performance across administrations by identifying statistical relationships between examinees’ characteristics and their test performance at both individual and administration levels.

Read More