angle-up angle-right angle-down angle-left close user menu open menu closed search globe bars phone store

Field Study Statistical Analysis for the Redesigned TOEIC Bridge Tests

Author(s):
Lin, Peng; Cid, Jaime; Zhang, Jiayue
Publication Year:
2019
Report Number:
RM-19-09
Source:
ETS Research Memorandum
Document Type:
Report
Page Count:
26
Subject/Key Words:
English Language Proficiency Field Studies Interrater Reliability Item Difficulty Redesign Statistical Analysis Test Reliability TOEIC Bridge Test

Abstract

This paper reports the results of a field study that contributed to the development of the redesigned TOEIC Bridge tests. The statistical analyses provide initial evidence to support claims that redesigned TOEIC Bridge test scores are consistent, and that test scores are meaningful indicators of English proficiency basic to intermediate levels. To better assess a test taker’s basic to intermediate English language proficiency in common everyday activities, ETS launched in June 2019 a comprehensive suite of redesigned TOEIC Bridge tests that includes all 4 essential communication skills (listening, reading, speaking, and writing). This paper reports the results of a field study conducted in April 2018 to evaluate the statistical properties of the redesigned TOEIC Bridge tests. The evaluation of the difficulty and discrimination of the items, correlation among different parts of the test, reliability of the scores, and interrater reliability for speaking and writing, not only helped to inform the final decisions regarding the final reporting scales of the redesigned TOEIC Bridge tests, but also allowed test developers make appropriate adjustments to the test design before the official launch in June 2019.

Read More