Reliability and Comparability of TOEFL iBT Scores TOEFL iBT
- Author(s):
- Educational Testing Service; Norris, John M.
- Publication Year:
- 2020
- Source:
- TOEFL Research Insight Series, v3 n1, 3rd edition, 2020
- Document Type:
- Periodical
- Page Count:
- 16
- Subject/Key Words:
- TOEFL iBT, Test Security, Test Score Reliability, e-rater, Automated Scoring of Written Content, Test Fairness, Test Scoring, Human Raters, SpeechRater, Scaling, Test Equating, Score Comparability
Abstract
ETS has always been committed to the quality of its test scores. A fundamental part of test score quality is ensuring that scores reported on different versions (e.g., test forms) of the same test can be interpreted in the same way. In other words, to be useful to score users, test scores must be reliable and comparable. As an ETS assessment program, the TOEFL program strives to ensure score reliability and comparability through strict adherence to the guidelines and practices established for the development and operational implementation of the TOEFL iBT test. Evidence of score reliability and test score comparability is important because this evidence supports an argument that test scores will have the same meaning across test forms. ETS ensures that TOEFL iBT scores are reliable and comparable through five major areas of practice: - Implementing standardized administration and test security procedures - Using detailed test specifications to guide test development - Monitoring score reliability - Employing an appropriate scale for reporting scores - Using equating and other means to maintain comparable scores across test forms In this volume of the TOEFL Research Insight Series, we describe the general procedures and guidelines that are used to achieve score reliability and comparability for the TOEFL iBT test, with the aim of helping score users and test takers understand how score quality is ensured by ETS. The TOEFL Committee of Examiners (COE), a body of twelve individuals from around the world, each of whom has achieved professional recognition in an academic field related to English as a second or foreign language, works closely with ETS on its program of research.