Mapping TOEIC Writing Test Scores to the American Council on the Teaching of Foreign Languages (ACTFL) Proficiency Guidelines for Writing TOEIC ACTFL
- Author(s):
- Lee, Shinhye; Hille, Kathryn; Renka, Ohta
- Publication Year:
- 2022
- Report Number:
- RM-22-01
- Source:
- ETS Research Memorandum
- Document Type:
- Report
- Page Count:
- 58
- Subject/Key Words:
- TOEIC Writing, ACTFL Proficiency Guidelines, Standard Setting, Cut Scores, Score Interpretation, Validity, Construct, Alignment of Standards, TOEIC Speaking and Writing Tests, Writing Evaluation, Writing Proficiency, Framework
Abstract
Proficiency frameworks and standards have been widely used as common reference points, not only in direct service for educators as educational road maps, but also for local/international testing programs as they strive to provide clarity and transparency in score interpretations and uses. One common example of the latter, which is also the primary focus of the current research report, is when test developers engage in the so-called standard setting process. In this paper, we report a standard setting study that aimed to establish an interpretive link between TOEIC Writing test scores and the American Council on the Teaching of Foreign Languages (ACTFL) Proficiency Guidelines for writing. Following well-established procedures and methods recommended in the field, we describe the process of evaluating construct congruence, composing and training an expert panel, and incorporating multiple sources of information to recommend final cut scores. In addition, we present numerous types of information that function as evidence supporting the validity of the procedures and outcomes of the study.
Read More
- Request Copy (specify title and report number, if any)
- https://www.ets.org/Media/Research/pdf/RM-22-01.pdf