skip to main content skip to footer

The Effects of Extended Planning Time on Candidates’ Performance, Processes, and Strategy Use in the Lecture Listening-Into-Speaking Tasks of the TOEFL iBT Test TOEFL CIU CAF IU IELTS IIU MP L1 L2

Author(s):
Inoue, Chihiro; Lam, Daniel M. K.
Publication Year:
2021
Report Number:
RR-21-09
Source:
ETS Research Report
Document Type:
Report
Page Count:
32
Subject/Key Words:
TOEFL iBT, Test of English as a Foreign Language (TOEFL), English Language Proficiency, Combined Idea Unit (CIU), Complexity, Accuracy, and Fluency (CAF), Individual Idea Unit (IIU), Idea Unit (IU), International English Language Testing System (IELTS), Macro Proposition (MP), Primary Language (L1), Secondary Language (L2), Planning, Listening Comprehension, Speaking Proficiency, Cognitive Abilities, Metacognitive Behavior, Metacognitive Strategies, Integrated Language Tasks, Target Domain, United Kingdom, College and University Programs, Stimulated Recall

Abstract

This study investigated the effects of two different planning time conditions (i.e., operational [20 s] and extended length [90 s]) for the lecture listening-into-speaking tasks of the TOEFL iBT test for candidates at different proficiency levels. Seventy international students based in universities and language schools in the United Kingdom (35 at a lower level; 35 at a higher level) participated in the study. The effects of different lengths of planning time were examined in terms of (a) the scores given by ETS-certified raters; (b) the quality of the speaking performances characterized by accurately reproduced idea units and the measures of complexity, accuracy, and fluency; and (c) self-reported use of cognitive and metacognitive processes and strategies during listening, planning, and speaking. The results found neither a statistically significant main effect of the length of planning time nor an interaction between planning time and proficiency on the scores or on the quality of the speaking performance. There were several cognitive and metacognitive processes and strategies where significantly more engagement was reported under the extended planning time, which suggests enhanced cognitive validity of the task. However, the increased engagement in planning did not lead to any measurable improvement in the score. Therefore, in the interest of practicality, the results of this study provide justifications for the operational length of planning time for the lecture listening-into-speaking tasks in the speaking section of the TOEFL iBT test.

Read More