Approaches to Automated Scoring of Speaking for K–12 English Language Proficiency Assessments
- Author(s):
- Evanini, Keelan; Hauck, Maurice Cogan; Hakuta, Kenji
- Publication Year:
- 2017
- Report Number:
- RR-17-18
- Source:
- ETS Research Report
- Document Type:
- Report
- Page Count:
- 13
- Subject/Key Words:
- Automated Speech Scoring K–12 English Language Proficiency Assessment Artificial Intelligence Scoring Standards-Based Assessment English Learner Speaking Proficiency
Abstract
This report is the fifth in a series concerning English language proficiency (ELP) assessments for English learners (ELs) in kindergarten through 12th grade in the United States. The series, produced by Educational Testing Service (ETS), is intended to provide theory and evidence-based principles and recommendations for improving next-generation ELP assessment systems, policies, and practices and to stimulate discussion on better serving K–12 EL students. The first report articulated a high-level conceptualization of next generation ELP assessment systems (Hauck, Wolf, & Mislevy, 2016).The second report addressed accessibility issues in the context of ELP assessments for ELs and ELs with disabilities (Guzman-Orth, Laitusis, Thurlow, & Christensen, 2016). The third report focused on critical policy and research issues of summative ELP assessments that state use for accountability purposes (Wolf, Guzman-Orth, & Hauck, 2016).The fourth report dealt with one of the major uses of ELP assessments—the initial identification and classification of ELs (Lopez, Pooler, & Linquanti, 2016).The present report discusses approaches to using automated scoring technology for the evaluation of student-spoken responses on K–12 ELP assessments. As many states have begun to use computer-based ELP assessments, there is a growing interest in automated scoring of spoken responses to increase the efficiency of scoring. This report delineates major areas to consider in using automated speech scoring for K–12 ELP assessments (i.e., assessment construct and task design, scoring and score reporting, and artificial intelligence (AI) model development and test delivery) and makes recommendations for states on how to evaluate these considerations and determine a path forward.
Related reports:
-
Creating a Next-Generation System of K–12 English Learner Language Proficiency Assessments
by M. C. Hauck, M. K. Wolf, & R. Mislevy
ETS Research Report No. RR-16-06
http://dx.doi.org/10.1002/ets2.12092 -
Conceptualizing Accessibility for English Language Proficiency Assessments
by D. Guzman-Orth, C. Laitusis, M. Thurlow, & L. Christensen
ETS Research Report No. RR-16-07
http://dx.doi.org/10.1002/ets2.12093 -
Next-Generation Summative English Language Proficiency Assessments for English Learners: Priorities for Policy and Research
by M. K. Wolf, D. Guzman-Orth, & M. C. Hauck
ETS Research Report No. RR-16-08
http://dx.doi.org/10.1002/ets2.12091 -
Key Issues and Opportunities in the Initial Identification and Classification of English Learners
by A. A. Lopez, E. Pooler, & R. Linquanti
ETS Research Report No. RR-16-09
http://dx.doi.org/10.1002/ets2.12090
Read More
- Request Copy (specify title and report number, if any)
- https://dx.doi.org/10.1002/ets2.12147