Examining Linguistic Characteristics of Paraphrase in Test-Taker Summaries

Author(s):
Burstein, Jill; Flor, Michael; Tetreault, Joel R.; Madnani, Nitin; Holtzman, Steven
Publication Year:
2012
Report Number:
RR-12-18
Source:
ETS Research Report
Document Type:
Report
Page Count:
46
Subject/Key Words:
Test of English as a Foreign Language (TOEFL) Non-Native Speakers Paraphrase Strategies Summary Writing Annotation Study Writing Electronic Essay Rater (E-rater)

Abstract

This annotation study is designed to help us gain an increased understanding of paraphrase strategies used by native and nonnative English speakers and how these strategies might affect test takers’ essay scores. Toward that end, this study aims to examine and analyze the paraphrase and the types of linguistic modifications used in paraphrase in test-taker responses and differences that may exist between native and nonnative English speakers. We are also interested in how these factors might influence final essay score. Outcomes discussed in this report can be used to inform the development of new e-rater® scoring engine features that capture information related to paraphrase, specifically in nonnative speaker responses to the TOEFL® exam integrated writing task.

Read More