How ETS Protects the Integrity of the TOEFL® Test

Prevention. Detection. Communication.

The competition among students applying to academic programs creates significant challenges for academic institutions and other stakeholders, including attempts by test takers to gain an unfair advantage on required tests or falsify score information.

ETS has long been at the forefront of combatting test security concerns. Our strategy is a three-pronged approach of prevention, detection and communication, which is designed to protect the integrity of test scores.

In addition, the ETS Office of Testing Integrity constantly monitors testing, investigates security issues and strives to ensure score validity worldwide, maintaining its long-standing commitment to reliable and secure test scores.

Prevention — Five Ways ETS Works to Prevent Breaches of Test Security

ETS has various procedures in place to address test security. These can be seen from the test design right through to the score reporting process. Here are some of the ways the integrity of TOEFL® test is protected from beginning to end.

1. Using the Highest Standards to Create Test Content

As a not-for-profit research and assessment organization, ETS is committed to the highest standards in developing test content, supported by more than 150 research studies. Watch our video, How ETS Develops Test Questions (Flash), to see all the steps we take to develop and review each question before it can appear on an ETS test.

In 2005, the TOEFL iBT® test pioneered the use of integrated test questions in a large scale language assessment. Integrated questions require test takers to demonstrate how well they can actually use English to communicate in the classroom by combining the language skills of reading, listening, speaking and writing. These integrated test questions not only provide important information on language ability, their design deters memorization of text to fit into responses, making these questions less amenable to coaching.

2. Establishing Secure Test Centers

Test administrations occur at Certified Test Administration Sites (CTAS). Each CTAS undergoes a screening process through ETS designed to ensure secure testing.

  • Test center applicants receive an initial pre-qualification review to determine if the facilities meet security and CTAS technical requirements, and to obtain verifiable references.
  • ETS uses the same Internet security protocols as those used by major financial institutions for their secure transmissions. The communication channel uses state-of-the-art encryption, and our software is able to detect whether a transmission was altered or disrupted.
  • Test content that is downloaded to a test center computer is encrypted and cannot be accessed until the actual test administration begins.

At the beginning of each test administration, the test software automatically closes all non-TOEFL iBT windows or applications, including instant messaging (IM). It closes any applications that try to open during the test and then automatically logs the incident. The software also locks the desktop, suppressing key combinations so the test taker cannot switch to any other task.

3. Training of Test Center Administrators

Test center staff are thoroughly trained to prepare for managing test administrations. As such, test center staff are required to pass a certification exam to demonstrate their knowledge of test delivery, as well as testing policies and procedures before they can serve as Test Center Administrators. Training includes the following security-related topics:

  • Identification requirements
  • Check-in procedures on the day of the test
  • Security of test data and computers used for testing
  • Test center layout and required distance between test takers
  • Monitoring of test takers during the test

ETS provides a Policies, Practices and Procedures Manual to test center supervisors. All policies and procedures in the Manual must be followed.

ETS conducts announced and unannounced audits of test sites, as well as visits by mystery shoppers, to observe and confirm that ETS standards are being applied properly at test centers around the world.

4. Instituting and Enforcing Test-taker Rules and Requirements

On the day of the test, test takers have to meet several security requirements in order to test, including:

  • Showing ETS-approved forms of identification that contain a photograph and signature; some locations require an ID with an electronic chip
  • Providing handwriting and signature samples
  • Signing an agreement that they have read and will adhere to all policies and procedures
  • Having their photos taken at the center and embedded into their score reports
  • Passing through security wanding when entering the testing room, to detect unauthorized items
  • Monitoring with video cameras (select locations)

To reinforce these procedures, test takers are encouraged to watch our TOEFL iBT Testing Site video (Flash) for a preview of what to expect on test day.

After checking in at the test center, test takers:

  • Are prohibited from bringing items into the testing room that could be used as a testing aid or to collect, share or collaborate on test content.
  • Have no access to personal items such as electronic devices, books, handbags and backpacks, all of which are stored separately from the test takers to maintain security.
  • Must have their identity verified by the test center administrator before starting the test, using the digital photo taken at check-in.
  • Must present their identification to the test center administrator and have their identity verified upon returning from breaks.

5. Maintaining the Quality of Scoring and Score Reporting

To further safeguard against test takers obtaining unfair advantages, scoring does not occur at the test center. ETS separates the scoring process from the testing process, eliminating many security issues that would arise from giving test administrators access to scoring tools. Also, test administrators cannot be directly involved in English-language instruction or test preparation, and they cannot administer the test to an individual where it could present the appearance or actual possibility of a conflict of interest.

Because ETS separates scoring from test administration, raters receive spoken and written responses from test takers worldwide; there is no possibility they will know the individuals whose responses they are given to score. See our scoring page to read more about how ETS scores the TOEFL test.

Another way ETS works to protect the integrity of scores is through the security measures implemented for paper score reports. There are two types of TOEFL score reports issued on paper:

  • The official score report, which is sent directly from ETS to the institutions or agencies designated by the test taker. Prior to test day, test takers can select up to four score recipients at no charge. They can also order additional score reports later for a nominal fee.
  • The test taker score report, which is sent from ETS to test takers who request a paper copy.

Official score reports are printed on purple security paper; test taker score reports are on green paper. ETS uses secure paper for TOEFL score reports, including the following features:

  • The security paper is Appleton DocuCheck® Watermark with TonerFuse 2. It contains a chain-link watermark on the back of the paper, which is visible when held at a 45-degree angle. This is the easiest, most obvious method of verifying the authenticity of an official score report.
  • There is a Full Chemical Sensitive VOID on the face of the paper. The word "VOID" is continuously repeated on an angle throughout the entire face of the document. "VOID" is produced in multiple languages when activated by a bleach, hypochloride or ink eradicator.
  • In addition, TOEFL score reports now include the words "ETS® Security Guard" in the upper right-hand corner, printed with a special heat-sensitive ink for security. To activate this security feature, recipients can apply heat to the text, either by rubbing it or blowing on it, and the ETS Security Guard text will disappear. This feature will not work if the score report has been photocopied.
  • There is a Laser Lock on the face of the paper. This makes it difficult to remove toner from laser- or ion-printed documents.
  • There are also laid lines on the back of the paper. Evenly spaced lines in a specially formulated grey ink, these laid lines make alteration by cutting and pasting difficult.

Detection — ETS is Vigilant in Identifying and Taking Action Against Test Taker Misconduct

Even with the most stringent security prevention measures in place, some test takers will try to gain an unfair advantage on the test. ETS investigates all reported incidents of misconduct, which can include photographic review, handwriting analysis and voice biometric analysis. The results of an investigation may lead ETS to cancel the score or ban the test taker from future ETS tests.

ETS uses biometric voice identification software similar to technologies used in the banking, law enforcement and healthcare industries. This technology helps ETS identify suspected impersonations and cancel those TOEFL iBT scores before they are reported.

ETS closely monitors all test centers and tracks all security incidents. If it is determined that a test center does not meet ETS standards, it is closed. ETS also conducts random inspections of test centers as well as site audits at centers where concerns have been raised through supervisor reports, tips or test taker complaints. In some cases, ETS collaborates with local and national law enforcement agencies to prosecute professional impersonation rings.

Monitoring Score Statistics

ETS reviews and analyzes scores after each test using statistical analysis methods to help identify invalid scores. The ETS Statistical Analysis team monitors score trends by test center, country and region.

  • System-generated irregularity reports are reviewed after each administration.
  • Site historical performance data is maintained to identify any discrepancies that need to be addressed.
  • Sites are subject to quality audits and third-party observations.

Watch Psychometrics at ETS: The Science of Assessment (Flash) to learn more about ETS’s Statistical Analysis, Data Analysis & Psychometric Research areas.

Communication — Keeping Score Users Informed is Our Priority

ETS works very closely with the institutions and agencies we serve around the world. ETS informs institutions that have been designated as score recipients when scores have been canceled. In addition, every concern regarding test results reported by an institution or agency will be investigated.

In the academic community, we are all dealing with a world where the motivation and capability to commit academic and admissions cheating is on the rise. ETS will continue adapting best practices and creating new technologies to prevent and detect breaches of test security.

ETS is committed to giving you results you can trust.

For additional security questions or concerns, please contact us at TSReturns@ets.org or call the Security Hotline at 1-800-750-6991 (United States) or +1-609-406-5430 (all other locations).

See also:

 

 

TOEFL Institutions

FACT: 4 out of 5 Institutions Prefer the TOEFL Test

Among admissions officers surveyed, and who expressed a preference*, four out of five prefer the TOEFL test.

* Source: Survey of 263 admissions officers at U.S. universities, of which 212 accept both the TOEFL test and the IELTS™ test and 152 state a preference.

Join the TOEFL Mailing List

Get the latest TOEFL news and information.
Sign up now >