Interpreting Scores on the GRE Analytical Writing Measure

Score Interpretation

For the Analytical Writing section, each essay receives a score from two trained readers, using a 6-point holistic scale. In holistic scoring, readers are trained to assign scores on the basis of the overall quality of an essay in response to the assigned task. If the two assigned scores differ by more than one point on the 6-point scale, the discrepancy is adjudicated by a third, very experienced reader. Otherwise, the scores from the two readings of each essay are averaged. The scores on the two tasks are then averaged and a single score (rounded up to ½-point intervals) is reported for the Analytical Writing measure.

The primary emphasis in scoring the Analytical Writing measure is on examinees' critical thinking and analytical writing skills rather than on grammar and mechanics. Interpreting the score is, thus, tied to the score level descriptions. The skills that are evaluated include the ability to:

• articulate complex ideas clearly and effectively
• examine claims and accompanying evidence
• support ideas with relevant reasons and examples
• sustain a well-focused, coherent discussion
• control the elements of standard written English (a factor that plays a role only to the extent that poor writing skills impede readers' understanding of the argument).

Score Interpretation for Non-native English Speakers

The issue of score interpretation is somewhat more complicated for students whose native language is not English. As a performance assessment, the GRE Analytical Writing measure provides a snapshot of examinees' analytical writing ability before entry into graduate school. If non-native speakers do not understand the task being posed to them, their performance will be affected. Test users should consider a variety of pieces of information about these applicants, including scores for the Writing section of the TOEFL test, to determine whether to admit these students.

Looking at both the TOEFL and GRE writing measures can be helpful because these two assessments are very different. Unlike Analytical Writing, the Writing section of the TOEFL test is not designed to measure higher levels of thinking and analytical writing, but centers instead on command of English vocabulary, grammar, and syntax. Because the TOEFL test emphasizes fundamental writing skills, the TOEFL Writing score can supplement an Analytical Writing score by helping faculty determine whether a low score on the GRE Analytical Writing measure is due to lack of familiarity with English or to lack of ability to produce and analyze logical arguments.

Preliminary Analytical Writing Score Distribution

Table 1 below contains analytical writing score distribution. The data are based ONLY on examinees who tested between October 2002 and June 2004. It is likely the examinees on whom the percentiles were calculated scored higher on the analytical writing section than will be true of the entire GRE population because:

• examinees who cannot produce good analytical writing essays may have tested before analytical writing was added to the General Test, and/or
• examinees who do produce good analytical writing essays may have wanted to test between October and June to show their proficiency in this area on their applications.

One major difference in the October 2002 - June 2004 test-taking population is illustrated in the following chart, which shows that for the October 2002 – June 2004 time period, U.S. citizens whose primary language is English represent about 67% of the test takers, whereas in a more typical year, they represent only about 57% of the test takers.

Table 1
(Based on the performance of examinees who tested between October 1, 2002, and June 30, 2004)

Use of GRE Scores

The GRE program has prepared How to Interpret and Use GRE Analytical Writing Scores to help departments determine how they can integrate Analytical Writing information into their admissions decisions. It is important to note that scores from the Analytical Writing measure should not be combined with the Verbal and Quantitative scores. Each measure should be considered separately because each provides insight into a different aspect of the applicant's abilities.