A Case for Adjusting Subjectively Rated Scores in the Advanced Placement Tests AP
- Author(s):
- Longford, Nicholas T.
- Publication Year:
- 1994
- Report Number:
- RR-94-58
- Source:
- ETS Research Report
- Document Type:
- Report
- Page Count:
- 24
- Subject/Key Words:
- Advanced Placement Program (AP), Free Response Tests, Interrater Reliability, Scoring, Variance Component Analysis
Abstract
The purpose of this report is to present a case for adjusting the scores for free response items in the Advanced Placement tests. Using information about the rating process from the reliability studies, administrations of the Advanced Placement test for three subject areas are analyzed, and it is shown that the minimum squared error score adjustments proposed by Longford (1993) result in changed AP grades for an appreciable percentage of the examinees. (24pp.)
Read More
- Request Copy (specify title and report number, if any)
- http://dx.doi.org/10.1002/j.2333-8504.1994.tb01632.x