AP Online Distributed Scoring Overview
- When and where will online distributed scoring of AP® Exams take place?
In June 2017, some Readers in certain subjects — U.S. History: Short Answer; European History: Short Answer; Spanish Language and Culture Speaking, Research, and Seminar — will score online from their home or office. These Readers must own a computer with a reliable Internet connection to score online, and must have access to a phone which can make and receive long-distance calls. Online distributed scoring will take place concurrently with the onsite Reading. To find out when your subject's Reading will take place, go to the AP Reading Calendar. Flexible and part-time schedules are available over the course of the seven-day Reading.
- What are the online scoring requirements?
Readers will score student responses and performance tasks using a web-based scoring system. For specific technical requirements, please refer to the subject-specific job details on the Online Scoring Opportunities page.
- Why will Readers score in an online, distributed fashion?
Online distributed scoring enables us to engage a new set of potential Readers and teachers for subjects where there are shortages of available Readers, and provides Reading opportunities for qualified individuals who would otherwise not be able to participate due to the time commitment and travel required by the on-site Reading. It allows us to extend scoring opportunities to interested educators who would benefit from the professional development gained by attendance at the Reading, but have traditionally been unable to participate due to school schedules or other conflicts. Online distributed scoring will offer benefits to Readers such as scoring exam responses from AP high school students, learning how to apply a rubric consistently and earning Continuing Education Units.
Scheduling and Timing
- What is the time commitment for being an online distributed Reader? Is there a part-time option available? What does this entail?
Upon registering for the Reading, online distributed Readers will be expected to commit to scoring a fixed number of student responses, which varies depending on the AP subject. Different levels of commitment will be available, reflecting both full-and part-time options. Readers will be able to work at their own pace, provided that they maintain quality in their scoring and meet their commitment over the course of the seven days of the Reading. This includes high school teachers whose schools may still be in session during the week of the Reading, and who may score before or after school hours.
In addition, Readers must complete online system training and certification prior to the Reading dates, which takes approximately four hours on average.
- Can Readers score at any time during the day or evening? Or, are there set hours during which Readers must score?
All online distributed scoring must be completed during the seven days of the Reading. At the beginning of the Reading, before scoring student responses, Readers must complete rubric training. Depending on the AP subject in question, some Readers may be required to score during the hours that the onsite Reading is in session, while others may have the option to score at any time of day. Specific information for each subject will be provided upon registering for the Reading.
- What is the time commitment before the start date? What is the time commitment after the end date?
Before the start date, Readers must complete system training and certification, which takes on average, four hours, depending on the AP Subject. After the end date, there is no time commitment for Readers; however, on rare occasions Readers may be asked to voluntarily continue scoring, if necessary, to finish scoring all the exams.
- How will I be paid for the scoring work that I do?
Distributed Reader compensation is determined by the number of student responses scored over the course of the Reading and an item-specific pay rate. Rates can vary by subject and item. Estimated scoring compensation is based on the size of the student response scoring commitment made at Registration. For example:
Scoring commitment: 500 responses
Expected compensation: $1,500
Scoring commitments are sized to be achievable during the course of the Reading by most Readers, although some Readers may score fewer responses than their commitment while others may score more; the calculation method remains the same, with item rate multiplied by the actual number of responses scored. Readers are also compensated at a flat rate for time spent completing training. Total compensation for a Reader who completes scoring a full commitment of responses is comparable to the stipend paid to onsite Readers; part-time commitments are proportionally comparable.
Training, Feedback and Collaboration
- When and how does training occur?
System training may be completed any time between registering and the start of the seven days of Reading. Content training occurs at the beginning of the first day of the Reading or at the beginning of the Reader's first session. Depending on the subject, initial training will take between two and eight hours, and may be either self-paced or conducted via teleconference by a Scoring Leader. All Reader training is conducted using online documents, sample student responses and features included in the online scoring system.
- Will Readers be monitored and receive feedback during their scoring session?
Yes, distributed AP Readers will be monitored by scoring leadership throughout the Reading. One of the monitoring tools that will be used for online scoring is back-reading, which occurs when a Scoring Leader reads and scores a response that has been scored by a Reader. This helps to ensure Readers are providing accurate scores. The online scoring system includes several features for Scoring Leaders to give feedback to Readers, including ways to give general feedback or feedback tied to specific scored responses. Table Leaders and Readers are also able to speak to each other on the phone or via email if needed, and also use the scoring system's online chat.
- Can Readers proactively reach out for feedback or collaboration?
Yes, the online scoring system has features that Readers can use to contact their Scoring Leader at any time during specified Reading hours to discuss their scoring. Readers can connect with their Scoring Leader using features like online chat and/or appending notes or questions to particular responses.
- What Internet speed is required to score online? How do I know if my Internet speed is fast enough? Will I be able to score if my Internet is slower than recommended?
Online distributed scoring requires an Internet speed of 2 Mbps for non-video scoring and 5 Mbps for constructed responses that contain videos. There are several free Internet connection bandwidth tests you can run to determine your network speed. We recommend www.speedtest.net.
If a Reader's Internet speed is slow, the Reader will experience slowness when responses are loaded. This may negatively impact the number of responses the Reader is able to score over the duration of the Reading.