skip to main content skip to footer

Administrators' Uses of Teacher Observation Protocol in Different Rating Contexts LAUSD

Qi, Yi; Bell, Courtney A.; Jones, Nathan D.; Lewis, Jennifer; Witherspoon, Margaret; Redash, Amanda
Publication Year:
Report Number:
ETS Research Report
Document Type:
Page Count:
Subject/Key Words:
Teacher Observation, Teacher Quality, Rater Cognition, Teaching Measurement, Classroom Observation Protocols, Los Angeles Unified School District (LAUSD), Think Aloud


Teacher observations are being used for high‐stakes purposes in states across the country, and administrators often serve as raters in teacher evaluation systems. This paper examines how the cognitive aspects of administrators' use of an observation instrument, a modified version of Charlotte Danielson's Framework for Teaching, interact with the complex and dynamic rating contexts in applied settings. Findings suggest that administrators' rating strategies and rating approaches vary as the characteristics of the rating contexts differ. Even shortly after training (and more so as time passed), raters used reasoning strategies not supported by their training to make scoring decisions. We discuss the implications of the findings for the training of raters and the development of evaluation systems in high‐stakes contexts.

Read More