skip to main content skip to footer

Relevance of Rater-Ratee Acquaintance in the Validity and Reliability of Ratings

Author(s):
Freeberg, Norman E.
Publication Year:
1967
Report Number:
RB-67-55
Source:
ETS Research Bulletin
Document Type:
Report
Page Count:
20
Subject/Key Words:
Behavior Rating Scales, Interpersonal Relationship, Validity Studies

Abstract

Unacquainted Ss worked in three-man groups under relevant (mathematical tasks) and irrelevant (socializing) acquaintance conditions. Ss rated one another on scales that defined several cognitive skills. They were also rated on these same scales by Observers who were dependent upon visual information, exclusively, and were unacquainted with the group members or the specific nature of the tasks being performed. As hypothesized, group members under the relevant acquaintance condition achieved consistently good validity for all three cognitive areas-- with the best validity for ratings of math ability. Validity under the irrelevant acquaintance condition was nil on all scales. Observers, surprisingly, achieved significant validity (although at lower levels than participating group members) for ratings under the relevant acquaintance condition. Levels of inter- and intrarater reliability were not associated with levels of validity under the various rating conditions.

Read More