skip to main content skip to footer

Engineering Products: Experimental Manipulations and Ratings by Supervisors and Engineers

Author(s):
Sprecher, Thomas B.
Publication Year:
1965
Report Number:
RB-65-27
Source:
ETS Research Bulletin
Document Type:
Report
Page Count:
31
Subject/Key Words:
Engineering, Evaluation Criteria, Interrater Reliability, Professional Recognition, Summative Evaluation

Abstract

When descriptions of engineering products were deliberately altered, supervisors responded positively to increases in the additional contributions reported. The marked spread of scores occurring when all judges rated the same nonmanipulated product is only in part due to the moderate test-retest reliability of the judgments. Differing criteria systems and even differing perceptions of the kind of achievement (e.g., novel versus conventional) were also involved.

Read More