skip to main content skip to footer

Validation by the Multigroup-Multiscale Matrix: An Adaptation of Campbell and Fiske's Convergent and Discriminant Validational Procedure IFI

Author(s):
Centra, John A.
Publication Year:
1969
Report Number:
RB-69-84
Source:
ETS Research Bulletin
Document Type:
Report
Page Count:
13
Subject/Key Words:
Campbell, D. T., College Environment, Evaluation Methods, Fiske, D. W., Higher Education, Institutional Functioning Inventory (IFI), Matrices, Measurement Techniques, Multidimensional Scaling, Student Attitudes, Validity Studies

Abstract

Campbell and Fiske advocate an approach to investigating validity that employs a matrix of intercorrelations among tests representing more than one trait, each measured by more than one method. This paper presents an application of the Campbell-Fiske multitrait-multimethod procedure. Referred to as validation by the multigroup-multiscale matrix, this adaptation compares discrete groups of individuals and the scale scores that represent their responses to a multidimensional perceptual space. As used here, therefore, intergroup agreement on a set of perceptual scales is being assessed, and validity may be defined as the degree of similarity in responses by different constituent groups. The application is illustrated by analyzing group perceptions of their college environment as indicated by the Institutional Functioning Inventory. Multidimensional scales assessing the viewpoints of faculty, administrator, and student groups at 17 colleges and universities comprised the multigroup-multiscale matrix. Lack of agreement between the groups indicated scales that more likely reflect subjective interpretations of the environment rather than relatively objective environmental constructs. Convergent and discriminant information through the multigroup-multiscale matrix, while not confirming the theory underlying the measurement, does nevertheless appear to provide useful insights into how a current instrument is operating and how it might be improved.

Read More