skip to main content skip to footer

Validity Evidence to Support the Development of a Licensure Assessment for School Superintendents: A Job-Analytic Approach

Author(s):
Swiggett, Wanda D.
Publication Year:
2012
Report Number:
RM-12-15
Source:
ETS Research Memorandum
Document Type:
Report
Page Count:
31
Subject/Key Words:
Job Analysis, Licensure, Certification, School Superintendent, Validity, Praxis

Abstract

A job analysis was conducted to define knowledge/skills important for entry-level school superintendents. The results will be used to guide the development of new test content specifications for the School Leadership Series School Superintendent Assessment. A draft domain was constructed from national standards, textbooks, existing test specifications, and professional literature. A national advisory committee (NAC) of school superintendents, college faculty and a Department of Education representative reviewed and modified the draft domain to reflect the knowledge/skills they believed were important for safe and effective practice and needed at time of entry into the profession. The revised domain consisted of 54 statements clustered within three major categories: (a) Educational Leadership, (b) Instructional Leadership and (c) Administrative Leadership. Survey responses of 516 superintendents and faculty who prepare superintendents provided independent evidence of the importance of the domain. Respondents judged each knowledge/skill statement on a scale ranging from 1 (not at all important) to 5 (extremely important). A total of 52 knowledge/skill statements had mean ratings above 3.50 in the aggregate sample and for subgroups containing more than 30 respondents. The results indicate that these 52 statements may be considered appropriate for guiding the development of new test content specifications for the School Leadership Series School Superintendent Assessment.

Read More