Errors of Measurement, Theory, and Public Policy NCLB
- Author(s):
- Kane, Michael
- Publication Year:
- 2010
- Source:
- William H. Angoff Memorial Lecture Series, ETS Policy Information Center Report
- Document Type:
- Publication
- Page Count:
- 35
- Subject/Key Words:
- Angoff Memorial Lecture Series, Error of Measurement, Classical Test Theory, Education Policy, No Child Left Behind Act (NCLB)
Abstract
Errors of measurement arise because our observations are affected by many sources of variability, but our conceptual frameworks necessarily ignore much of this variability. Sources of variability that are not included in our models and descriptions of phenomena are treated as error or noise. A good theory of error supports the development of precise measurements, clearly defined constructs and sound public policy. Narrowly defined constructs that do not generalize much beyond the observed performances do not involve many sources of error, but constructs that generalize observed scores over a broad range of conditions of observation (e.g., context, time, test tasks) necessarily involve many potential sources of error. We can have narrow constructs with small errors or more broadly defined constructs with larger errors. Some errors that are negligible for individuals can have a substantial impact on estimates of group performance, and therefore, can have serious consequences.