Psychometric Advances, Opportunities, and Challenges for Simulation-Based Assessment ECD CAT GBA IRT
- Author(s):
- Levy, Roy
- Publication Year:
- 2012
- Source:
- Paper presented at the Invitational Research Symposium on Science Assessment, May 7-8, 2012
- Document Type:
- Paper
- Page Count:
- 47
- Subject/Key Words:
- Simulations, Evidence Centered Design (ECD), Assessment Delivery, Computer Adaptive Test, Game-Based Assessment (GBA), Psychometric Assessment, Psychometric Challenges, Psychometric Models, Item Response Theory (IRT), ETS K-12 Center
Abstract
Related aspects, strategies, and pitfalls in other parts of the assessment development process that must cohere with the psychometric model are discussed, including those surrounding assessment design, data analysis, and assessment and model revision. It is further argued that many of the key challenges facing psychometrics of simulation-based assessment are best resolved by a principled approach to assessment design in concert with data analysis. Strategies for solutions to some of the more imminent challenges to psychometrics for simulations are discussed, and potential short- and long-term future developments are suggested.