ETS Using Unique Approach to Setting Cut Scores on Teacher Licensure Assessments
- Jason Baran
- Jason Baran
Princeton, N.J. (July 28, 2010) —
More than 20 states are expected to participate in a Multi-State Standard Setting Study in September to develop qualifying-score recommendations for the new Praxis™ Technology Education test. This unique standard-setting process, first developed by ETS, is being used to assist states in setting their passing score for the new Praxis licensure test.
Using this approach, ETS convenes panels of practitioners from many states to provide input into a passing-score recommendation to states. The panelists evaluate the questions systematically, and their question-by-question feedback forms the basis of an extensive research report that presents the results of the Multi-State Standard Setting Study to the 27 states that use this Praxis test.
"I have greater confidence in the value of the test score as a result of participating in the Multi-State Standards Setting Panel," said Dr. Shirley Marie McCarther, assistant professor, University of Missouri-Kansas City who participated in a recent similar study conducted for the School Leaders Licensure Assessment.
The current study will be focused on a new Praxis Technology Education test that has been updated to reflect the most recent standards published by the International Technology Education Association. The Technology Education study will be the 14th study completed since Praxis began using this approach in 2009. Following the Technology Education study, four more studies are planned for 2010.
"ETS has the only educator licensure testing program that is currently providing states the opportunity to participate in Multi-State Standard Setting Studies," said ETS Vice President and Chief Operating Officer of Teacher Licensure and Certification, Linda Tyler. "The process offers several advantages, including reducing states' burden of recruiting educators."
"The approach involves two independent panels to replicate the standard setting process," said Director of Research and co-developer of the multi-state process Dr. Richard Tannenbaum. He cites several advantages for states of the multi-state process over state-by-state studies such as:
- Reduced state burden of recruiting educators
- Shorter implementation of new tests used for licensure
- Greater educator input into the passing score recommendation (up to 50 educators)
- Added support for states seeking greater interstate licensure portability
Ultimately, each state maintains control by setting its own passing score for a test; these multi-state studies provide valuable judgments to inform the state's final decision. State-specific standard setting studies are also available, but use of the multi-state approach is particularly beneficial in cases where states have difficulty gathering sufficient practicing professionals to engage in these studies.
At nonprofit ETS, we advance quality and equity in education for people worldwide by creating assessments based on rigorous research. ETS serves individuals, educational institutions and government agencies by providing customized solutions for teacher certification, English language learning, and elementary, secondary and post-secondary education, as well as conducting education research, analysis and policy studies. Founded in 1947, ETS develops, administers and scores more than 50 million tests annually — including the TOEFL® and TOEIC® tests, the GRE® tests and The Praxis Series™ assessments — in more than 180 countries, at over 9,000 locations worldwide. www.ets.org
Learn how ETS offers advice on common state assessments.
ETS has assisted the NAEP program in introducing numerous psychometric and assessment design innovations over the years. Learn more >