Keeping Test Content Current
How Are Tests Updated To Keep Content Current?
ETS is committed to keeping the content of the Praxis® tests up-to-date and aligned with professionally accepted standards, and tests are therefore reviewed on a regular basis. We involve stakeholders in this process by asking them to nominate teachers and teacher educators to serve on Test Development Standing Committees and National Advisory Committees (NACs). Teachers and teacher educators interested in serving on one of these committees can register at www.ets.org/praxiscomm.
The Test Development Standing Committees review the specifications for each Praxis test title on an annual basis to determine whether there are circumstances that require revision of the test specifications or regeneration of the test. The questions that the Standing Committees answer include the following:
- Do the test specifications still represent knowledge and/or skills that are important for competent, beginning-level practice?
- Are there areas of knowledge and/or skill that are not included but are critical for competent, beginning-level practice?
- Are there content categories in the test specifications that we need to update to reflect current practice?
- Do the current proportions among the content categories in the test specifications still reflect current practice?
- Are there changes on the horizon that could impact these specifications in the future, either at the national level or within a particular state?
The results of these specification reviews determine the plan for regeneration of a test or test series. ETS researchers, psychometricians and test developers analyze the reviewers’ answers and comments and use expert judgment to determine a path forward for each test or test series. The group would typically choose one of three options, depending on the answers to the questions provided by the Standing Committee:
- Internal and external experts validate the test specifications and no National Advisory Committee (NAC) meeting is necessary; test specifications remain unchanged.
- When updates are straightforward, we use content expertise we have in house to draft updated test specifications to improve alignment; external experts then validate the specifications via a virtual meeting. We make these updates when the test specifications do not match current professional standards in the field.
- When updates are not straightforward, a NAC is convened to update the test specifications to improve alignment, and ETS performs a job analysis confirmation survey. These updates are necessary when test specifications do not match current professional standards if they exist, or internal and external experts determine the specifications are outdated.
When a NAC is convened, the Praxis client states help ETS recruit 12–15 licensed practicing professionals who are close to the beginning of their teaching practice, as well as college faculty who prepare teachers for that specific licensure area. The NAC works closely with ETS assessment specialists to define the content domain and later to develop the test blueprint and test content specifications. NAC meetings typically take place on the ETS campus in Princeton, New Jersey.
After the NAC meets to define the test domains, a job analysis survey is conducted to confirm these domains. A job survey is conducted for new tests and for existing tests that are being significantly revised. The job analysis survey enables relatively large numbers of practitioners from across the country to judge the importance of the knowledge and/or skills defined by the NAC for beginning-level practice. The practitioners' judgments serve as an independent source of validation evidence. Once the results of the survey have been analyzed, the NAC is reconvened to develop the test blueprint and test specifications.
After the NAC develops the test blueprint and test specifications, ETS convenes panels of licensed practicing educators and college faculty from user states to conduct standard-setting studies. Each standard-setting panel confirms that the knowledge and/or skills represented in the test content specifications are important for entry-level practice and recommends a passing score for each state to consider when setting its own passing score.
The Praxis program will be rolling out 14 newly regenerated assessments in the 2014–2015 testing year. The four Elementary Education tests (Elementary Education: Curriculum, Instruction, and Assessment; Elementary Education: Content Knowledge; Elementary Education: Instructional Practice and Applications; and Elementary Education: Multiple Subjects) and the new Education of Young Children test have been redesigned to align with the Common Core State Standards (CCSS) for English Language Arts and Mathematics.
States will consider the recommended passing scores from the standard-setting studies when they set passing scores for their jurisdictions. Please note that the regenerated tests have a new test code number. See the 2014–15 Regenerated Tests chart below for more information about each of these tests. Any state wishing to review the new forms of these tests should contact their Client Relations Director at PraxisClientRelations@ets.org.
Regenerated Tests for 2014–2015 testing year:
|New Test Code||Old Test Code||Test Title||Notes|
|5701||0700||Agriculture||Regenerated test with Multistate Standard-Setting Study.|
|5024||5021||Education Of Young Children||Regenerated test with Multistate Standard-Setting Study.|
|5018||5014||Elementary Education: Content Knowledge||Regenerated test with Multistate Standard-Setting Study. Math and ELA content aligned to the Common Core State Standards.|
|5017||5011||Elementary Education: Curriculum, Instruction, and Assessment||Regenerated test with Multistate Standard-Setting Study. Math and ELA content aligned to the Common Core State Standards.|
|5019||5015||Elementary Education: Instructional Practice and Applications||Regenerated test with Multistate Standard-Setting Study. Math and ELA content aligned to the Common Core State Standards.|
|5001||5031||Elementary Education: Multiple Subjects|
|5122||5121||Family And Consumer Sciences||Regenerated test with Multistate Standard-Setting Study.|
|5358||0357||Gifted Education||Regenerated test with Multistate Standard-Setting Study.|
|5857||5856||Health And Physical Education: Content Knowledge||Regenerated test with Multistate Standard-Setting Study.|
|5440||0439||Middle School Science||Regenerated test with Multistate Standard-Setting Study.|
|5402||0401||School Psychologist||Regenerated test with Multistate Standard-Setting Study.|
|5952||0950||Sociology||Regenerated test with Multistate Standard-Setting Study.|
|5322||0321||Special Education: Teaching Students With Intellectual Disabilities||Regenerated test with Multistate Standard-Setting Study.|
|5331||5330||Speech Language Pathology||Regenerated test with Multistate Standard-Setting Study.|
Computer Roll Out Schedule
Beginning with the 2014–2015 testing year, Praxis becomes a fully computer-delivered testing program.
Computer-delivered Tests Rolling Out in the 2014–2015 Testing Year:
|Available in September 2014|
|5440||Middle School Science|
|5322||Special Education: Teaching Students with Intellectual Disabilities|
|Available in October 2014|
|5135||Art: Content and Analysis|
For questions or further information, please contact your Client Relations Director at PraxisClientRelations@ets.org.