Review our Global Institute sample agenda for the course "Design and Development of Large-Scale Assessments."
| Topic | Learning Objective |
|---|---|
| Test Development Process | Review the general steps of the ETS test development process. |
| Evidence-Centered Design | This session presents a method of designing tests that directly links item and test development to the knowledge, skills and abilities to be tested, claims to be made and evidence to be collected. |
| Item Writing and Reviewing Guidelines | Review general item writing and reviewing guidelines applicable to multiple-choice tests. Time permitting, participants practice writing and reviewing items using the guidelines. |
| Design and Development of Performance Assessments | This session outlines the guidelines and procedures for developing performance assessments (non-multiple-choice assessments). Rubrics and essays from ETS tests are used as examples. |
| Scoring Performance Assessments | Methods and logistics of essay scoring. Time permitting, participants also gain experience reviewing essays. |
| Overview of Psychometric Concepts in Testing | This session provides a summary of the basic psychometric concepts behind test development: item analysis, differential item functioning (DIF), equating, scaling, score interpretation, reliability, validity and fairness. |
| Equating and Scaling of Test Scores | Discusses the statistical issues involved in constructing comparable test forms. |
| Standard Setting | Provides an overview of the methodologies involved in establishing cut scores in large-scale assessments. |
| Test Fairness and Differential Item Functioning (DIF) | This session discusses the issues surrounding test fairness. The session also introduces DIF, the analysis of how matched people in different groups perform on a test item. |
If you are interested in an ETS Global Institute General Course, contact globalinstitute@ets.org.