Standard Courses Sample Agenda

Review our Global Institute sample agenda for the course "Design and Development of Large-Scale Assessments."

Topic Learning Objective
Test Development Process This workshop session reviews the general steps of the ETS test development process.
Developing Test Specifications Test specifications are the blueprints that test developers use when creating a test. This session describes how test specifications are developed.
Evidence-Centered Design This session presents a method of designing tests that directly links item and test development to the knowledge, skills and abilities to be tested, claims to be made and evidence to be collected.
Item Writing/Reviewing Guidelines This session reviews general item writing and reviewing guidelines applicable to multiple-choice tests. Time permitting, participants practice writing and reviewing items using the guidelines.
Design and Development of Performance Assessments This session outlines the guidelines and procedures for developing performance assessments (non-multiple-choice assessments). Rubrics and essays from ETS tests are used as examples.
Administering and Scoring Performance Assessments This session outlines the methods and logistics of essay scoring. Time permitting, participants also gain experience reviewing essays.
Conceptual Overview of Psychometric Concepts in Testing This session provides a summary of the basic psychometric concepts behind test development: item analysis, differential item functioning (DIF), equating, scaling, score interpretation, reliability, validity and fairness.
Equating This session discusses the statistical issues involved in constructing comparable test forms.
Standard Setting This session provides an overview of the methodologies involved in establishing cut scores in large-scale assessments.
Test Fairness and Differential Item Functioning (DIF) This session discusses the issues surrounding test fairness and equity vs. equality. It also reviews the international principles and guidelines for fairness in testing. The session also introduces DIF, the analysis of how matched people in different groups perform on a test item.

If you are interested in an ETS Global Institute General Course, contact globalinstitute@ets.org.