Psychometric Considerations and a General Scoring Strategy for Assessments of Collaborative Problem Solving CPS ECSAP CBA
Kyllonen, Patrick C.;
von Davier, Alina A.
- Publication Year:
- Report Number:
ETS Research Report
- Document Type:
- Page Count:
- Subject/Key Words:
Collaborative Problem Solving (CPS),
ETS Collaborative Science Assessment Prototype (ECSAP),
Computer Based Assessment (CBA),
21st Century Skills
Collaborative problem solving (CPS) is an important 21st-century skill that is crucial for both career and academic success. However, developing a large-scale and standardized assessment of CPS that can be administered on a regular basis is very challenging. In this report, we introduce a set of psychometric considerations and a general scoring strategy around assessing CPS, summarized based on the results of the extensive empirical studies we conducted at Educational Testing Service (ETS) over the past 6 years. Using the ETS Collaborative Science Assessment Prototype as an example, we show how these psychometric considerations have been incorporated into the development of the assessment prototype and how the scoring strategy has been implemented.