skip to main content skip to footer

Proficiency Scaling Based on Conditional Probability Functions for Attributes IRT SAT

Author(s):
Birenbaum, Menucha; Lewis, Charles; Sheehan, Kathleen M.; Tatsuoka, Kikumi K.
Publication Year:
1993
Report Number:
RR-93-50-ONR
Source:
ETS Research Report
Document Type:
Report
Page Count:
72
Subject/Key Words:
Office of Naval Research, Classification, Cognitive Processing, Content Analysis, Educational Diagnosis, Item Response Theory (IRT), Probability, Rule-Space Model, Scaling, Scholastic Aptitude Test (SAT), Task Analysis

Abstract

(72pp.) This study introduces procedures for constructing a proficiency scale for a large-scale test by applying Tatsuoka's Rule Space Model. The SAT Mathematics (SAT M), Section 2, is used for illustrating the process and the results. A task analysis is summarized in a mapping sentence, and then 14 processes and content attributes are identified for explaining the underlying cognitive aspects of the examinees' performance on the SAT M. Analysis results show that almost 98% of 2334 examinees are successfully classified into one of 468 cognitive states. The cognitive states are characterized by mastery or non-mastery of the 14 attributes. Attribute Characteristic Curves, which are conditional probability functions defined on the SAT Scale, are introduced and used for interpreting an examinees' proficiency. Prototypes of a student's performance report and a group performance report are given as examples of possible ways for summarizing the analysis results.

Read More