skip to main content skip to footer

An Approximately Reproducing Scoring Scheme That Aligns Random Response and Omission

Author(s):
Boldt, Robert F.
Publication Year:
1971
Report Number:
RB-71-43
Source:
ETS Research Bulletin
Document Type:
Report
Page Count:
10
Subject/Key Words:
United States Air Force Human Resources Laboratory, Confidence Testing, Multiple Choice Tests, Probability, Response Style (Tests), Scoring Formulas

Abstract

One formulation of confidence scoring requires the examinee to indicate as a number his or her personal probability of the correctness of each alternative in a multiple-choice test. For this formulation, a linear transformation of the logarithm of the correct response is maximized if the examinee reports accurately his or her personal probability. To equate omits scores with choice scores, the transformation can be chosen so that the score is zero if the examinee indicates complete uncertainty. If this is done, the scoring function depends on the number of alternatives. One could also align uncertainty and response omission by granting credit for omitting items, though it is felt this might be hard to explain to examinees. (Author)

Read More