skip to main content skip to footer

Using Just Noticeable Differences to Interpret Test of Spoken English Scores JND TSE

Author(s):
Stricker, Lawrence J.
Publication Year:
1997
Report Number:
RR-97-04
Source:
ETS Research Report
Document Type:
Report
Page Count:
36
Subject/Key Words:
English (Second Language), Just Noticeable Difference (JND), Test Interpretation, Test Validity, Test of Spoken English (TSE)

Abstract

This study explored the value of obtaining a just noticeable difference (JND) the difference in scores needed before observers discern a difference in examinees' English proficiency for the current TSE® (Test of Spoken English™) as a means of interpreting scores in practical terms, using college students' ratings of their international teaching assistants' English proficiency and adapting classical psychophysical methods. The test's concurrent validity against these ratings was also appraised. Three estimates of the JND were obtained. They varied considerably in size, but all were substantial when compared with the standard deviation of the TSE scores, the test's standard error of measurement, and guidelines for the effect size for mean differences. The TSE test correlated moderately with the rating criterion. The JND estimates appear to be meaningful and useful in interpreting the practical significance of TSE scores, and the test has some concurrent validity.

Read More