Using PRMSE to Evaluate Automated Scoring Systems in the Presence of Label Noise PRMSE NLP
- Author(s):
-
Loukina, Anastassia;
Madnani, Nitin;
Cahill, Aoife;
Yao, Lili;
Johnson, Matthew S.;
Riordan, Brian;
McCaffrey, Daniel F.
- Publication Year:
- 2020
- Source:
-
Proceedings of the 15th Workshop on Innovative Use of NLP for Building Educational Applications. Online Conference, July 10, 2020, p18-29
- Document Type:
- Chapter
- Page Count:
- 12
- Subject/Key Words:
-
Natural Language Processing (NLP),
Proportional Reduction in Mean-Squared Error (PRMSE),
Human Raters,
Automated Scoring and Natural Language Processing,
Annotation,
Human Scores,
Automated Scoring Systems,
Error
Read More