Speech- and Text-driven Features for Automated Scoring of English Speaking Tasks

Anastassia Loukina, Nitin Madnani, Aoife Cahill


Abstract
We consider the automatic scoring of a task for which both the content of the response as well its spoken fluency are important. We combine features from a text-only content scoring system originally designed for written responses with several categories of acoustic features. Although adding any single category of acoustic features to the text-only system on its own does not significantly improve performance, adding all acoustic features together does yield a small but significant improvement. These results are consistent for responses to open-ended questions and to questions focused on some given source material.
Anthology ID:
W17-4609
Volume:
Proceedings of the Workshop on Speech-Centric Natural Language Processing
Month:
September
Year:
2017
Address:
Copenhagen, Denmark
Editors:
Nicholas Ruiz, Srinivas Bangalore
Venue:
WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
67–77
Language:
URL:
https://aclanthology.org/W17-4609
DOI:
10.18653/v1/W17-4609
Bibkey:
Cite (ACL):
Anastassia Loukina, Nitin Madnani, and Aoife Cahill. 2017. Speech- and Text-driven Features for Automated Scoring of English Speaking Tasks. In Proceedings of the Workshop on Speech-Centric Natural Language Processing, pages 67–77, Copenhagen, Denmark. Association for Computational Linguistics.
Cite (Informal):
Speech- and Text-driven Features for Automated Scoring of English Speaking Tasks (Loukina et al., 2017)
Copy Citation:
PDF:
https://aclanthology.org/W17-4609.pdf