Role-specific Language Models for Processing Recorded Neuropsychological Exams

Tuka Al Hanai, Rhoda Au, James Glass


Abstract
Neuropsychological examinations are an important screening tool for the presence of cognitive conditions (e.g. Alzheimer’s, Parkinson’s Disease), and require a trained tester to conduct the exam through spoken interactions with the subject. While audio is relatively easy to record, it remains a challenge to automatically diarize (who spoke when?), decode (what did they say?), and assess a subject’s cognitive health. This paper demonstrates a method to determine the cognitive health (impaired or not) of 92 subjects, from audio that was diarized using an automatic speech recognition system trained on TED talks and on the structured language used by testers and subjects. Using leave-one-out cross validation and logistic regression modeling we show that even with noisily decoded data (81% WER) we can still perform accurate enough diarization (0.02% confusion rate) to determine the cognitive state of a subject (0.76 AUC).
Anthology ID:
N18-2117
Volume:
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Marilyn Walker, Heng Ji, Amanda Stent
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
746–752
Language:
URL:
https://aclanthology.org/N18-2117
DOI:
10.18653/v1/N18-2117
Bibkey:
Cite (ACL):
Tuka Al Hanai, Rhoda Au, and James Glass. 2018. Role-specific Language Models for Processing Recorded Neuropsychological Exams. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 746–752, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
Role-specific Language Models for Processing Recorded Neuropsychological Exams (Al Hanai et al., NAACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/N18-2117.pdf
Data
TED-LIUM