EDA: Enriching Emotional Dialogue Acts using an Ensemble of Neural Annotators

Chandrakant Bothe, Cornelius Weber, Sven Magg, Stefan Wermter


Abstract
The recognition of emotion and dialogue acts enriches conversational analysis and help to build natural dialogue systems. Emotion interpretation makes us understand feelings and dialogue acts reflect the intentions and performative functions in the utterances. However, most of the textual and multi-modal conversational emotion corpora contain only emotion labels but not dialogue acts. To address this problem, we propose to use a pool of various recurrent neural models trained on a dialogue act corpus, with and without context. These neural models annotate the emotion corpora with dialogue act labels, and an ensemble annotator extracts the final dialogue act label. We annotated two accessible multi-modal emotion corpora: IEMOCAP and MELD. We analyzed the co-occurrence of emotion and dialogue act labels and discovered specific relations. For example, Accept/Agree dialogue acts often occur with the Joy emotion, Apology with Sadness, and Thanking with Joy. We make the Emotional Dialogue Acts (EDA) corpus publicly available to the research community for further study and analysis.
Anthology ID:
2020.lrec-1.78
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
620–627
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.78
DOI:
Bibkey:
Cite (ACL):
Chandrakant Bothe, Cornelius Weber, Sven Magg, and Stefan Wermter. 2020. EDA: Enriching Emotional Dialogue Acts using an Ensemble of Neural Annotators. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 620–627, Marseille, France. European Language Resources Association.
Cite (Informal):
EDA: Enriching Emotional Dialogue Acts using an Ensemble of Neural Annotators (Bothe et al., LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.78.pdf
Code
 bothe/EDAs +  additional community code
Data
Emotional Dialogue ActsEmotionLinesIEMOCAPMELD