Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approach

Anshul Wadhawan, Akshita Aggarwal


Abstract
In the last few years, emotion detection in social-media text has become a popular problem due to its wide ranging application in better understanding the consumers, in psychology, in aiding human interaction with computers, designing smart systems etc. Because of the availability of huge amounts of data from social-media, which is regularly used for expressing sentiments and opinions, this problem has garnered great attention. In this paper, we present a Hinglish dataset labelled for emotion detection. We highlight a deep learning based approach for detecting emotions using bilingual word embeddings derived from FastText and Word2Vec approaches in Hindi-English code mixed tweets. We experiment with various deep learning models, including CNNs, LSTMs, Bi-directional LSTMs (with and without attention), along with transformers like BERT, RoBERTa, and ALBERT. The transformer based BERT model outperforms all current state-of-the-art models giving the best performance with an accuracy of 71.43%.
Anthology ID:
2021.wassa-1.21
Volume:
Proceedings of the Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis
Month:
April
Year:
2021
Address:
Online
Editors:
Orphee De Clercq, Alexandra Balahur, Joao Sedoc, Valentin Barriere, Shabnam Tafreshi, Sven Buechel, Veronique Hoste
Venue:
WASSA
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
195–202
Language:
URL:
https://aclanthology.org/2021.wassa-1.21
DOI:
Bibkey:
Cite (ACL):
Anshul Wadhawan and Akshita Aggarwal. 2021. Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approach. In Proceedings of the Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pages 195–202, Online. Association for Computational Linguistics.
Cite (Informal):
Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approach (Wadhawan & Aggarwal, WASSA 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.wassa-1.21.pdf
Code
 anshulwadhawan/emotion_detection