TeamUNCC@LT-EDI-EACL2021: Hope Speech Detection using Transfer Learning with Transformers

Khyati Mahajan, Erfan Al-Hossami, Samira Shaikh


Abstract
In this paper, we describe our approach towards utilizing pre-trained models for the task of hope speech detection. We participated in Task 2: Hope Speech Detection for Equality, Diversity and Inclusion at LT-EDI-2021 @ EACL2021. The goal of this task is to predict the presence of hope speech, along with the presence of samples that do not belong to the same language in the dataset. We describe our approach to fine-tuning RoBERTa for Hope Speech detection in English and our approach to fine-tuning XLM-RoBERTa for Hope Speech detection in Tamil and Malayalam, two low resource Indic languages. We demonstrate the performance of our approach on classifying text into hope-speech, non-hope and not-language. Our approach ranked 1st in English (F1 = 0.93), 1st in Tamil (F1 = 0.61) and 3rd in Malayalam (F1 = 0.83).
Anthology ID:
2021.ltedi-1.20
Volume:
Proceedings of the First Workshop on Language Technology for Equality, Diversity and Inclusion
Month:
April
Year:
2021
Address:
Kyiv
Editors:
Bharathi Raja Chakravarthi, John P. McCrae, Manel Zarrouk, Kalika Bali, Paul Buitelaar
Venue:
LTEDI
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
136–142
Language:
URL:
https://aclanthology.org/2021.ltedi-1.20
DOI:
Bibkey:
Cite (ACL):
Khyati Mahajan, Erfan Al-Hossami, and Samira Shaikh. 2021. TeamUNCC@LT-EDI-EACL2021: Hope Speech Detection using Transfer Learning with Transformers. In Proceedings of the First Workshop on Language Technology for Equality, Diversity and Inclusion, pages 136–142, Kyiv. Association for Computational Linguistics.
Cite (Informal):
TeamUNCC@LT-EDI-EACL2021: Hope Speech Detection using Transfer Learning with Transformers (Mahajan et al., LTEDI 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.ltedi-1.20.pdf
Software:
 2021.ltedi-1.20.Software.zip
Data
HopeEDI