Negation typology and general representation models for cross-lingual zero-shot negation scope resolution in Russian, French, and Spanish.

Anastassia Shaitarova, Fabio Rinaldi


Abstract
Negation is a linguistic universal that poses difficulties for cognitive and computational processing. Despite many advances in text analytics, negation resolution remains an acute and continuously researched question in Natural Language Processing. Reliable negation parsing affects results in biomedical text mining, sentiment analysis, machine translation, and many other fields. The availability of multilingual pre-trained general representation models makes it possible to experiment with negation detection in languages that lack annotated data. In this work we test the performance of two state-of-the-art contextual representation models, Multilingual BERT and XLM-RoBERTa. We resolve negation scope by conducting zero-shot transfer between English, Spanish, French, and Russian. Our best result amounts to a token-level F1-score of 86.86% between Spanish and Russian. We correlate these results with a linguistic negation typology and lexical capacity of the models.
Anthology ID:
2021.naacl-srw.3
Volume:
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop
Month:
June
Year:
2021
Address:
Online
Editors:
Esin Durmus, Vivek Gupta, Nelson Liu, Nanyun Peng, Yu Su
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
15–23
Language:
URL:
https://aclanthology.org/2021.naacl-srw.3
DOI:
10.18653/v1/2021.naacl-srw.3
Bibkey:
Cite (ACL):
Anastassia Shaitarova and Fabio Rinaldi. 2021. Negation typology and general representation models for cross-lingual zero-shot negation scope resolution in Russian, French, and Spanish.. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop, pages 15–23, Online. Association for Computational Linguistics.
Cite (Informal):
Negation typology and general representation models for cross-lingual zero-shot negation scope resolution in Russian, French, and Spanish. (Shaitarova & Rinaldi, NAACL 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.naacl-srw.3.pdf
Video:
 https://aclanthology.org/2021.naacl-srw.3.mp4