Multiword Expressions Dataset for Indian Languages

Dhirendra Singh, Sudha Bhingardive, Pushpak Bhattacharyya


Abstract
Multiword Expressions (MWEs) are used frequently in natural languages, but understanding the diversity in MWEs is one of the open problem in the area of Natural Language Processing. In the context of Indian languages, MWEs play an important role. In this paper, we present MWEs annotation dataset created for Indian languages viz., Hindi and Marathi. We extract possible MWE candidates using two repositories: 1) the POS-tagged corpus and 2) the IndoWordNet synsets. Annotation is done for two types of MWEs: compound nouns and light verb constructions. In the process of annotation, human annotators tag valid MWEs from these candidates based on the standard guidelines provided to them. We obtained 3178 compound nouns and 2556 light verb constructions in Hindi and 1003 compound nouns and 2416 light verb constructions in Marathi using two repositories mentioned before. This created resource is made available publicly and can be used as a gold standard for Hindi and Marathi MWE systems.
Anthology ID:
L16-1369
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
2331–2335
Language:
URL:
https://aclanthology.org/L16-1369
DOI:
Bibkey:
Cite (ACL):
Dhirendra Singh, Sudha Bhingardive, and Pushpak Bhattacharyya. 2016. Multiword Expressions Dataset for Indian Languages. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 2331–2335, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Multiword Expressions Dataset for Indian Languages (Singh et al., LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1369.pdf