Evaluating Unsupervised Dutch Word Embeddings as a Linguistic Resource

Stéphan Tulkens, Chris Emmery, Walter Daelemans


Abstract
Word embeddings have recently seen a strong increase in interest as a result of strong performance gains on a variety of tasks. However, most of this research also underlined the importance of benchmark datasets, and the difficulty of constructing these for a variety of language-specific tasks. Still, many of the datasets used in these tasks could prove to be fruitful linguistic resources, allowing for unique observations into language use and variability. In this paper we demonstrate the performance of multiple types of embeddings, created with both count and prediction-based architectures on a variety of corpora, in two language-specific tasks: relation evaluation, and dialect identification. For the latter, we compare unsupervised methods with a traditional, hand-crafted dictionary. With this research, we provide the embeddings themselves, the relation evaluation task benchmark for use in further research, and demonstrate how the benchmarked embeddings prove a useful unsupervised linguistic resource, effectively used in a downstream task.
Anthology ID:
L16-1652
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
4130–4136
Language:
URL:
https://aclanthology.org/L16-1652
DOI:
Bibkey:
Cite (ACL):
Stéphan Tulkens, Chris Emmery, and Walter Daelemans. 2016. Evaluating Unsupervised Dutch Word Embeddings as a Linguistic Resource. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 4130–4136, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Evaluating Unsupervised Dutch Word Embeddings as a Linguistic Resource (Tulkens et al., LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1652.pdf
Code
 clips/dutchembeddings