LSDC - A comprehensive dataset for Low Saxon Dialect Classification

Janine Siewert, Yves Scherrer, Martijn Wieling, Jörg Tiedemann


Abstract
We present a new comprehensive dataset for the unstandardised West-Germanic language Low Saxon covering the last two centuries, the majority of modern dialects and various genres, which will be made openly available in connection with the final version of this paper. Since so far no such comprehensive dataset of contemporary Low Saxon exists, this provides a great contribution to NLP research on this language. We also test the use of this dataset for dialect classification by training a few baseline models comparing statistical and neural approaches. The performance of these models shows that in spite of an imbalance in the amount of data per dialect, enough features can be learned for a relatively high classification accuracy.
Anthology ID:
2020.vardial-1.3
Volume:
Proceedings of the 7th Workshop on NLP for Similar Languages, Varieties and Dialects
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Marcos Zampieri, Preslav Nakov, Nikola Ljubešić, Jörg Tiedemann, Yves Scherrer
Venue:
VarDial
SIG:
Publisher:
International Committee on Computational Linguistics (ICCL)
Note:
Pages:
25–35
Language:
URL:
https://aclanthology.org/2020.vardial-1.3
DOI:
Bibkey:
Cite (ACL):
Janine Siewert, Yves Scherrer, Martijn Wieling, and Jörg Tiedemann. 2020. LSDC - A comprehensive dataset for Low Saxon Dialect Classification. In Proceedings of the 7th Workshop on NLP for Similar Languages, Varieties and Dialects, pages 25–35, Barcelona, Spain (Online). International Committee on Computational Linguistics (ICCL).
Cite (Informal):
LSDC - A comprehensive dataset for Low Saxon Dialect Classification (Siewert et al., VarDial 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.vardial-1.3.pdf