Evaluating Cross-Lingual Transfer Learning Approaches in Multilingual Conversational Agent Models

Lizhen Tan, Olga Golovneva


Abstract
With the recent explosion in popularity of voice assistant devices, there is a growing interest in making them available to user populations in additional countries and languages. However, to provide the highest accuracy and best performance for specific user populations, most existing voice assistant models are developed individually for each region or language, which requires linear investment of effort. In this paper, we propose a general multilingual model framework for Natural Language Understanding (NLU) models, which can help bootstrap new language models faster and reduce the amount of effort required to develop each language separately. We explore how different deep learning architectures affect multilingual NLU model performance. Our experimental results show that these multilingual models can reach same or better performance compared to monolingual models across language-specific test data while require less effort in creating features and model maintenance.
Anthology ID:
2020.coling-industry.1
Volume:
Proceedings of the 28th International Conference on Computational Linguistics: Industry Track
Month:
December
Year:
2020
Address:
Online
Editors:
Ann Clifton, Courtney Napoles
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
1–9
Language:
URL:
https://aclanthology.org/2020.coling-industry.1
DOI:
10.18653/v1/2020.coling-industry.1
Bibkey:
Cite (ACL):
Lizhen Tan and Olga Golovneva. 2020. Evaluating Cross-Lingual Transfer Learning Approaches in Multilingual Conversational Agent Models. In Proceedings of the 28th International Conference on Computational Linguistics: Industry Track, pages 1–9, Online. International Committee on Computational Linguistics.
Cite (Informal):
Evaluating Cross-Lingual Transfer Learning Approaches in Multilingual Conversational Agent Models (Tan & Golovneva, COLING 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.coling-industry.1.pdf