A Multilingual View of Unsupervised Machine Translation

Xavier Garcia, Pierre Foret, Thibault Sellam, Ankur Parikh


Abstract
We present a probabilistic framework for multilingual neural machine translation that encompasses supervised and unsupervised setups, focusing on unsupervised translation. In addition to studying the vanilla case where there is only monolingual data available, we propose a novel setup where one language in the (source, target) pair is not associated with any parallel data, but there may exist auxiliary parallel data that contains the other. This auxiliary data can naturally be utilized in our probabilistic framework via a novel cross-translation loss term. Empirically, we show that our approach results in higher BLEU scores over state-of-the-art unsupervised models on the WMT’14 English-French, WMT’16 English-German, and WMT’16 English-Romanian datasets in most directions.
Anthology ID:
2020.findings-emnlp.283
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2020
Month:
November
Year:
2020
Address:
Online
Editors:
Trevor Cohn, Yulan He, Yang Liu
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3160–3170
Language:
URL:
https://aclanthology.org/2020.findings-emnlp.283
DOI:
10.18653/v1/2020.findings-emnlp.283
Bibkey:
Cite (ACL):
Xavier Garcia, Pierre Foret, Thibault Sellam, and Ankur Parikh. 2020. A Multilingual View of Unsupervised Machine Translation. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3160–3170, Online. Association for Computational Linguistics.
Cite (Informal):
A Multilingual View of Unsupervised Machine Translation (Garcia et al., Findings 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.findings-emnlp.283.pdf