Quality Estimation for Synthetic Parallel Data Generation

Raphael Rubino, Antonio Toral, Nikola Ljubešić, Gema Ramírez-Sánchez


Abstract
This paper presents a novel approach for parallel data generation using machine translation and quality estimation. Our study focuses on pivot-based machine translation from English to Croatian through Slovene. We generate an English―Croatian version of the Europarl parallel corpus based on the English―Slovene Europarl corpus and the Apertium rule-based translation system for Slovene―Croatian. These experiments are to be considered as a first step towards the generation of reliable synthetic parallel data for under-resourced languages. We first collect small amounts of aligned parallel data for the Slovene―Croatian language pair in order to build a quality estimation system for sentence-level Translation Edit Rate (TER) estimation. We then infer TER scores on automatically translated Slovene to Croatian sentences and use the best translations to build an English―Croatian statistical MT system. We show significant improvement in terms of automatic metrics obtained on two test sets using our approach compared to a random selection of synthetic parallel data.
Anthology ID:
L14-1625
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1843–1849
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/807_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Raphael Rubino, Antonio Toral, Nikola Ljubešić, and Gema Ramírez-Sánchez. 2014. Quality Estimation for Synthetic Parallel Data Generation. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 1843–1849, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
Quality Estimation for Synthetic Parallel Data Generation (Rubino et al., LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/807_Paper.pdf