CoVoST: A Diverse Multilingual Speech-To-Text Translation Corpus

Changhan Wang, Juan Pino, Anne Wu, Jiatao Gu


Abstract
Spoken language translation has recently witnessed a resurgence in popularity, thanks to the development of end-to-end models and the creation of new corpora, such as Augmented LibriSpeech and MuST-C. Existing datasets involve language pairs with English as a source language, involve very specific domains or are low resource. We introduce CoVoST, a multilingual speech-to-text translation corpus from 11 languages into English, diversified with over 11,000 speakers and over 60 accents. We describe the dataset creation methodology and provide empirical evidence of the quality of the data. We also provide initial benchmarks, including, to our knowledge, the first end-to-end many-to-one multilingual models for spoken language translation. CoVoST is released under CC0 license and free to use. We also provide additional evaluation data derived from Tatoeba under CC licenses.
Anthology ID:
2020.lrec-1.517
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
4197–4203
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.517
DOI:
Bibkey:
Cite (ACL):
Changhan Wang, Juan Pino, Anne Wu, and Jiatao Gu. 2020. CoVoST: A Diverse Multilingual Speech-To-Text Translation Corpus. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 4197–4203, Marseille, France. European Language Resources Association.
Cite (Informal):
CoVoST: A Diverse Multilingual Speech-To-Text Translation Corpus (Wang et al., LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.517.pdf
Code
 facebookresearch/covost
Data
CoVoSTTatoeba