Multi-language Speech Collection for NIST LRE

Karen Jones, Stephanie Strassel, Kevin Walker, David Graff, Jonathan Wright


Abstract
The Multi-language Speech (MLS) Corpus supports NIST’s Language Recognition Evaluation series by providing new conversational telephone speech and broadcast narrowband data in 20 languages/dialects. The corpus was built with the intention of testing system performance in the matter of distinguishing closely related or confusable linguistic varieties, and careful manual auditing of collected data was an important aspect of this work. This paper lists the specific data requirements for the collection and provides both a commentary on the rationale for those requirements as well as an outline of the various steps taken to ensure all goals were met as specified. LDC conducted a large-scale recruitment effort involving the implementation of candidate assessment and interview techniques suitable for hiring a large contingent of telecommuting workers, and this recruitment effort is discussed in detail. We also describe the telephone and broadcast collection infrastructure and protocols, and provide details of the steps taken to pre-process collected data prior to auditing. Finally, annotation training, procedures and outcomes are presented in detail.
Anthology ID:
L16-1674
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
4253–4258
Language:
URL:
https://aclanthology.org/L16-1674
DOI:
Bibkey:
Cite (ACL):
Karen Jones, Stephanie Strassel, Kevin Walker, David Graff, and Jonathan Wright. 2016. Multi-language Speech Collection for NIST LRE. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 4253–4258, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Multi-language Speech Collection for NIST LRE (Jones et al., LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1674.pdf