The ETAPE speech processing evaluation

Olivier Galibert, Jeremy Leixa, Gilles Adda, Khalid Choukri, Guillaume Gravier


Abstract
The ETAPE evaluation is the third evaluation in automatic speech recognition and associated technologies in a series which started with ESTER. This evaluation proposed some new challenges, by proposing TV and radio shows with prepared and spontaneous speech, annotation and evaluation of overlapping speech, a cross-show condition in speaker diarization, and new, complex but very informative named entities in the information extraction task. This paper presents the whole campaign, including the data annotated, the metrics used and the anonymized system results. All the data created in the evaluation, hopefully including system outputs, will be distributed through the ELRA catalogue in the future.
Anthology ID:
L14-1022
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
3995–3999
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/1027_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Olivier Galibert, Jeremy Leixa, Gilles Adda, Khalid Choukri, and Guillaume Gravier. 2014. The ETAPE speech processing evaluation. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 3995–3999, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
The ETAPE speech processing evaluation (Galibert et al., LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/1027_Paper.pdf