Resource Evaluation for Usable Speech Interfaces: Utilizing Human-Human Dialogue

Pepi Stavropoulou, Dimitris Spiliotopoulos, Georgios Kouroupetroglou


Abstract
Human-human spoken dialogues are considered an important tool for effective speech interface design and are often used for stochastic model training in speech based applications. However, the less restricted nature of human-human interaction compared to human-system interaction may undermine the usefulness of such corpora for creating effective and usable interfaces. In this respect, this work examines the differences between corpora collected from human-human interaction and corpora collected from actual system use, in order to formally assess the appropriateness of the former for both the design and implementation of spoken dialogue systems. Comparison results show that there are significant differences with respect to vocabulary, sentence structure and speech recognition success rate among others. Nevertheless, compared to other available tools and techniques, human-human dialogues may still be used as a temporary at least solution for building more effective working systems. Accordingly, ways to better utilize such resources are presented.
Anthology ID:
L12-1583
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1348–1353
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/977_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Pepi Stavropoulou, Dimitris Spiliotopoulos, and Georgios Kouroupetroglou. 2012. Resource Evaluation for Usable Speech Interfaces: Utilizing Human-Human Dialogue. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 1348–1353, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
Resource Evaluation for Usable Speech Interfaces: Utilizing Human-Human Dialogue (Stavropoulou et al., LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/977_Paper.pdf