A Corpus for a Gesture-Controlled Mobile Spoken Dialogue System

Nikos Tsourakis, Manny Rayner


Abstract
Speech and hand gestures offer the most natural modalities for everyday human-to-human interaction. The availability of diverse spoken dialogue applications and the proliferation of accelerometers on consumer electronics allow the introduction of new interaction paradigms based on speech and gestures. Little attention has been paid however to the manipulation of spoken dialogue systems through gestures. Situation-induced disabilities or real disabilities are determinant factors that motivate this type of interaction. In this paper we propose six concise and intuitively meaningful gestures that can be used to trigger the commands in any SDS. Using different machine learning techniques we achieve a classification error for the gesture patterns of less than 5%, and we also compare our own set of gestures to ones proposed by users. Finally, we examine the social acceptability of the specific interaction scheme and encounter high levels of acceptance for public use.
Anthology ID:
L12-1304
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1315–1322
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/539_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Nikos Tsourakis and Manny Rayner. 2012. A Corpus for a Gesture-Controlled Mobile Spoken Dialogue System. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 1315–1322, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
A Corpus for a Gesture-Controlled Mobile Spoken Dialogue System (Tsourakis & Rayner, LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/539_Paper.pdf