Using multimodal resources for explanation approaches in intelligent systems

Florian Nothdurft, Wolfgang Minker


Abstract
In this work we show that there is a need of using multimodal resources during human-computer interaction (HCI) in intelligent systems. We propose that not only creating multimodal output for the user is important, but to take multimodal input resources into account for the decision when and how to interact. Especially the use of multimodal input resources for the decision when and how to provide assistance in HCI is important. The use of assistive functionalities like providing adaptive explanations to keep the user motivated and cooperative is more than a side-effect and demands a closer look. In this paper we introduce our approach on how to use multimodal input ressources in an adaptive and generic explanation pipeline. We do not only concentrate on using explanations as a way to manage user knowledge, but to maintain the cooperativeness, trust and motivation of the user to continue a healthy and well-structured HCI.
Anthology ID:
L12-1067
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
411–415
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/211_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Florian Nothdurft and Wolfgang Minker. 2012. Using multimodal resources for explanation approaches in intelligent systems. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 411–415, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
Using multimodal resources for explanation approaches in intelligent systems (Nothdurft & Minker, LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/211_Paper.pdf