Subjective Evaluation of Comprehensibility in Movie Interactions

Estelle Randria, Lionel Fontan, Maxime Le Coz, Isabelle Ferrané, Julien Pinquier


Abstract
Various research works have dealt with the comprehensibility of textual, audio, or audiovisual documents, and showed that factors related to text (e.g. linguistic complexity), sound (e.g. speech intelligibility), image (e.g. presence of visual context), or even to cognition and emotion can play a major role in the ability of humans to understand the semantic and pragmatic contents of a given document. However, to date, no reference human data is available that could help investigating the role of the linguistic and extralinguistic information present at these different levels (i.e., linguistic, audio/phonetic, and visual) in multimodal documents (e.g., movies). The present work aimed at building a corpus of human annotations that would help to study further how much and in which way the human perception of comprehensibility (i.e., of the difficulty of comprehension, referred in this paper as overall difficulty) of audiovisual documents is affected (1) by lexical complexity, grammatical complexity, and speech intelligibility, and (2) by the modality/ies (text, audio, video) available to the human recipient.
Anthology ID:
2020.lrec-1.286
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
2348–2357
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.286
DOI:
Bibkey:
Cite (ACL):
Estelle Randria, Lionel Fontan, Maxime Le Coz, Isabelle Ferrané, and Julien Pinquier. 2020. Subjective Evaluation of Comprehensibility in Movie Interactions. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 2348–2357, Marseille, France. European Language Resources Association.
Cite (Informal):
Subjective Evaluation of Comprehensibility in Movie Interactions (Randria et al., LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.286.pdf