Production in a Multimodal Corpus: how Speakers Communicate Complex Actions

Carlos Gómez Gallo, T. Florian Jaeger, James Allen, Mary Swift


Abstract
We describe a new multimodal corpus currently under development. The corpus consists of videos of task-oriented dialogues that are annotated for speaker’s verbal requests and domain action executions. This resource provides data for new research on language production and comprehension. The corpus can be used to study speakers’ decisions as to how to structure their utterances given the complexity of the message they are trying to convey.
Anthology ID:
L08-1200
Volume:
Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)
Month:
May
Year:
2008
Address:
Marrakech, Morocco
Editors:
Nicoletta Calzolari, Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2008/pdf/740_paper.pdf
DOI:
Bibkey:
Cite (ACL):
Carlos Gómez Gallo, T. Florian Jaeger, James Allen, and Mary Swift. 2008. Production in a Multimodal Corpus: how Speakers Communicate Complex Actions. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08), Marrakech, Morocco. European Language Resources Association (ELRA).
Cite (Informal):
Production in a Multimodal Corpus: how Speakers Communicate Complex Actions (Gallo et al., LREC 2008)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2008/pdf/740_paper.pdf