Visual Story Post-Editing

Ting-Yao Hsu, Chieh-Yang Huang, Yen-Chia Hsu, Ting-Hao Huang


Abstract
We introduce the first dataset for human edits of machine-generated visual stories and explore how these collected edits may be used for the visual story post-editing task. The dataset ,VIST-Edit, includes 14,905 human-edited versions of 2,981 machine-generated visual stories. The stories were generated by two state-of-the-art visual storytelling models, each aligned to 5 human-edited versions. We establish baselines for the task, showing how a relatively small set of human edits can be leveraged to boost the performance of large visual storytelling models. We also discuss the weak correlation between automatic evaluation scores and human ratings, motivating the need for new automatic metrics.
Anthology ID:
P19-1658
Volume:
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
Month:
July
Year:
2019
Address:
Florence, Italy
Editors:
Anna Korhonen, David Traum, Lluís Màrquez
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6581–6586
Language:
URL:
https://aclanthology.org/P19-1658
DOI:
10.18653/v1/P19-1658
Bibkey:
Cite (ACL):
Ting-Yao Hsu, Chieh-Yang Huang, Yen-Chia Hsu, and Ting-Hao Huang. 2019. Visual Story Post-Editing. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 6581–6586, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Visual Story Post-Editing (Hsu et al., ACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/P19-1658.pdf
Code
 tingyaohsu/VIST-Edit
Data
VIST-EditVIST