Heterogeneous Graph Neural Networks to Predict What Happen Next

Jianming Zheng, Fei Cai, Yanxiang Ling, Honghui Chen


Abstract
Given an incomplete event chain, script learning aims to predict the missing event, which can support a series of NLP applications. Existing work cannot well represent the heterogeneous relations and capture the discontinuous event segments that are common in the event chain. To address these issues, we introduce a heterogeneous-event (HeterEvent) graph network. In particular, we employ each unique word and individual event as nodes in the graph, and explore three kinds of edges based on realistic relations (e.g., the relations of word-and-word, word-and-event, event-and-event). We also design a message passing process to realize information interactions among homo or heterogeneous nodes. And the discontinuous event segments could be explicitly modeled by finding the specific path between corresponding nodes in the graph. The experimental results on one-step and multi-step inference tasks demonstrate that our ensemble model HeterEvent[W+E] can outperform existing baselines.
Anthology ID:
2020.coling-main.29
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Donia Scott, Nuria Bel, Chengqing Zong
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
328–338
Language:
URL:
https://aclanthology.org/2020.coling-main.29
DOI:
10.18653/v1/2020.coling-main.29
Bibkey:
Cite (ACL):
Jianming Zheng, Fei Cai, Yanxiang Ling, and Honghui Chen. 2020. Heterogeneous Graph Neural Networks to Predict What Happen Next. In Proceedings of the 28th International Conference on Computational Linguistics, pages 328–338, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
Heterogeneous Graph Neural Networks to Predict What Happen Next (Zheng et al., COLING 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.coling-main.29.pdf