BERT-based Cohesion Analysis of Japanese Texts

Nobuhiro Ueda, Daisuke Kawahara, Sadao Kurohashi


Abstract
The meaning of natural language text is supported by cohesion among various kinds of entities, including coreference relations, predicate-argument structures, and bridging anaphora relations. However, predicate-argument structures for nominal predicates and bridging anaphora relations have not been studied well, and their analyses have been still very difficult. Recent advances in neural networks, in particular, self training-based language models including BERT (Devlin et al., 2019), have significantly improved many natural language processing tasks, making it possible to dive into the study on analysis of cohesion in the whole text. In this study, we tackle an integrated analysis of cohesion in Japanese texts. Our results significantly outperformed existing studies in each task, especially about 10 to 20 point improvement both for zero anaphora and coreference resolution. Furthermore, we also showed that coreference resolution is different in nature from the other tasks and should be treated specially.
Anthology ID:
2020.coling-main.114
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Donia Scott, Nuria Bel, Chengqing Zong
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
1323–1333
Language:
URL:
https://aclanthology.org/2020.coling-main.114
DOI:
10.18653/v1/2020.coling-main.114
Bibkey:
Cite (ACL):
Nobuhiro Ueda, Daisuke Kawahara, and Sadao Kurohashi. 2020. BERT-based Cohesion Analysis of Japanese Texts. In Proceedings of the 28th International Conference on Computational Linguistics, pages 1323–1333, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
BERT-based Cohesion Analysis of Japanese Texts (Ueda et al., COLING 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.coling-main.114.pdf
Code
 nobu-g/cohesion-analysis