Context Tracking Network: Graph-based Context Modeling for Implicit Discourse Relation Recognition

Yingxue Zhang, Fandong Meng, Peng Li, Ping Jian, Jie Zhou


Abstract
Implicit discourse relation recognition (IDRR) aims to identify logical relations between two adjacent sentences in the discourse. Existing models fail to fully utilize the contextual information which plays an important role in interpreting each local sentence. In this paper, we thus propose a novel graph-based Context Tracking Network (CT-Net) to model the discourse context for IDRR. The CT-Net firstly converts the discourse into the paragraph association graph (PAG), where each sentence tracks their closely related context from the intricate discourse through different types of edges. Then, the CT-Net extracts contextual representation from the PAG through a specially designed cross-grained updating mechanism, which can effectively integrate both sentence-level and token-level contextual semantics. Experiments on PDTB 2.0 show that the CT-Net gains better performance than models that roughly model the context.
Anthology ID:
2021.naacl-main.126
Volume:
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Month:
June
Year:
2021
Address:
Online
Editors:
Kristina Toutanova, Anna Rumshisky, Luke Zettlemoyer, Dilek Hakkani-Tur, Iz Beltagy, Steven Bethard, Ryan Cotterell, Tanmoy Chakraborty, Yichao Zhou
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1592–1599
Language:
URL:
https://aclanthology.org/2021.naacl-main.126
DOI:
10.18653/v1/2021.naacl-main.126
Bibkey:
Cite (ACL):
Yingxue Zhang, Fandong Meng, Peng Li, Ping Jian, and Jie Zhou. 2021. Context Tracking Network: Graph-based Context Modeling for Implicit Discourse Relation Recognition. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 1592–1599, Online. Association for Computational Linguistics.
Cite (Informal):
Context Tracking Network: Graph-based Context Modeling for Implicit Discourse Relation Recognition (Zhang et al., NAACL 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.naacl-main.126.pdf
Video:
 https://aclanthology.org/2021.naacl-main.126.mp4