Feasible Annotation Scheme for Capturing Policy Argument Reasoning using Argument Templates

Paul Reisert, Naoya Inoue, Tatsuki Kuribayashi, Kentaro Inui


Abstract
Most of the existing works on argument mining cast the problem of argumentative structure identification as classification tasks (e.g. attack-support relations, stance, explicit premise/claim). This paper goes a step further by addressing the task of automatically identifying reasoning patterns of arguments using predefined templates, which is called argument template (AT) instantiation. The contributions of this work are three-fold. First, we develop a simple, yet expressive set of easily annotatable ATs that can represent a majority of writer’s reasoning for texts with diverse policy topics while maintaining the computational feasibility of the task. Second, we create a small, but highly reliable annotated corpus of instantiated ATs on top of reliably annotated support and attack relations and conduct an annotation study. Third, we formulate the task of AT instantiation as structured prediction constrained by a feasible set of templates. Our evaluation demonstrates that we can annotate ATs with a reasonably high inter-annotator agreement, and the use of template-constrained inference is useful for instantiating ATs with only partial reasoning comprehension clues.
Anthology ID:
W18-5210
Volume:
Proceedings of the 5th Workshop on Argument Mining
Month:
November
Year:
2018
Address:
Brussels, Belgium
Editors:
Noam Slonim, Ranit Aharonov
Venue:
ArgMining
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
79–89
Language:
URL:
https://aclanthology.org/W18-5210
DOI:
10.18653/v1/W18-5210
Bibkey:
Cite (ACL):
Paul Reisert, Naoya Inoue, Tatsuki Kuribayashi, and Kentaro Inui. 2018. Feasible Annotation Scheme for Capturing Policy Argument Reasoning using Argument Templates. In Proceedings of the 5th Workshop on Argument Mining, pages 79–89, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
Feasible Annotation Scheme for Capturing Policy Argument Reasoning using Argument Templates (Reisert et al., ArgMining 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-5210.pdf
Code
 preisert/argument-reasoning-patterns