More or less controlled elicitation of argumentative text: Enlarging a microtext corpus via crowdsourcing

Maria Skeppstedt, Andreas Peldszus, Manfred Stede


Abstract
We present an extension of an annotated corpus of short argumentative texts that had originally been built in a controlled text production experiment. Our extension more than doubles the size of the corpus by means of crowdsourcing. We report on the setup of this experiment and on the consequences that crowdsourcing had for assembling the data, and in particular for annotation. We labeled the argumentative structure by marking claims, premises, and relations between them, following the scheme used in the original corpus, but had to make a few modifications in response to interesting phenomena in the data. Finally, we report on an experiment with the automatic prediction of this argumentation structure: We first replicated the approach of an earlier study on the original corpus, and compare the performance to various settings involving the extension.
Anthology ID:
W18-5218
Volume:
Proceedings of the 5th Workshop on Argument Mining
Month:
November
Year:
2018
Address:
Brussels, Belgium
Editors:
Noam Slonim, Ranit Aharonov
Venue:
ArgMining
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
155–163
Language:
URL:
https://aclanthology.org/W18-5218
DOI:
10.18653/v1/W18-5218
Bibkey:
Cite (ACL):
Maria Skeppstedt, Andreas Peldszus, and Manfred Stede. 2018. More or less controlled elicitation of argumentative text: Enlarging a microtext corpus via crowdsourcing. In Proceedings of the 5th Workshop on Argument Mining, pages 155–163, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
More or less controlled elicitation of argumentative text: Enlarging a microtext corpus via crowdsourcing (Skeppstedt et al., ArgMining 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-5218.pdf