CS-NET at SemEval-2020 Task 4: Siamese BERT for ComVE

Soumya Ranjan Dash, Sandeep Routray, Prateek Varshney, Ashutosh Modi


Abstract
In this paper, we describe our system for Task 4 of SemEval 2020, which involves differentiating between natural language statements that conform to common sense and those that do not. The organizers propose three subtasks - first, selecting between two sentences, the one which is against common sense. Second, identifying the most crucial reason why a statement does not make sense. Third, generating novel reasons for explaining the against common sense statement. Out of the three subtasks, this paper reports the system description of subtask A and subtask B. This paper proposes a model based on transformer neural network architecture for addressing the subtasks. The novelty in work lies in the architecture design, which handles the logical implication of contradicting statements and simultaneous information extraction from both sentences. We use a parallel instance of transformers, which is responsible for a boost in the performance. We achieved an accuracy of 94.8% in subtask A and 89% in subtask B on the test set.
Anthology ID:
2020.semeval-1.61
Volume:
Proceedings of the Fourteenth Workshop on Semantic Evaluation
Month:
December
Year:
2020
Address:
Barcelona (online)
Editors:
Aurelie Herbelot, Xiaodan Zhu, Alexis Palmer, Nathan Schneider, Jonathan May, Ekaterina Shutova
Venue:
SemEval
SIG:
SIGLEX
Publisher:
International Committee for Computational Linguistics
Note:
Pages:
501–506
Language:
URL:
https://aclanthology.org/2020.semeval-1.61
DOI:
10.18653/v1/2020.semeval-1.61
Bibkey:
Cite (ACL):
Soumya Ranjan Dash, Sandeep Routray, Prateek Varshney, and Ashutosh Modi. 2020. CS-NET at SemEval-2020 Task 4: Siamese BERT for ComVE. In Proceedings of the Fourteenth Workshop on Semantic Evaluation, pages 501–506, Barcelona (online). International Committee for Computational Linguistics.
Cite (Informal):
CS-NET at SemEval-2020 Task 4: Siamese BERT for ComVE (Dash et al., SemEval 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.semeval-1.61.pdf
Code
 soumyardash/SemEval2020-Task4