Lyb3b at SemEval-2018 Task 11: Machine Comprehension Task using Deep Learning Models

Yongbin Li, Xiaobing Zhou


Abstract
Machine Comprehension of text is a typical Natural Language Processing task which remains an elusive challenge. This paper is to solve the task 11 of SemEval-2018, Machine Comprehension using Commonsense Knowledge task. We use deep learning model to solve the problem. We build distributed word embedding of text, question and answering respectively instead of manually extracting features by linguistic tools. Meanwhile, we use a series of frameworks such as CNN model, LSTM model, LSTM with attention model and biLSTM with attention model for processing word vector. Experiments demonstrate the superior performance of biLSTM with attention framework compared to other models. We also delete high frequency words and combine word vector and data augmentation methods, achieved a certain effect. The approach we proposed rank 6th in official results, with accuracy rate of 0.7437 in test dataset.
Anthology ID:
S18-1180
Volume:
Proceedings of the 12th International Workshop on Semantic Evaluation
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Marianna Apidianaki, Saif M. Mohammad, Jonathan May, Ekaterina Shutova, Steven Bethard, Marine Carpuat
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1073–1077
Language:
URL:
https://aclanthology.org/S18-1180
DOI:
10.18653/v1/S18-1180
Bibkey:
Cite (ACL):
Yongbin Li and Xiaobing Zhou. 2018. Lyb3b at SemEval-2018 Task 11: Machine Comprehension Task using Deep Learning Models. In Proceedings of the 12th International Workshop on Semantic Evaluation, pages 1073–1077, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
Lyb3b at SemEval-2018 Task 11: Machine Comprehension Task using Deep Learning Models (Li & Zhou, SemEval 2018)
Copy Citation:
PDF:
https://aclanthology.org/S18-1180.pdf