NUAA-QMUL at SemEval-2020 Task 8: Utilizing BERT and DenseNet for Internet Meme Emotion Analysis

Xiaoyu Guo, Jing Ma, Arkaitz Zubiaga


Abstract
This paper describes our contribution to SemEval 2020 Task 8: Memotion Analysis. Our system learns multi-modal embeddings from text and images in order to classify Internet memes by sentiment. Our model learns text embeddings using BERT and extracts features from images with DenseNet, subsequently combining both features through concatenation. We also compare our results with those produced by DenseNet, ResNet, BERT, and BERT-ResNet. Our results show that image classification models have the potential to help classifying memes, with DenseNet outperforming ResNet. Adding text features is however not always helpful for Memotion Analysis.
Anthology ID:
2020.semeval-1.114
Volume:
Proceedings of the Fourteenth Workshop on Semantic Evaluation
Month:
December
Year:
2020
Address:
Barcelona (online)
Editors:
Aurelie Herbelot, Xiaodan Zhu, Alexis Palmer, Nathan Schneider, Jonathan May, Ekaterina Shutova
Venue:
SemEval
SIG:
SIGLEX
Publisher:
International Committee for Computational Linguistics
Note:
Pages:
901–907
Language:
URL:
https://aclanthology.org/2020.semeval-1.114
DOI:
10.18653/v1/2020.semeval-1.114
Bibkey:
Cite (ACL):
Xiaoyu Guo, Jing Ma, and Arkaitz Zubiaga. 2020. NUAA-QMUL at SemEval-2020 Task 8: Utilizing BERT and DenseNet for Internet Meme Emotion Analysis. In Proceedings of the Fourteenth Workshop on Semantic Evaluation, pages 901–907, Barcelona (online). International Committee for Computational Linguistics.
Cite (Informal):
NUAA-QMUL at SemEval-2020 Task 8: Utilizing BERT and DenseNet for Internet Meme Emotion Analysis (Guo et al., SemEval 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.semeval-1.114.pdf
Code
 xxxxxxxxy/Memotion-Analysis