Attention Modeling for Targeted Sentiment

Jiangming Liu, Yue Zhang


Abstract
Neural network models have been used for target-dependent sentiment analysis. Previous work focus on learning a target specific representation for a given input sentence which is used for classification. However, they do not explicitly model the contribution of each word in a sentence with respect to targeted sentiment polarities. We investigate an attention model to this end. In particular, a vanilla LSTM model is used to induce an attention value of the whole sentence. The model is further extended to differentiate left and right contexts given a certain target following previous work. Results show that by using attention to model the contribution of each word with respect to the target, our model gives significantly improved results over two standard benchmarks. We report the best accuracy for this task.
Anthology ID:
E17-2091
Volume:
Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers
Month:
April
Year:
2017
Address:
Valencia, Spain
Editors:
Mirella Lapata, Phil Blunsom, Alexander Koller
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
572–577
Language:
URL:
https://aclanthology.org/E17-2091
DOI:
Bibkey:
Cite (ACL):
Jiangming Liu and Yue Zhang. 2017. Attention Modeling for Targeted Sentiment. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, pages 572–577, Valencia, Spain. Association for Computational Linguistics.
Cite (Informal):
Attention Modeling for Targeted Sentiment (Liu & Zhang, EACL 2017)
Copy Citation:
PDF:
https://aclanthology.org/E17-2091.pdf