TripleNet: Triple Attention Network for Multi-Turn Response Selection in Retrieval-Based Chatbots

Wentao Ma, Yiming Cui, Nan Shao, Su He, Wei-Nan Zhang, Ting Liu, Shijin Wang, Guoping Hu


Abstract
We consider the importance of different utterances in the context for selecting the response usually depends on the current query. In this paper, we propose the model TripleNet to fully model the task with the triple <context, query, response> instead of <context, response > in previous works. The heart of TripleNet is a novel attention mechanism named triple attention to model the relationships within the triple at four levels. The new mechanism updates the representation of each element based on the attention with the other two concurrently and symmetrically. We match the triple <C, Q, R> centered on the response from char to context level for prediction. Experimental results on two large-scale multi-turn response selection datasets show that the proposed model can significantly outperform the state-of-the-art methods.
Anthology ID:
K19-1069
Volume:
Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL)
Month:
November
Year:
2019
Address:
Hong Kong, China
Editors:
Mohit Bansal, Aline Villavicencio
Venue:
CoNLL
SIG:
SIGNLL
Publisher:
Association for Computational Linguistics
Note:
Pages:
737–746
Language:
URL:
https://aclanthology.org/K19-1069
DOI:
10.18653/v1/K19-1069
Bibkey:
Cite (ACL):
Wentao Ma, Yiming Cui, Nan Shao, Su He, Wei-Nan Zhang, Ting Liu, Shijin Wang, and Guoping Hu. 2019. TripleNet: Triple Attention Network for Multi-Turn Response Selection in Retrieval-Based Chatbots. In Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL), pages 737–746, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):
TripleNet: Triple Attention Network for Multi-Turn Response Selection in Retrieval-Based Chatbots (Ma et al., CoNLL 2019)
Copy Citation:
PDF:
https://aclanthology.org/K19-1069.pdf
Data
DoubanDouban Conversation CorpusUDC