Chat Discrimination for Intelligent Conversational Agents with a Hybrid CNN-LMTGRU Network

Dennis Singh Moirangthem, Minho Lee


Abstract
Recently, intelligent dialog systems and smart assistants have attracted the attention of many, and development of novel dialogue agents have become a research challenge. Intelligent agents that can handle both domain-specific task-oriented and open-domain chit-chat dialogs are one of the major requirements in the current systems. In order to address this issue and to realize such smart hybrid dialogue systems, we develop a model to discriminate user utterance between task-oriented and chit-chat conversations. We introduce a hybrid of convolutional neural network (CNN) and a lateral multiple timescale gated recurrent units (LMTGRU) that can represent multiple temporal scale dependencies for the discrimination task. With the help of the combined slow and fast units of the LMTGRU, our model effectively determines whether a user will have a chit-chat conversation or a task-specific conversation with the system. We also show that the LMTGRU structure helps the model to perform well on longer text inputs. We address the lack of dataset by constructing a dataset using Twitter and Maluuba Frames data. The results of the experiments demonstrate that the proposed hybrid network outperforms the conventional models on the chat discrimination task as well as performed comparable to the baselines on various benchmark datasets.
Anthology ID:
W18-3004
Volume:
Proceedings of the Third Workshop on Representation Learning for NLP
Month:
July
Year:
2018
Address:
Melbourne, Australia
Editors:
Isabelle Augenstein, Kris Cao, He He, Felix Hill, Spandana Gella, Jamie Kiros, Hongyuan Mei, Dipendra Misra
Venue:
RepL4NLP
SIG:
SIGREP
Publisher:
Association for Computational Linguistics
Note:
Pages:
30–40
Language:
URL:
https://aclanthology.org/W18-3004
DOI:
10.18653/v1/W18-3004
Bibkey:
Cite (ACL):
Dennis Singh Moirangthem and Minho Lee. 2018. Chat Discrimination for Intelligent Conversational Agents with a Hybrid CNN-LMTGRU Network. In Proceedings of the Third Workshop on Representation Learning for NLP, pages 30–40, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
Chat Discrimination for Intelligent Conversational Agents with a Hybrid CNN-LMTGRU Network (Moirangthem & Lee, RepL4NLP 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-3004.pdf
Data
MPQA Opinion CorpusMicrosoft Research Social Media Conversation CorpusSSTSST-2