Feudal Dialogue Management with Jointly Learned Feature Extractors

Iñigo Casanueva, Paweł Budzianowski, Stefan Ultes, Florian Kreyssig, Bo-Hsiang Tseng, Yen-chen Wu, Milica Gašić


Abstract
Reinforcement learning (RL) is a promising dialogue policy optimisation approach, but traditional RL algorithms fail to scale to large domains. Recently, Feudal Dialogue Management (FDM), has shown to increase the scalability to large domains by decomposing the dialogue management decision into two steps, making use of the domain ontology to abstract the dialogue state in each step. In order to abstract the state space, however, previous work on FDM relies on handcrafted feature functions. In this work, we show that these feature functions can be learned jointly with the policy model while obtaining similar performance, even outperforming the handcrafted features in several environments and domains.
Anthology ID:
W18-5038
Volume:
Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue
Month:
July
Year:
2018
Address:
Melbourne, Australia
Editors:
Kazunori Komatani, Diane Litman, Kai Yu, Alex Papangelis, Lawrence Cavedon, Mikio Nakano
Venue:
SIGDIAL
SIG:
SIGDIAL
Publisher:
Association for Computational Linguistics
Note:
Pages:
332–337
Language:
URL:
https://aclanthology.org/W18-5038
DOI:
10.18653/v1/W18-5038
Bibkey:
Cite (ACL):
Iñigo Casanueva, Paweł Budzianowski, Stefan Ultes, Florian Kreyssig, Bo-Hsiang Tseng, Yen-chen Wu, and Milica Gašić. 2018. Feudal Dialogue Management with Jointly Learned Feature Extractors. In Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue, pages 332–337, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
Feudal Dialogue Management with Jointly Learned Feature Extractors (Casanueva et al., SIGDIAL 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-5038.pdf