Efficient Dialog Policy Learning by Reasoning with Contextual Knowledge

Haodi Zhang, Zhichao Zeng, Keting Lu, Kaishun Wu, Shiqi Zhang

[AAAI-22] Main Track
Abstract: Goal-oriented dialog policy learning algorithms aim to learn a dialog policy for selecting language actions based on the current dialog state. Deep reinforcement learning methods have been used for dialog policy learning. This work is motivated by the observation that, although dialog is a domain with rich contextual knowledge, reinforcement learning methods are ill-equipped to incorporate such knowledge into the dialog policy learning process. In this paper, we develop a deep reinforcement learning framework for goal-oriented dialog policy learning that learns user preferences from user goal data, while leveraging commonsense knowledge from people. The developed framework has been evaluated using a realistic dialog simulation platform. Compared with baselines from the literature and the ablations of our approach, we see significant improvements in learning efficiency and the quality of the computed action policies.

Introduction Video

Sessions where this paper appears

  • Poster Session 3

    Red 5

  • Poster Session 8

    Red 5