CINS: Comprehensive Instruction for Few-Shot Learning in Task-Oriented Dialog Systems
Fei Mi, Yasheng Wang, Yitong Li
[AAAI-22] Main Track
Abstract:
As the labeling cost for different modules in task-oriented dialog (ToD) systems is high, a major challenge is to learn different tasks with the least amount of labeled data. Recently, pre-trained language models (PLMs) have shown promising results for few-shot learning in ToD. To better utilize the power of PLMs, this paper proposes Comprehensive Instruction (CINS) that exploits PLMs with extra task-specific instructions. We design a schema (definition, constraint, prompt) of instructions and their customized realizations for three important downstream tasks in ToD, ie. intent classification, dialog state tracking, and natural language generation. A sequence-to-sequence model (T5) is adopted to solve these three tasks in a unified framework. Extensive experiments are conducted on these ToD tasks in realistic few-shot learning scenarios with small validation data. Empirical results demonstrate that the proposed CINS approach consistently improves techniques that finetune PLMs with raw input or short prompt.
Introduction Video
Sessions where this paper appears
-
Poster Session 4
Fri, February 25 5:00 PM - 6:45 PM (+00:00)
Red 5
-
Poster Session 11
Mon, February 28 12:45 AM - 2:30 AM (+00:00)
Red 5
-
Oral Session 11
Mon, February 28 2:30 AM - 3:45 AM (+00:00)
Red 5