Adversarial Domain Adaptation for Variational Neural Language Generation in Dialogue Systems

  • 2018-08-08 00:02:18
  • Van-Khanh Tran, Le-Minh Nguyen
  • 2

Abstract

Domain Adaptation arises when we aim at learning from source domain a modelthat can per- form acceptably well on a different target domain. It isespecially crucial for Natural Language Generation (NLG) in Spoken DialogueSystems when there are sufficient annotated data in the source domain, butthere is a limited labeled data in the target domain. How to effectivelyutilize as much of existing abilities from source domains is a crucial issue indomain adaptation. In this paper, we propose an adversarial training procedureto train a Variational encoder-decoder based language generator via multipleadaptation steps. In this procedure, a model is first trained on a sourcedomain data and then fine-tuned on a small set of target domain utterancesunder the guidance of two proposed critics. Experimental results show that theproposed method can effec- tively leverage the existing knowledge in the sourcedomain to adapt to another related domain by using only a small amount ofin-domain data.

 

Quick Read (beta)

loading the full paper ...