Abstract
A major bottleneck in training end-to-end task-oriented dialog system is thelack of data. To utilize limited training data more efficiently, we proposeModular Supervision Network (MOSS), an encoder-decoder training framework thatcould incorporate supervision from various intermediate dialog system modulesincluding natural language understanding, dialog state tracking, dialog policylearning, and natural language generation. With only 60% of the training data,MOSS-all (i.e., MOSS with supervision from all four dialog modules) outperformsstate-of-the-art models on CamRest676. Moreover, introducing modularsupervision has even bigger benefits when the dialog task has a more complexdialog state and action space. With only 40% of the training data, MOSS-alloutperforms the state-of-the-art model on a complex laptop networktroubleshooting dataset, LaptopNetwork, that we introduced. LaptopNetworkconsists of conversations between real customers and customer service agents inChinese. Moreover, MOSS framework can accommodate dialogs that have supervisionfrom different dialog modules at both the framework level and model level.Therefore, MOSS is extremely flexible to update in a real-world deployment.