Abstract
Statistical language models (LM) play a key role in Automatic SpeechRecognition (ASR) systems used by conversational agents. These ASR systemsshould provide a high accuracy under a variety of speaking styles, domains,vocabulary and argots. In this paper, we present a DNN-based method to adaptthe LM to each user-agent interaction based on generalized contextualinformation, by predicting an optimal, context-dependent set of LMinterpolation weights. We show that this framework for contextual adaptationprovides accuracy improvements under different possible mixture LM partitionsthat are relevant for both (1) Goal-oriented conversational agents where it'snatural to partition the data by the requested application and for (2) Non-goaloriented conversational agents where the data can be partitioned using topiclabels that come from predictions of a topic classifier. We obtain a relativeWER improvement of 3% with a 1-pass decoding strategy and 6% in a 2-passdecoding framework, over an unadapted model. We also show up to a 15% relativeimprovement in recognizing named entities which is of significant value forconversational ASR systems.