Meta Learning for End-to-End Low-Resource Speech Recognition

  • 2019-10-26 16:00:44
  • Jui-Yang Hsu, Yuan-Jui Chen, Hung-yi Lee
  • 2

Abstract

In this paper, we proposed to apply meta learning approach for low-resourceautomatic speech recognition (ASR). We formulated ASR for different languagesas different tasks, and meta-learned the initialization parameters from manypretraining languages to achieve fast adaptation on unseen target language, viarecently proposed model-agnostic meta learning algorithm (MAML). We evaluatedthe proposed approach using six languages as pretraining tasks and fourlanguages as target tasks. Preliminary results showed that the proposed method,MetaASR, significantly outperforms the state-of-the-art multitask pretrainingapproach on all target languages with different combinations of pretraininglanguages. In addition, since MAML's model-agnostic property, this paper alsoopens new research direction of applying meta learning to more speech-relatedapplications.

 

Quick Read (beta)

loading the full paper ...