Abstract

We employ a combination of recent developments in semi-supervised learningfor automatic speech recognition to obtain state-of-the-art results onLibriSpeech utilizing the unlabeled audio of the Libri-Light dataset. Moreprecisely, we carry out noisy student training with SpecAugment using giantConformer models pre-trained using wav2vec 2.0 pre-training. By doing so, weare able to achieve word-error-rates (WERs) 1.4%/2.6% on the LibriSpeechtest/test-other sets against the current state-of-the-art WERs 1.7%/3.3%.

 

Quick Read (beta)