Abstract

In this paper, we explore a method for training speech-to-speech translationtasks without any transcription or linguistic supervision. Our proposed methodconsists of two steps: First, we train and generate discrete representationwith unsupervised term discovery with a discrete quantized autoencoder. Second,we train a sequence-to-sequence model that directly maps the source languagespeech to the target language's discrete representation. Our proposed methodcan directly generate target speech without any auxiliary or pre-training stepswith a source or target transcription. To the best of our knowledge, this isthe first work that performed pure speech-to-speech translation betweenuntranscribed unknown languages.

 

Quick Read (beta)