Abstract
Global Style Tokens (GSTs) are a recently-proposed method to learn latentdisentangled representations of high-dimensional data. GSTs can be used withinTacotron, a state-of-the-art end-to-end text-to-speech synthesis system, touncover expressive factors of variation in speaking style. In this work, weintroduce the Text-Predicted Global Style Token (TP-GST) architecture, whichtreats GST combination weights or style embeddings as "virtual" speaking stylelabels within Tacotron. TP-GST learns to predict stylistic renderings from textalone, requiring neither explicit labels during training nor auxiliary inputsfor inference. We show that, when trained on a dataset of expressive speech,our system generates audio with more pitch and energy variation than twostate-of-the-art baseline models. We further demonstrate that TP-GSTs cansynthesize speech with background noise removed, and corroborate these analyseswith positive results on human-rated listener preference audiobook tasks.Finally, we demonstrate that multi-speaker TP-GST models successfully factorizespeaker identity and speaking style. We provide a website with audio samplesfor each of our findings.