Abstract
This paper tackles the problem of disentangling the latent variables of styleand content in language models. We propose a simple, yet effective approach,which incorporates auxiliary objectives: a multi-task classification objective,and dual adversarial objectives for label prediction and bag-of-wordsprediction, respectively. We show, both qualitatively and quantitatively, thatthe style and content are indeed disentangled in the latent space, using thisapproach. This disentangled latent representation learning method is applied toattribute (e.g. style) transfer on non-parallel corpora. We achieve similarcontent preservation scores compared to previous state-of-the-art approaches,and significantly better style-transfer strength scores. Our code is madepublicly available for replicability and extension purposes.