Abstract
How to generate conditional synthetic data for a domain without utilizinginformation about its labels/attributes? Our work presents a solution to theabove question. We propose a transfer learning-based framework utilizingnormalizing flows, coupled with both maximum-likelihood and adversarialtraining. We model a source domain (labels available) and a target domain(labels unavailable) with individual normalizing flows, and perform domainalignment to a common latent space using adversarial discriminators. Due to theinvertible property of flow models, the mapping has exact cycle consistency. Wealso learn the joint distribution of the data samples and attributes in thesource domain by employing an encoder to map attributes to the latent space viaadversarial training. During the synthesis phase, given any combination ofattributes, our method can generate synthetic samples conditioned on them inthe target domain. Empirical studies confirm the effectiveness of our method onbenchmarked datasets. We envision our method to be particularly useful forsynthetic data generation in label-scarce systems by generating non-trivialaugmentations via attribute transformations. These synthetic samples willintroduce more entropy into the label-scarce domain than their geometric andphotometric transformation counterparts, helpful for robust downstream tasks.