Abstract
Can one inject new concepts into an already trained generative model, whilerespecting its existing structure and knowledge? We propose a new task - domainexpansion - to address this. Given a pretrained generator and novel (butrelated) domains, we expand the generator to jointly model all domains, old andnew, harmoniously. First, we note the generator contains a meaningful,pretrained latent space. Is it possible to minimally perturb this hard-earnedrepresentation, while maximally representing the new domains? Interestingly, wefind that the latent space offers unused, "dormant" directions, which do notaffect the output. This provides an opportunity: By "repurposing" thesedirections, we can represent new domains without perturbing the originalrepresentation. In fact, we find that pretrained generators have the capacityto add several - even hundreds - of new domains! Using our expansion method,one "expanded" model can supersede numerous domain-specific models, withoutexpanding the model size. Additionally, a single expanded generator nativelysupports smooth transitions between domains, as well as composition of domains.Code and project page available athttps://yotamnitzan.github.io/domain-expansion/.