Abstract
This paper focuses on face stylization with a single artistic target.Existing works for this task often fail to retain the source content whileachieving geometry variation. Here, we present a novel StyO model, ie. Stylizethe face in only One-shot, to solve the above problem. In particular, StyOexploits a disentanglement and recombination strategy. It first disentanglesthe content and style of source and target images into identifiers, which arethen recombined in a cross manner to derive the stylized face image. In thisway, StyO decomposes complex images into independent and specific attributes,and simplifies one-shot face stylization as the combination of differentattributes from input images, thus producing results better matching facegeometry of target image and content of source one. StyO is implemented withlatent diffusion models (LDM) and composed of two key modules: 1) IdentifierDisentanglement Learner (IDL) for disentanglement phase. It representsidentifiers as contrastive text prompts, ie. positive and negativedescriptions. And it introduces a novel triple reconstruction loss to fine-tunethe pre-trained LDM for encoding style and content into correspondingidentifiers; 2) Fine-grained Content Controller (FCC) for the recombinationphase. It recombines disentangled identifiers from IDL to form an augmentedtext prompt for generating stylized faces. In addition, FCC also constrains thecross-attention maps of latent and text features to preserve source facedetails in results. The extensive evaluation shows that StyO produceshigh-quality images on numerous paintings of various styles and outperforms thecurrent state-of-the-art. Code will be released upon acceptance.