Abstract
When there is a mismatch between the target identity and the driver identity,face reenactment suffers severe degradation in the quality of the result,especially in a few-shot setting. The identity preservation problem, where themodel loses the detailed information of the target leading to a defectiveoutput, is the most common failure mode. The problem has several potentialsources such as the identity of the driver leaking due to the identitymismatch, or dealing with unseen large poses. To overcome such problems, weintroduce components that address the mentioned problem: image attention block,target feature alignment, and landmark transformer. Through attending andwarping the relevant features, the proposed architecture, called MarioNETte,produces high-quality reenactments of unseen identities in a few-shot setting.In addition, the landmark transformer dramatically alleviates the identitypreservation problem by isolating the expression geometry through landmarkdisentanglement. Comprehensive experiments are performed to verify that theproposed framework can generate highly realistic faces, outperforming all otherbaselines, even under a significant mismatch of facial characteristics betweenthe target and the driver.