Abstract
Personalizing Stable Diffusion for professional portrait generation fromamateur photos faces challenges in maintaining facial resemblance. This paperevaluates the impact of augmentation strategies on two personalization methods:DreamBooth and InstantID. We compare classical augmentations (flipping,cropping, color adjustments) with generative augmentation using InstantID'ssynthetic images to enrich training data. Using SDXL and a new FaceDistancemetric based on FaceNet, we quantitatively assess facial similarity. Resultsshow classical augmentations can cause artifacts harming identity retention,while InstantID improves fidelity when balanced with real images to avoidoverfitting. A user study with 97 participants confirms high photorealism andpreferences for InstantID's polished look versus DreamBooth's identityaccuracy. Our findings inform effective augmentation strategies forpersonalized text-to-image generation.