Abstract
Recent advancements in generative models have revolutionized image generationand editing, making these tasks accessible to non-experts. This paper focuseson local image editing, particularly the task of adding new content to aloosely specified area. Existing methods often require a precise mask or adetailed description of the location, which can be cumbersome and prone toerrors. We propose Click2Mask, a novel approach that simplifies the localediting process by requiring only a single point of reference (in addition tothe content description). A mask is dynamically grown around this point duringa Blended Latent Diffusion (BLD) process, guided by a masked CLIP-basedsemantic loss. Click2Mask surpasses the limitations of segmentation-based andfine-tuning dependent methods, offering a more user-friendly and contextuallyaccurate solution. Our experiments demonstrate that Click2Mask not onlyminimizes user effort but also delivers competitive or superior local imagemanipulation results compared to SoTA methods, according to both humanjudgement and automatic metrics. Key contributions include the simplificationof user input, the ability to freely add objects unconstrained by existingsegments, and the integration potential of our dynamic mask approach withinother editing methods.