Abstract
Recent studies have explored combining different LoRAs to jointly generatelearned style and content. However, existing methods either fail to effectivelypreserve both the original subject and style simultaneously or requireadditional training. In this paper, we argue that the intrinsic properties ofLoRA can effectively guide diffusion models in merging learned subject andstyle. Building on this insight, we propose K-LoRA, a simple yet effectivetraining-free LoRA fusion approach. In each attention layer, K-LoRA comparesthe Top-K elements in each LoRA to be fused, determining which LoRA to selectfor optimal fusion. This selection mechanism ensures that the mostrepresentative features of both subject and style are retained during thefusion process, effectively balancing their contributions. Experimental resultsdemonstrate that the proposed method effectively integrates the subject andstyle information learned by the original LoRAs, outperforming state-of-the-arttraining-based approaches in both qualitative and quantitative results.