Abstract
Text-to-image (T2I) models excel on single-entity prompts but struggle withmulti-subject descriptions, often showing attribute leakage, identityentanglement, and subject omissions. We introduce the first theoreticalframework with a principled, optimizable objective for steering samplingdynamics toward multi-subject fidelity. Viewing flow matching (FM) throughstochastic optimal control (SOC), we formulate subject disentanglement ascontrol over a trained FM sampler. This yields two architecture-agnosticalgorithms: (i) a training-free test-time controller that perturbs the basevelocity with a single-pass update, and (ii) Adjoint Matching, a lightweightfine-tuning rule that regresses a control network to a backward adjoint signalwhile preserving base-model capabilities. The same formulation unifies priorattention heuristics, extends to diffusion models via a flow-diffusioncorrespondence, and provides the first fine-tuning route explicitly designedfor multi-subject fidelity. Empirically, on Stable Diffusion 3.5, FLUX, andStable Diffusion XL, both algorithms consistently improve multi-subjectalignment while maintaining base-model style. Test-time control runsefficiently on commodity GPUs, and fine-tuned controllers trained on limitedprompts generalize to unseen ones. We further highlight FOCUS (Flow OptimalControl for Unentangled Subjects), which achieves state-of-the-artmulti-subject fidelity across models.