Abstract
Training-free guided generation is a widely used and powerful technique thatallows the end user to exert further control over the generative process offlow/diffusion models. Generally speaking, two families of techniques haveemerged for solving this problem for gradient-based guidance: namely, posteriorguidance (i.e., guidance via projecting the current sample to the targetdistribution via the target prediction model) and end-to-end guidance (i.e.,guidance by performing backpropagation throughout the entire ODE solve). Inthis work, we show that these two seemingly separate families can actually beunified by looking at posterior guidance as a greedy strategy of end-to-endguidance. We explore the theoretical connections between these two families andprovide an in-depth theoretical of these two techniques relative to thecontinuous ideal gradients. Motivated by this analysis we then show a methodfor interpolating between these two families enabling a trade-off betweencompute and accuracy of the guidance gradients. We then validate this work onseveral inverse image problems and property-guided molecular generation.