Abstract
Learning representations for solutions of constrained optimization problems(COPs) with unknown cost functions is challenging, as models like (Variational)Autoencoders struggle to enforce constraints when decoding structured outputs.We propose an Inverse Optimization Latent Variable Model (IO-LVM) that learns alatent space of COP cost functions from observed solutions and reconstructsfeasible outputs by solving a COP with a solver in the loop. Our approachleverages estimated gradients of a Fenchel-Young loss through anon-differentiable deterministic solver to shape the latent space. Unlikestandard Inverse Optimization or Inverse Reinforcement Learning methods, whichtypically recover a single or context-specific cost function, IO-LVM captures adistribution over cost functions, enabling the identification of diversesolution behaviors arising from different agents or conditions not availableduring the training process. We validate our method on real-world datasets ofship and taxi routes, as well as paths in synthetic graphs, demonstrating itsability to reconstruct paths and cycles, predict their distributions, and yieldinterpretable latent representations.