Neural Fixed-Point Acceleration for Convex Optimization

  • 2021-07-21 17:59:34
  • Shobha Venkataraman, Brandon Amos
  • 2


Fixed-point iterations are at the heart of numerical computing and are oftena computational bottleneck in real-time applications, which typically insteadneed a fast solution of moderate accuracy. Classical acceleration methods forfixed-point problems focus on designing algorithms with theoretical guaranteesthat apply to any fixed-point problem. We present neural fixed-pointacceleration, a framework to automatically learn to accelerate convexfixed-point problems that are drawn from a distribution, using ideas frommeta-learning and classical acceleration algorithms. We apply our framework toSCS, the state-of-the-art solver for convex cone programming, and design modelsand loss functions to overcome the challenges of learning over unrolledoptimization and acceleration instabilities. Our work brings neuralacceleration into any optimization problem expressible with CVXPY. The sourcecode behind this paper is available at


Quick Read (beta)

loading the full paper ...