Projective Splitting with Forward Steps: Asynchronous and Block-Iterative Operator Splitting

  • 2018-03-19 17:15:43
  • Patrick R. Johnstone, Jonathan Eckstein
  • 1

Abstract

This work is concerned with the classical problem of finding a zero of a sumof maximal monotone operators. For the projective splitting framework recentlyproposed by Combettes and Eckstein, we show how to replace the fundamentalsubproblem calculation using a backward step with one based on two forwardsteps. The resulting algorithms have the same kind of coordination procedureand can be implemented in the same block-iterative and potentially distributedand asynchronous manner, but may perform backward steps on some operators andforward steps on others. Prior algorithms in the projective splitting familyhave used only backward steps. Forward steps can be used for anyLipschitz-continuous operators provided the stepsize is bounded by the inverseof the Lipschitz constant. If the Lipschitz constant is unknown, a simplebacktracking linesearch procedure may be used. For affine operators, thestepsize can be chosen adaptively without knowledge of the Lipschitz constantand without any additional forward steps. We close the paper by empiricallystudying the performance of several kinds of splitting algorithms on the lassoproblem.

 

Quick Read (beta)

loading the full paper ...