Higher-order algorithms and implicit regularization for nonlinearly parameterized adaptive control

  • 2020-02-20 18:59:10
  • Nicholas M. Boffi, Jean-Jacques E. Slotine
  • 0

Abstract

Stable concurrent learning and control of dynamical systems is the subject ofadaptive control. Adaptive control is a field with many practical applicationsand a rich theory, but much of the development for nonlinear systems revolvesaround a few key algorithms. By exploiting strong connections between nonlinearadaptive control techniques and recent progress in optimization and machinelearning, we show that there exists considerable untapped potential inalgorithm development for nonlinear adaptive control. We present a large set ofnew globally convergent adaptive control algorithms that are applicable both tolinearly parameterized systems and to nonlinearly parameterized systemssatisfying a certain monotonicity requirement. We adopt a variational formalismbased on the Bregman Lagrangian to define a general framework thatsystematically generates higher-order in-time velocity gradient algorithms. Wegeneralize our algorithms to the non-Euclidean setting and show that the EulerLagrange equations for the Bregman Lagrangian lead to natural gradient andmirror descent-like adaptation laws with momentum that incorporate localgeometry through a Hessian metric specified by a convex function. We prove thatthese non-Euclidean adaptation laws implicitly regularize the system model byminimizing the convex function that specifies the metric throughout adaptation.Local geometry imposed during adaptation thus may be used to select parametervectors - out of the many that will lead to perfect tracking - for desiredproperties such as sparsity. We illustrate our analysis with simulations usinga higher-order algorithm for nonlinearly parameterized systems to learnregularized hidden layer weights in a three-layer feedforward neural network.

 

Quick Read (beta)

loading the full paper ...