Abstract
Stable concurrent learning and control of dynamical systems is the subject ofadaptive control. Adaptive control is a field with many practical applicationsand a rich theory, but much of the development for nonlinear systems revolvesaround a few key algorithms. By exploiting strong connections between nonlinearadaptive control techniques and recent progress in optimization and machinelearning, we show that there exists considerable untapped potential inalgorithm development for nonlinear adaptive control. We present a large set ofnew globally convergent adaptive control algorithms that are applicable both tolinearly parameterized systems and to nonlinearly parameterized systemssatisfying certain monotonicity or convexity requirements. We adopt avariational formalism based on the Bregman Lagrangian to define a generalframework that systematically generates higher-order in-time velocity gradientalgorithms. We generalize our algorithms to the non-Euclidean setting and showthat the Euler Lagrange equations for the Bregman Lagrangian lead to naturalgradient and mirror descent-like adaptation laws with momentum that incorporatelocal geometry through a Hessian metric specified by a convex function. Weprove that these non-Euclidean adaptation laws implicitly regularize the systemmodel by minimizing the convex function that specifies the metric throughoutadaptation. Local geometry imposed during adaptation thus may be used to selectparameter vectors - out of the many that will lead to perfect tracking - fordesired properties such as sparsity. We illustrate our analysis withsimulations using a higher-order algorithm for nonlinearly parameterizedsystems to learn regularized hidden layer weights in a three-layer feedforwardneural network.