On the overfly algorithm in deep learning of neural networks

  • 2018-08-09 15:05:34
  • Alexei Tsygvintsev
  • 1

Abstract

In this paper we investigate the supervised backpropagation training ofmultilayer neural networks from a dynamical systems point of view. We discusssome links with the qualitative theory of differential equations and introducethe overfly algorithm to tackle the local minima problem. Our approach is basedon the existence of first integrals of the generalised gradient system withbuild-in dissipation.

 

Introduction (beta)

None

 

Conclusion (beta)

None