Abstract
Equilibrium Propagation (EP) is a learning algorithm for trainingEnergy-based Models (EBMs) on static inputs which leverages the variationaldescription of their fixed points. Extending EP to time-varying inputs is achallenging problem, as the variational description must apply to the entiresystem trajectory rather than just fixed points, and careful consideration ofboundary conditions becomes essential. In this work, we present GeneralizedLagrangian Equilibrium Propagation (GLEP), which extends the variationalformulation of EP to time-varying inputs. We demonstrate that GLEP yieldsdifferent learning algorithms depending on the boundary conditions of thesystem, many of which are impractical for implementation. We then show thatHamiltonian Echo Learning (HEL) -- which includes the recently proposedRecurrent HEL (RHEL) and the earlier known Hamiltonian Echo Backpropagation(HEB) algorithms -- can be derived as a special case of GLEP. Notably, HEL isthe only instance of GLEP we found that inherits the properties that make EP adesirable alternative to backpropagation for hardware implementations: itoperates in a "forward-only" manner (i.e. using the same system for bothinference and learning), it scales efficiently (requiring only two or morepasses through the system regardless of model size), and enables locallearning.