Stimulating STDP to Exploit Locality for Lifelong Learning without Catastrophic Forgetting

  • 2019-02-08 16:50:33
  • Jason M. Allred, Kaushik Roy
  • 1

Abstract

Stochastic gradient descent requires that training samples be drawn from auniformly random distribution of the data. For a deployed system that mustlearn online from an uncontrolled and unknown environment, the ordering ofinput samples often fails to meet this criterion, making lifelong learning adifficult challenge. We exploit the locality of the unsupervised Spike TimingDependent Plasticity (STDP) learning rule to target subsets of a segmentedSpiking Neural Network (SNN) to adapt to novel information while protecting theinformation in the remainder of the SNN from catastrophic forgetting. In oursystem, novel information triggers stimulated firing, inspired by biologicaldopamine signals, to boost STDP in the synapses of neurons associated withoutlier information. This targeting controls the forgetting process in a waythat reduces accuracy degradation while learning new information. Ourpreliminary results on the MNIST dataset validate the capability of such asystem to learn successfully over time from an unknown, changing environment,achieving up to 93.88% accuracy for a completely disjoint dataset.

 

Introduction (beta)

None

 

Conclusion (beta)

None