Differentiable plasticity: training plastic neural networks with backpropagation

  • 2018-07-31 16:55:11
  • Thomas Miconi, Jeff Clune, Kenneth O. Stanley
  • 0

Abstract

How can we build agents that keep learning from experience, quickly andefficiently, after their initial training? Here we take inspiration from themain mechanism of learning in biological brains: synaptic plasticity, carefullytuned by evolution to produce efficient lifelong learning. We show thatplasticity, just like connection weights, can be optimized by gradient descentin large (millions of parameters) recurrent networks with Hebbian plasticconnections. First, recurrent plastic networks with more than two millionparameters can be trained to memorize and reconstruct sets of novel,high-dimensional 1000+ pixels natural images not seen during training.Crucially, traditional non-plastic recurrent networks fail to solve this task.Furthermore, trained plastic networks can also solve generic meta-learningtasks such as the Omniglot task, with competitive results and little parameteroverhead. Finally, in reinforcement learning settings, plastic networksoutperform a non-plastic equivalent in a maze exploration task. We concludethat differentiable plasticity may provide a powerful novel approach to thelearning-to-learn problem.

 

Quick Read (beta)

loading the full paper ...