Functional Regularisation for Continual Learning

  • 2019-06-11 17:49:51
  • Michalis K. Titsias, Jonathan Schwarz, Alexander G. de G. Matthews, Razvan Pascanu, Yee Whye Teh
  • 0

Abstract

We introduce a framework for continual learning based on Bayesian inferenceover the function space rather than the parameters of a deep neural network.This method, referred to as functional regularisation for continual learning,avoids forgetting a previous task by constructing and memorising an approximateposterior belief over the underlying task-specific function. To achieve this werely on a Gaussian process obtained by treating the weights of the last layerof a neural network as random and Gaussian distributed. Then, the trainingalgorithm sequentially encounters tasks and constructs posterior beliefs overthe task-specific functions by using inducing point sparse Gaussian processmethods. At each step a new task is first learnt and then a summary isconstructed consisting of (i) inducing inputs and (ii) a posterior distributionover the function values at these inputs. This summary then regulariseslearning of future tasks, through Kullback-Leibler regularisation terms, sothat catastrophic forgetting of earlier tasks is avoided. We demonstrate ouralgorithm in classification datasets, such as Split-MNIST, Permuted-MNIST andOmniglot.

 

Quick Read (beta)

loading the full paper ...