Abstract
A neural network (NN) is a parameterised function that can be tuned viagradient descent to approximate a labelled collection of data with highprecision. A Gaussian process (GP), on the other hand, is a probabilistic modelthat defines a distribution over possible functions, and is updated in light ofdata via the rules of probabilistic inference. GPs are probabilistic,data-efficient and flexible, however they are also computationally intensiveand thus limited in their applicability. We introduce a class of neural latentvariable models which we call Neural Processes (NPs), combining the best ofboth worlds. Like GPs, NPs define distributions over functions, are capable ofrapid adaptation to new observations, and can estimate the uncertainty in theirpredictions. Like NNs, NPs are computationally efficient during training andevaluation but also learn to adapt their priors to data. We demonstrate theperformance of NPs on a range of learning tasks, including regression andoptimisation, and compare and contrast with related models in the literature.