Abstract
Deep neural networks excel at function approximation, yet they are typicallytrained from scratch for each new function. On the other hand, Bayesianmethods, such as Gaussian Processes (GPs), exploit prior knowledge to quicklyinfer the shape of a new function at test time. Yet GPs are computationallyexpensive, and it can be hard to design appropriate priors. In this paper wepropose a family of neural models, Conditional Neural Processes (CNPs), thatcombine the benefits of both. CNPs are inspired by the flexibility ofstochastic processes such as GPs, but are structured as neural networks andtrained via gradient descent. CNPs make accurate predictions after observingonly a handful of training data points, yet scale to complex functions andlarge datasets. We demonstrate the performance and versatility of the approachon a range of canonical machine learning tasks, including regression,classification and image completion.