Abstract
We introduce a deep generative model for functions. Our model provides ajoint distribution p(f, z) over functions f and latent variables z which letsus efficiently sample from the marginal p(f) and maximize a variational lowerbound on the entropy H(f). We can thus maximize objectives of the formE_{f~p(f)}[R(f)] + c*H(f), where R(f) denotes, e.g., a data log-likelihood termor an expected reward. Such objectives encompass Bayesian deep learning infunction space, rather than parameter space, and Bayesian deep RL withrepresentations of uncertainty that offer benefits over bootstrapping andparameter noise. In this short paper we describe our model, situate it in thecontext of prior work, and present proof-of-concept experiments for regressionand RL.