Abstract
Bayesian reinforcement learning (BRL) offers a decision-theoretic solutionfor reinforcement learning. While "model-based" BRL algorithms have focusedeither on maintaining a posterior distribution on models or value functions andcombining this with approximate dynamic programming or tree search, previousBayesian "model-free" value function distribution approaches implicitly makestrong assumptions or approximations. We describe a novel Bayesian framework,Inferential Induction, for correctly inferring value function distributionsfrom data, which leads to the development of a new class of BRL algorithms. Wedesign an algorithm, Bayesian Backwards Induction, with this framework. Weexperimentally demonstrate that the proposed algorithm is competitive withrespect to the state of the art.