Adaptive behavior often requires predicting future events. The theory ofreinforcement learning prescribes what kinds of predictive representations areuseful and how to compute them. This paper integrates these theoretical ideaswith work on cognition and neuroscience. We pay special attention to thesuccessor representation (SR) and its generalizations, which have been widelyapplied both as engineering tools and models of brain function. Thisconvergence suggests that particular kinds of predictive representations mayfunction as versatile building blocks of intelligence.