Abstract
Active inference is a unifying theory for perception and action resting uponthe idea that the brain maintains an internal model of the world by minimizingfree energy. From a behavioral perspective, active inference agents can be seenas self-evidencing beings that act to fulfill their optimistic predictions,namely preferred outcomes or goals. In contrast, reinforcement learningrequires human-designed rewards to accomplish any desired outcome. Althoughactive inference could provide a more natural self-supervised objective forcontrol, its applicability has been limited because of the shortcomings inscaling the approach to complex environments. In this work, we propose acontrastive objective for active inference that strongly reduces thecomputational burden in learning the agent's generative model and planningfuture actions. Our method performs notably better than likelihood-based activeinference in image-based tasks, while also being computationally cheaper andeasier to train. We compare to reinforcement learning agents that have accessto human-designed reward functions, showing that our approach closely matchestheir performance. Finally, we also show that contrastive methods performsignificantly better in the case of distractors in the environment and that ourmethod is able to generalize goals to variations in the background.