Abstract
Reasoning, a crucial ability for complex problem-solving, plays a pivotalrole in various real-world settings such as negotiation, medical diagnosis, andcriminal investigation. It serves as a fundamental methodology in the field ofArtificial General Intelligence (AGI). With the ongoing development offoundation models, there is a growing interest in exploring their abilities inreasoning tasks. In this paper, we introduce seminal foundation models proposedor adaptable for reasoning, highlighting the latest advancements in variousreasoning tasks, methods, and benchmarks. We then delve into the potentialfuture directions behind the emergence of reasoning abilities within foundationmodels. We also discuss the relevance of multimodal learning, autonomousagents, and super alignment in the context of reasoning. By discussing thesefuture research directions, we hope to inspire researchers in their explorationof this field, stimulate further advancements in reasoning with foundationmodels, and contribute to the development of AGI.