Abstract
Large Language Models (LLMs) have demonstrated impressive real-world utility,exemplifying artificial useful intelligence (AUI). However, their ability toreason adaptively and robustly -- the hallmarks of artificial generalintelligence (AGI) -- remains fragile. While LLMs seemingly succeed incommonsense reasoning, programming, and mathematics, they struggle togeneralize algorithmic understanding across novel contexts. Our experimentswith algorithmic tasks in esoteric programming languages reveal that LLM'sreasoning overfits to the training data and is limited in its transferability.We hypothesize that the core issue underlying such limited transferability isthe coupling of reasoning and knowledge in LLMs. To transition from AUI to AGI, we propose disentangling knowledge andreasoning through three key directions: (1) pretaining to reason using RL fromscratch as an alternative to the widely used next-token prediction pretraining,(2) using a curriculum of synthetic tasks to ease the learning of a\textit{reasoning prior} for RL that can then be transferred to naturallanguage tasks, and (3) learning more generalizable reasoning functions using asmall context window to reduce exploiting spurious correlations between tokens.Such a reasoning system coupled with a trained retrieval system and a largeexternal memory bank as a knowledge store can overcome several limitations ofexisting architectures at learning to reason in novel scenarios.