Abstract
Physical AI systems need to perceive, understand, and perform complex actionsin the physical world. In this paper, we present the Cosmos-Reason1 models thatcan understand the physical world and generate appropriate embodied decisions(e.g., next step action) in natural language through long chain-of-thoughtreasoning processes. We begin by defining key capabilities for Physical AIreasoning, with a focus on physical common sense and embodied reasoning. Torepresent physical common sense, we use a hierarchical ontology that capturesfundamental knowledge about space, time, and physics. For embodied reasoning,we rely on a two-dimensional ontology that generalizes across differentphysical embodiments. Building on these capabilities, we develop two multimodallarge language models, Cosmos-Reason1-7B and Cosmos-Reason1-56B. We curate dataand train our models in two stages: Physical AI supervised fine-tuning (SFT)and Physical AI reinforcement learning (RL). To evaluate our models, we buildcomprehensive benchmarks for physical common sense and embodied reasoningaccording to our ontologies. Evaluation results show that Physical AI SFT andRL bring significant improvements. To facilitate the development of PhysicalAI, we make our code and pre-trained models available under the NVIDIA OpenModel License at https://github.com/nvidia-cosmos/cosmos-reason1.