Abstract
We propose a theoretical model called "information gravity" to describe thetext generation process in large language models (LLMs). The model usesphysical apparatus from field theory and spacetime geometry to formalize theinteraction between user queries and the probability distribution of generatedtokens. A query is viewed as an object with "information mass" that curves thesemantic space of the model, creating gravitational potential wells that"attract" tokens during generation. This model offers a mechanism to explainseveral observed phenomena in LLM behavior, including hallucinations (emergingfrom low-density semantic voids), sensitivity to query formulation (due tosemantic field curvature changes), and the influence of sampling temperature onoutput diversity.