Abstract
How do people understand and evaluate claims about others' beliefs, eventhough these beliefs cannot be directly observed? In this paper, we introduce acognitive model of epistemic language interpretation, grounded in Bayesianinferences about other agents' goals, beliefs, and intentions: alanguage-augmented Bayesian theory-of-mind (LaBToM). By translating naturallanguage into an epistemic ``language-of-thought'' with grammar-constrained LLMdecoding, then evaluating these translations against the inferences produced byinverting a generative model of rational action and perception, LaBToM capturesgraded plausibility judgments of epistemic claims. We validate our model in anexperiment where participants watch an agent navigate a maze to find keyshidden in boxes needed to reach their goal, then rate sentences about theagent's beliefs. In contrast with multimodal LLMs (GPT-4o, Gemini Pro) andablated models, our model correlates highly with human judgments for a widerange of expressions, including modal language, uncertainty expressions,knowledge claims, likelihood comparisons, and attributions of false belief.