Intuition emerges in Maximum Caliber models at criticality

  • 2025-08-08 17:27:41
  • Lluís Arola-Fernández
  • 0

Abstract

Whether large predictive models merely parrot their training data or producegenuine insight lacks a physical explanation. This work reports a primitiveform of intuition that emerges as a metastable phase of learning thatcritically balances next-token prediction against future path-entropy. Theintuition mechanism is discovered via mind-tuning, the minimal principle thatimposes Maximum Caliber in predictive models with a control temperature-likeparameter $\lambda$. Training on random walks in deterministic mazes reveals arich phase diagram: imitation (low $\lambda$), rule-breaking hallucination(high $\lambda$), and a fragile in-between window exhibiting strongprotocol-dependence (hysteresis) and multistability, where models spontaneouslydiscover novel goal-directed strategies. These results are captured by aneffective low-dimensional theory and frame intuition as an emergent property atthe critical balance between memorizing what is and wondering what could be.

 

Quick Read (beta)

loading the full paper ...