Abstract
As Large Language Models (LLMs) continue to advance, they exhibit certaincognitive patterns similar to those of humans that are not directly specifiedin training data. This study investigates this phenomenon by focusing ontemporal cognition in LLMs. Leveraging the similarity judgment task, we findthat larger models spontaneously establish a subjective temporal referencepoint and adhere to the Weber-Fechner law, whereby the perceived distancelogarithmically compresses as years recede from this reference point. Touncover the mechanisms behind this behavior, we conducted multiple analysesacross neuronal, representational, and informational levels. We first identifya set of temporal-preferential neurons and find that this group exhibitsminimal activation at the subjective reference point and implements alogarithmic coding scheme convergently found in biological systems. Probingrepresentations of years reveals a hierarchical construction process, whereyears evolve from basic numerical values in shallow layers to abstract temporalorientation in deep layers. Finally, using pre-trained embedding models, wefound that the training corpus itself possesses an inherent, non-lineartemporal structure, which provides the raw material for the model's internalconstruction. In discussion, we propose an experientialist perspective forunderstanding these findings, where the LLMs' cognition is viewed as asubjective construction of the external world by its internal representationalsystem. This nuanced perspective implies the potential emergence of aliencognitive frameworks that humans cannot intuitively predict, pointing toward adirection for AI alignment that focuses on guiding internal constructions. Ourcode is available at https://TheOtherMind.github.io.