Abstract
Collaborative dialogue relies on participants incrementally establishingcommon ground, yet in asymmetric settings they may believe they agree whilereferring to different entities. We introduce a perspectivist annotation schemefor the HCRC MapTask corpus (Anderson et al., 1991) that separately capturesspeaker and addressee grounded interpretations for each reference expression,enabling us to trace how understanding emerges, diverges, and repairs overtime. Using a scheme-constrained LLM annotation pipeline, we obtain 13kannotated reference expressions with reliability estimates and analyze theresulting understanding states. The results show that full misunderstandingsare rare once lexical variants are unified, but multiplicity discrepanciessystematically induce divergences, revealing how apparent grounding can maskreferential misalignment. Our framework provides both a resource and ananalytic lens for studying grounded misunderstanding and for evaluating(V)LLMs' capacity to model perspective-dependent grounding in collaborativedialogue.