Abstract
Cognitive decline often surfaces in language years before diagnosis. It isfrequently non-experts, such as those closest to the patient, who first sense achange and raise concern. As LLMs become integrated into daily communicationand used over prolonged periods, it may even be an LLM that notices somethingis off. But what exactly do they notice--and should be noticing--when makingthat judgment? This paper investigates how dementia is perceived throughlanguage by non-experts. We presented transcribed picture descriptions tonon-expert humans and LLMs, asking them to intuitively judge whether each textwas produced by someone healthy or with dementia. We introduce an explainablemethod that uses LLMs to extract high-level, expert-guided featuresrepresenting these picture descriptions, and use logistic regression to modelhuman and LLM perceptions and compare with clinical diagnoses. Our analysisreveals that human perception of dementia is inconsistent and relies on anarrow, and sometimes misleading, set of cues. LLMs, by contrast, draw on aricher, more nuanced feature set that aligns more closely with clinicalpatterns. Still, both groups show a tendency toward false negatives, frequentlyoverlooking dementia cases. Through our interpretable framework and theinsights it provides, we hope to help non-experts better recognize thelinguistic signs that matter.