Meaning without reference in large language models

  • 2022-08-05 03:48:26
  • Steven T. Piantasodi, Felix Hill
  • 67

Abstract

The widespread success of large language models (LLMs) has been met withskepticism that they possess anything like human concepts or meanings. Contraryto claims that LLMs possess no meaning whatsoever, we argue that they likelycapture important aspects of meaning, and moreover work in a way thatapproximates a compelling account of human cognition in which meaning arisesfrom conceptual role. Because conceptual role is defined by the relationshipsbetween internal representational states, meaning cannot be determined from amodel's architecture, training data, or objective function, but only byexamination of how its internal states relate to each other. This approach mayclarify why and how LLMs are so successful and suggest how they can be mademore human-like.

 

Quick Read (beta)

loading the full paper ...