Shaping Shared Languages: Human and Large Language Models' Inductive Biases in Emergent Communication

  • 2025-05-28 07:42:23
  • Tom Kouwenhoven, Max Peeperkorn, Roy de Kleijn, Tessa Verhoef
  • 0

Abstract

Languages are shaped by the inductive biases of their users. Using aclassical referential game, we investigate how artificial languages evolve whenoptimised for inductive biases in humans and large language models (LLMs) viaHuman-Human, LLM-LLM and Human-LLM experiments. We show that referentiallygrounded vocabularies emerge that enable reliable communication in allconditions, even when humans \textit{and} LLMs collaborate. Comparisons betweenconditions reveal that languages optimised for LLMs subtly differ from thoseoptimised for humans. Interestingly, interactions between humans and LLMsalleviate these differences and result in vocabularies more human-like thanLLM-like. These findings advance our understanding of the role inductive biasesin LLMs play in the dynamic nature of human language and contribute tomaintaining alignment in human and machine communication. In particular, ourwork underscores the need to think of new LLM training methods that includehuman interaction and shows that using communicative success as a reward signalcan be a fruitful, novel direction.

 

Quick Read (beta)

loading the full paper ...