Shaping Shared Languages: Human and Large Language Models' Inductive Biases in Emergent Communication

  • 2025-03-06 12:47:54
  • Tom Kouwenhoven, Max Peeperkorn, Roy de Kleijn, Tessa Verhoef
  • 0

Abstract

Languages are shaped by the inductive biases of their users. Using aclassical referential game, we investigate how artificial languages evolve whenoptimised for inductive biases in humans and large language models (LLMs) viaHuman-Human, LLM-LLM and Human-LLM experiments. We show that referentiallygrounded vocabularies emerge that enable reliable communication in allconditions, even when humans and LLMs collaborate. Comparisons betweenconditions reveal that languages optimised for LLMs subtly differ from thoseoptimised for humans. Interestingly, interactions between humans and LLMsalleviate these differences and result in vocabularies which are morehuman-like than LLM-like. These findings advance our understanding of howinductive biases in LLMs play a role in the dynamic nature of human languageand contribute to maintaining alignment in human and machine communication. Inparticular, our work underscores the need to think of new methods that includehuman interaction in the training processes of LLMs, and shows that usingcommunicative success as a reward signal can be a fruitful, novel direction.

 

Quick Read (beta)

loading the full paper ...