Emergent communication and learning pressures in language models: a language evolution perspective

  • 2024-03-21 15:33:34
  • Lukas Galke, Limor Raviv
  • 0

Abstract

Language models and humans are two types of learning systems. Finding orfacilitating commonalities could enable major breakthroughs in ourunderstanding of the acquisition and evolution of language. Many theories oflanguage evolution rely heavily on learning biases and learning pressures. Yetdue to substantial differences in learning pressures, it is questionablewhether the similarity between humans and machines is sufficient for insightsto carry over and to be worth testing with human participants. Here, we reviewthe emergent communication literature, a subfield of multi-agent reinforcementlearning, from a language evolution perspective. We find that the emergentcommunication literature excels at designing and adapting models to recoverinitially absent linguistic phenomena of natural languages. Based on a shortliterature review, we identify key pressures that have recovered initiallyabsent human patterns in emergent communication models: communicative success,efficiency, learnability, and other psycho-/sociolinguistic factors. We arguethat this may serve as inspiration for how to design language models forlanguage acquisition and language evolution research.

 

Quick Read (beta)

loading the full paper ...