Learning Efficient Recursive Numeral Systems via Reinforcement Learning

  • 2025-03-03 07:02:20
  • Andrea Silvi, Jonathan Thomas, Emil Carlsson, Devdatt Dubhashi, Moa Johansson
  • 0

Abstract

It has previously been shown that by using reinforcement learning (RL),agents can derive simple approximate and exact-restricted numeral systems thatare similar to human ones (Carlsson, 2021). However, it is a major challenge toshow how more complex recursive numeral systems, similar to for exampleEnglish, could arise via a simple learning mechanism such as RL. Here, weintroduce an approach towards deriving a mechanistic explanation of theemergence of efficient recursive number systems. We consider pairs of agentslearning how to communicate about numerical quantities through a meta-grammarthat can be gradually modified throughout the interactions. %We find that theseminal meta-grammar of Hurford (Hurford, 1975) is not suitable for thisapplication as its optimization results in systems that deviate from standardconventions observed within human numeral systems. We propose a simplemodification which addresses this issue. Utilising a slightly modified versionof the meta-grammar of Hurford, we demonstrate that our RL agents, shaped bythe pressures for efficient communication, can effectively modify their lexicontowards Pareto-optimal configurations which are comparable to those observedwithin human numeral systems in terms of their efficiency.

 

Quick Read (beta)

loading the full paper ...