Synchronization of mean-field models on the circle

  • 2025-07-30 17:31:57
  • Yury Polyanskiy, Philippe Rigollet, Andrew Yao
  • 0

Abstract

This paper considers a mean-field model of $n$ interacting particles whosestate space is the unit circle, a generalization of the classical Kuramotomodel. Global synchronization is said to occur if after starting from almostany initial state, all particles coalesce to a common point on the circle. Wepropose a general synchronization criterion in terms of $L_1$-norm of the thirdderivative of the particle interaction function. As an application we resolve aconjecture for the so-called self-attention dynamics (stylized model oftransformers), by showing synchronization for all $\beta \ge -0.16$, whichsignificantly extends the previous bound of $0\le \beta \le 1$ fromCriscitiello, Rebjock, McRae, and Boumal (2024). We also show that globalsynchronization does not occur when $\beta < -2/3$.

 

Quick Read (beta)

loading the full paper ...