Abstract
We argue that representations in AI models, particularly deep networks, areconverging. First, we survey many examples of convergence in the literature:over time and across multiple domains, the ways by which different neuralnetworks represent data are becoming more aligned. Next, we demonstrateconvergence across data modalities: as vision models and language models getlarger, they measure distance between datapoints in a more and more alike way.We hypothesize that this convergence is driving toward a shared statisticalmodel of reality, akin to Plato's concept of an ideal reality. We term such arepresentation the platonic representation and discuss several possibleselective pressures toward it. Finally, we discuss the implications of thesetrends, their limitations, and counterexamples to our analysis.