Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models

  • 2025-01-09 17:11:22
  • Kristian G. Barman, Sascha Caron, Emily Sullivan, Henk W. de Regt, Roberto Ruiz de Austri, Mieke Boon, Michael Färber, Stefan Fröse, Faegheh Hasibi, Andreas Ipp, Rukshak Kapoor, Gregor Kasieczka, Daniel Kostić, Michael Krämer, Tobias Golling, Luis G. Lopez, Jesus Marco, Sydney Otten, Pawel Pawlowski, Pietro Vischia, Erik Weber, Christoph Weniger
  • 0

Abstract

This paper explores ideas and provides a potential roadmap for thedevelopment and evaluation of physics-specific large-scale AI models, which wecall Large Physics Models (LPMs). These models, based on foundation models suchas Large Language Models (LLMs) - trained on broad data - are tailored toaddress the demands of physics research. LPMs can function independently or aspart of an integrated framework. This framework can incorporate specializedtools, including symbolic reasoning modules for mathematical manipulations,frameworks to analyse specific experimental and simulated data, and mechanismsfor synthesizing theories and scientific literature. We begin by examiningwhether the physics community should actively develop and refine dedicatedmodels, rather than relying solely on commercial LLMs. We then outline how LPMscan be realized through interdisciplinary collaboration among experts inphysics, computer science, and philosophy of science. To integrate these modelseffectively, we identify three key pillars: Development, Evaluation, andPhilosophical Reflection. Development focuses on constructing models capable ofprocessing physics texts, mathematical formulations, and diverse physical data.Evaluation assesses accuracy and reliability by testing and benchmarking.Finally, Philosophical Reflection encompasses the analysis of broaderimplications of LLMs in physics, including their potential to generate newscientific understanding and what novel collaboration dynamics might arise inresearch. Inspired by the organizational structure of experimentalcollaborations in particle physics, we propose a similarly interdisciplinaryand collaborative approach to building and refining Large Physics Models. Thisroadmap provides specific objectives, defines pathways to achieve them, andidentifies challenges that must be addressed to realise physics-specific largescale AI models.

 

Quick Read (beta)

loading the full paper ...