Abstract
We propose a novel framework for solving nonlinear PDEs using sparse radialbasis function (RBF) networks. Sparsity-promoting regularization is employed toprevent over-parameterization and reduce redundant features. This work ismotivated by longstanding challenges in traditional RBF collocation methods,along with the limitations of physics-informed neural networks (PINNs) andGaussian process (GP) approaches, aiming to blend their respective strengths ina unified framework. The theoretical foundation of our approach lies in thefunction space of Reproducing Kernel Banach Spaces (RKBS) induced byone-hidden-layer neural networks of possibly infinite width. We prove arepresenter theorem showing that the solution to the sparse optimizationproblem in the RKBS admits a finite solution and establishes error bounds thatoffer a foundation for generalizing classical numerical analysis. Thealgorithmic framework is based on a three-phase algorithm to maintaincomputational efficiency through adaptive feature selection, second-orderoptimization, and pruning of inactive neurons. Numerical experimentsdemonstrate the effectiveness of our method and highlight cases where it offersnotable advantages over GP approaches. This work opens new directions foradaptive PDE solvers grounded in rigorous analysis with efficient,learning-inspired implementation.