Abstract
Inductive bias is a key factor in spatial regression models, determining howwell a model can learn from limited data and capture spatial patterns. Thiswork revisits the inductive biases in Geographically Neural Network WeightedRegression (GNNWR) and identifies limitations in current approaches formodeling spatial non-stationarity. While GNNWR extends traditionalGeographically Weighted Regression by using neural networks to learn spatialweighting functions, existing implementations are often restricted by fixeddistance-based schemes and limited inductive bias. We propose to generalizeGNNWR by incorporating concepts from convolutional neural networks, recurrentneural networks, and transformers, introducing local receptive fields,sequential context, and self-attention into spatial regression. Throughextensive benchmarking on synthetic spatial datasets with varyingheterogeneity, noise, and sample sizes, we show that GNNWR outperforms classicmethods in capturing nonlinear and complex spatial relationships. Our resultsalso reveal that model performance depends strongly on data characteristics,with local models excelling in highly heterogeneous or small-sample scenarios,and global models performing better with larger, more homogeneous data. Thesefindings highlight the importance of inductive bias in spatial modeling andsuggest future directions, including learnable spatial weighting functions,hybrid neural architectures, and improved interpretability for models handlingnon-stationary spatial data.