Abstract
We argue that progress toward general intelligence requires complementaryfoundation models grounded in language, the physical world, and structureddata. This report presents LimiX-16M and LimiX-2M, two instantiations of ourlarge structured-data models (LDMs). Both models treat structured data as ajoint distribution over variables and missingness, thus capable of addressing awide range of tabular tasks through query-based conditional prediction via asingle model. They are pretrained using masked joint-distribution modeling withan episodic, context-conditional objective, supporting rapid, training-freeadaptation at inference. We evaluate LimiX models across 11 largestructured-data benchmarks with broad regimes of sample size, featuredimensionality, class number, categorical-to-numerical feature ratio,missingness, and sample-to-feature ratios. LimiX-16M consistently surpassesstrong baselines, as shown in Figure 1 and Figure 2. The superiority holdsacross a wide range of tasks, such as classification, regression, missing valueimputation, and data generation, often by substantial margins, while avoidingtask-specific architectures or bespoke training per task. Notably, LimiX-2Mdelivers strong results under tight compute and memory budgets. We also presentthe first scaling law study for LDMs, revealing how data and model scalingjointly influence downstream performance and offering quantitative guidance fortabular foundation modeling. All LimiX models are publicly accessible underApache 2.0.