Abstract
The application of machine learning on tabular data in specialized domains isseverely limited by data scarcity. While generative models offer a solution,traditional methods falter in low-data regimes, and recent Large LanguageModels (LLMs) often ignore the explicit dependency structure of tabular data,leading to low-fidelity synthetics. To address these limitations, we introduceStructSynth, a novel framework that integrates the generative power of LLMswith robust structural control. StructSynth employs a two-stage architecture.First, it performs explicit structure discovery to learn a Directed AcyclicGraph (DAG) from the available data. Second, this learned structure serves as ahigh-fidelity blueprint to steer the LLM's generation process, forcing it toadhere to the learned feature dependencies and thereby ensuring the generateddata respects the underlying structure by design. Our extensive experimentsdemonstrate that StructSynth produces synthetic data with significantly higherstructural integrity and downstream utility than state-of-the-art methods. Itproves especially effective in challenging low-data scenarios, successfullynavigating the trade-off between privacy preservation and statistical fidelity.