Abstract
The impressive performance of ChatGPT and other foundation-model-basedproducts in human language understanding has prompted both academia andindustry to explore how these models can be tailored for specific industriesand application scenarios. This process, known as the customization ofdomain-specific foundation models (FMs), addresses the limitations ofgeneral-purpose models, which may not fully capture the unique patterns andrequirements of domain-specific data. Despite its importance, there is anotable lack of comprehensive overview papers on building domain-specific FMs,while numerous resources exist for general-purpose models. To bridge this gap,this article provides a timely and thorough overview of the methodology forcustomizing domain-specific FMs. It introduces basic concepts, outlines thegeneral architecture, and surveys key methods for constructing domain-specificmodels. Furthermore, the article discusses various domains that can benefitfrom these specialized models and highlights the challenges ahead. Through thisoverview, we aim to offer valuable guidance and reference for researchers andpractitioners from diverse fields to develop their own customized FMs.