Abstract
General-purpose large language models demonstrate notable capabilities inlanguage comprehension and generation, achieving results that are comparableto, or even surpass, human performance in many natural language processingtasks. Nevertheless, when general models are applied to some specific domains,e.g., Classical Chinese texts, their effectiveness is often unsatisfactory, andfine-tuning open-source foundational models similarly struggles to adequatelyincorporate domain-specific knowledge. To address this challenge, this studydeveloped a large language model, AI Taiyan, specifically designed forunderstanding and generating Classical Chinese. Experiments show that with areasonable model design, data processing, foundational training, andfine-tuning, satisfactory results can be achieved with only 1.8 billionparameters. In key tasks related to language processing of Classical Chinesesuch as punctuation, identification of allusions, explanation of word meanings,and translation between ancient and modern Chinese, this model exhibits a clearadvantage over both general-purpose large models and domain-specifictraditional models, achieving levels close to or surpassing human baselines.This research provides a reference for the efficient construction ofspecialized domain-specific large language models. Furthermore, the paperdiscusses the application of this model in fields such as the collation ofancient texts, dictionary editing, and language research, combined with casestudies.