Abstract
In this era of large language models (LLMs), the traditional training ofmodels has become increasingly unimaginable for regular users and institutions.The exploration of efficient fine-tuning for high-resource languages on thesemodels is an undeniable trend that is gradually gaining popularity. However,there has been very little exploration for various low-resource languages, suchas Tibetan. Research in Tibetan NLP is inherently scarce and limited. Whilethere is currently no existing large language model for Tibetan due to itslow-resource nature, that day will undoubtedly arrive. Therefore, research onefficient fine-tuning for low-resource language models like Tibetan is highlynecessary. Our research can serve as a reference to fill this crucial gap.Efficient fine-tuning strategies for pre-trained language models (PLMs) inTibetan have seen minimal exploration. We conducted three types of efficientfine-tuning experiments on the publicly available TNCC-title dataset:"prompt-tuning," "Adapter lightweight fine-tuning," and "prompt-tuning +Adapter fine-tuning." The experimental results demonstrate significantimprovements using these methods, providing valuable insights for advancingTibetan language applications in the context of pre-trained models.