Abstract
Adapting LLMs to specific stylistic characteristics, like brand voice orauthorial tones, is crucial for enterprise communication but challenging toachieve from corpora which lacks instruction-response formatting withoutcompromising instruction adherence. We introduce StyleAdaptedLM, a frameworkthat efficiently transfers stylistic traits to instruction-following modelsusing Low-Rank Adaptation (LoRA). LoRA adapters are first trained on a basemodel with diverse unstructured stylistic corpora, then merged with a separateinstruction-following model. This enables robust stylistic customizationwithout paired data or sacrificing task performance. Experiments acrossmultiple datasets and models demonstrate improved stylistic consistency whilepreserving instruction adherence, with human evaluations confirmingbrand-specific convention uptake. StyleAdaptedLM offers an efficient path forstylistic personalization in LLMs.