Abstract
Federated Learning (FL) faces major challenges regarding communicationoverhead and model privacy when training large language models (LLMs),especially in healthcare applications. To address these, we introduce SelectiveAttention Federated Learning (SAFL), a novel approach that dynamicallyfine-tunes only those transformer layers identified as attention-critical. Byemploying attention patterns to determine layer importance, SAFL significantlyreduces communication bandwidth and enhances differential privacy resilience.Evaluations on clinical NLP benchmarks (i2b2 Clinical Concept Extraction andMIMIC-III discharge summaries) demonstrate that SAFL achieves competitiveperformance with centralized models while substantially improving communicationefficiency and privacy preservation.