Abstract
Unstructured clinical data can serve as a unique and rich source ofinformation that can meaningfully inform clinical practice. Extracting the mostpertinent context from such data is critical for exploiting its true potentialtoward optimal and timely decision-making in patient care. While prior researchhas explored various methods for clinical text summarization, most priorstudies either process all input tokens uniformly or rely on heuristic-basedfilters, which can overlook nuanced clinical cues and fail to prioritizeinformation critical for decision-making. In this study, we propose Contextual,a novel framework that integrates a Context-Preserving Token Filtering methodwith a Domain-Specific Knowledge Graph (KG) for contextual augmentation. Bypreserving context-specific important tokens and enriching them with structuredknowledge, ConTextual improves both linguistic coherence and clinical fidelity.Our extensive empirical evaluations on two public benchmark datasetsdemonstrate that ConTextual consistently outperforms other baselines. Ourproposed approach highlights the complementary role of token-level filteringand structured retrieval in enhancing both linguistic and clinical integrity,as well as offering a scalable solution for improving precision in clinicaltext generation.