Abstract
Pancreatic cancer carries a poor prognosis and relies on endoscopicultrasound (EUS) for targeted biopsy and radiotherapy. However, the specklenoise, low contrast, and unintuitive appearance of EUS make segmentation ofpancreatic tumors with fully supervised deep learning (DL) models botherror-prone and dependent on large, expert-curated annotation datasets. Toaddress these challenges, we present TextSAM-EUS, a novel, lightweight,text-driven adaptation of the Segment Anything Model (SAM) that requires nomanual geometric prompts at inference. Our approach leverages text promptlearning (context optimization) through the BiomedCLIP text encoder inconjunction with a LoRA-based adaptation of SAM's architecture to enableautomatic pancreatic tumor segmentation in EUS, tuning only 0.86% of the totalparameters. On the public Endoscopic Ultrasound Database of the Pancreas,TextSAM-EUS with automatic prompts attains 82.69% Dice and 85.28% normalizedsurface distance (NSD), and with manual geometric prompts reaches 83.10% Diceand 85.70% NSD, outperforming both existing state-of-the-art (SOTA) supervisedDL models and foundation models (e.g., SAM and its variants). As the firstattempt to incorporate prompt learning in SAM-based medical image segmentation,TextSAM-EUS offers a practical option for efficient and robust automatic EUSsegmentation. Code is available at https://github.com/HealthX-Lab/TextSAM-EUS .