Abstract
Medical image classification is a very fundamental and crucial task in thefield of computer vision. These years, CNN-based and Transformer-based modelsare widely used in classifying various medical images. Unfortunately, Thelimitation of CNNs in long-range modeling capabilities prevent them fromeffectively extracting fine-grained features in medical images , whileTransformers are hampered by their quadratic computational complexity. Recentresearch has shown that the state space model (SSM) represented by Mamba canefficiently model long-range interactions while maintaining linearcomputational complexity. Inspired by this, we propose Vision Mamba for medicalimage classification (MedMamba). More specifically, we introduce a novelConv-SSM module, which combines the local feature extraction ability ofconvolutional layers with the ability of SSM to capture long-range dependency.To demonstrate the potential of MedMamba, we conduct extensive experimentsusing three publicly available medical datasets with different imagingtechniques (i.e., Kvasir (endoscopic images), FETAL_PLANES_DB (ultrasoundimages) and Covid19-Pneumonia-Normal Chest X-Ray (X-ray images)) and twoprivate datasets built by ourselves. Experimental results show that theproposed MedMamba performs well in detecting lesions in various medical images.To the best of our knowledge, this is the first Vision Mamba tailored formedical image classification. The purpose of this work is to establish a newbaseline for medical image classification tasks and provide valuable insightsfor the future development of more efficient and effective SSM-based artificialintelligence algorithms and application systems in the medical. Source code hasbeen available at https://github.com/YubiaoYue/MedMamba.