Abstract
Vision-language models, while effective in general domains and showing strongperformance in diverse multi-modal applications like visual question-answering(VQA), struggle to maintain the same level of effectiveness in more specializeddomains, e.g., medical. We propose a medical vision-language model thatintegrates large vision and language models adapted for the medical domain.This model goes through three stages of parameter-efficient training usingthree separate biomedical and radiology multi-modal visual and text datasets.The proposed model achieves state-of-the-art performance on the SLAKE 1.0medical VQA (MedVQA) dataset with an overall accuracy of 87.5% and demonstratesstrong performance on another MedVQA dataset, VQA-RAD, achieving an overallaccuracy of 73.2%.