Abstract

During multimodal model training and reasoning, data samples may miss certainmodalities and lead to compromised model performance due to sensor limitations,cost constraints, privacy concerns, data loss, and temporal and spatialfactors. This survey provides an overview of recent progress in MultimodalLearning with Missing Modality (MLMM), focusing on deep learning techniques. Itis the first comprehensive survey that covers the historical background and thedistinction between MLMM and standard multimodal learning setups, followed by adetailed analysis of current MLMM methods, applications, and datasets,concluding with a discussion about challenges and potential future directionsin the field.

 

Quick Read (beta)