Abstract
Memory decay makes it harder for the human brain to recognize visual objectsand retain details. Consequently, recorded brain signals become weaker,uncertain, and contain poor visual context over time. This paper presents oneof the first vision-learning approaches to address this problem. First, westatistically and experimentally demonstrate the existence of inconsistency inbrain signals and its impact on the Vision-Brain Understanding (VBU) model. Ourfindings show that brain signal representations shift over recording sessions,leading to compounding bias, which poses challenges for model learning anddegrades performance. Then, we propose a new Bias-Mitigation Continual Learning(BRAIN) approach to address these limitations. In this approach, the model istrained in a continual learning setup and mitigates the growing bias from eachlearning step. A new loss function named De-bias Contrastive Learning is alsointroduced to address the bias problem. In addition, to prevent catastrophicforgetting, where the model loses knowledge from previous sessions, the newAngular-based Forgetting Mitigation approach is introduced to preserve learnedknowledge in the model. Finally, the empirical experiments demonstrate that ourapproach achieves State-of-the-Art (SOTA) performance across variousbenchmarks, surpassing prior and non-continual learning methods.