Multi-stream deep learning framework to predict mild cognitive impairment with Rey Complex Figure Test

  • 2024-09-04 18:08:04
  • Junyoung Park, Eun Hyun Seo, Sunjun Kim, SangHak Yi, Kun Ho Lee, Sungho Won
  • 0

Abstract

Drawing tests like the Rey Complex Figure Test (RCFT) are widely used toassess cognitive functions such as visuospatial skills and memory, making themvaluable tools for detecting mild cognitive impairment (MCI). Despite theirutility, existing predictive models based on these tests often suffer fromlimitations like small sample sizes and lack of external validation, whichundermine their reliability. We developed a multi-stream deep learningframework that integrates two distinct processing streams: a multi-headself-attention based spatial stream using raw RCFT images and a scoring streamemploying a previously developed automated scoring system. Our model wastrained on data from 1,740 subjects in the Korean cohort and validated on anexternal hospital dataset of 222 subjects from Korea. The proposed multi-streammodel demonstrated superior performance over baseline models (AUC = 0.872,Accuracy = 0.781) in external validation. The integration of both spatial andscoring streams enables the model to capture intricate visual details from theraw images while also incorporating structured scoring data, which togetherenhance its ability to detect subtle cognitive impairments. This dual approachnot only improves predictive accuracy but also increases the robustness of themodel, making it more reliable in diverse clinical settings. Our model haspractical implications for clinical settings, where it could serve as acost-effective tool for early MCI screening.

 

Quick Read (beta)

loading the full paper ...