Abstract
Major depressive disorder (MDD), a leading cause of disability and mortality,is associated with reward-processing abnormalities and concentration issues.Motivated by the probabilistic reward task from the Establishing Moderators andBiosignatures of Antidepressant Response in Clinical Care (EMBARC) study, wepropose a novel framework that integrates the reinforcement learning (RL) modeland drift-diffusion model (DDM) to jointly analyze reward-based decision-makingwith response times. To account for emerging evidence suggesting thatdecision-making may alternate between multiple interleaved strategies, we modellatent state switching using a hidden Markov model (HMM). In the ''engaged''state, decisions follow an RL-DDM, simultaneously capturing reward processing,decision dynamics, and temporal structure. In contrast, in the ''lapsed''state, decision-making is modeled using a simplified DDM, where specificparameters are fixed to approximate random guessing with equal probability. Theproposed method is implemented using a computationally efficient generalizedexpectation-maximization (EM) algorithm with forward-backward procedures.Through extensive numerical studies, we demonstrate that our proposed methodoutperforms competing approaches across various reward-generatingdistributions, under both strategy-switching and non-switching scenarios, aswell as in the presence of input perturbations. When applied to the EMBARCstudy, our framework reveals that MDD patients exhibit lower overall engagementthan healthy controls and experience longer decision times when they do engage.Additionally, we show that neuroimaging measures of brain activities areassociated with decision-making characteristics in the ''engaged'' state butnot in the ''lapsed'' state, providing evidence of brain-behavior associationspecific to the ''engaged'' state.