Abstract
Biological learning unfolds continuously in time, yet most algorithmic modelsrely on discrete updates and separate inference and learning phases. We study acontinuous-time neural model that unifies several biologically plausiblelearning algorithms and removes the need for phase separation. Rules includingstochastic gradient descent (SGD), feedback alignment (FA), direct feedbackalignment (DFA), and Kolen-Pollack (KP) emerge naturally as limiting cases ofthe dynamics. Simulations show that these continuous-time networks stably learnat biological timescales, even under temporal mismatches and integration noise.Through analysis and simulation, we show that learning depends on temporaloverlap: a synapse updates correctly only when its input and the correspondingerror signal coincide in time. When inputs are held constant, learning strengthdeclines linearly as the delay between input and error approaches the stimulusduration, explaining observed robustness and failure across network depths.Critically, robust learning requires the synaptic plasticity timescale toexceed the stimulus duration by one to two orders of magnitude. For typicalcortical stimuli (tens of milliseconds), this places the functional plasticitywindow in the few-second range, a testable prediction that identifiesseconds-scale eligibility traces as necessary for error-driven learning inbiological circuits.