Abstract
This paper demonstrates how reinforcement learning can explain two puzzlingempirical patterns in household consumption behavior during economic downturns.I develop a model where agents use Q-learning with neural network approximationto make consumption-savings decisions under income uncertainty, departing fromstandard rational expectations assumptions. The model replicates two keyfindings from recent literature: (1) unemployed households with previously lowliquid assets exhibit substantially higher marginal propensities to consume(MPCs) out of stimulus transfers compared to high-asset households (0.50 vs0.34), even when neither group faces borrowing constraints, consistent withGanong et al. (2024); and (2) households with more past unemploymentexperiences maintain persistently lower consumption levels after controllingfor current economic conditions, a "scarring" effect documented by Malmendierand Shen (2024). Unlike existing explanations based on belief updating aboutincome risk or ex-ante heterogeneity, the reinforcement learning mechanismgenerates both higher MPCs and lower consumption levels simultaneously throughvalue function approximation errors that evolve with experience. Simulationresults closely match the empirical estimates, suggesting that adaptivelearning through reinforcement learning provides a unifying framework forunderstanding how past experiences shape current consumption behavior beyondwhat current economic conditions would predict.