Abstract
Sequential Recommendation (SeqRec) aims to predict the next item by capturingsequential patterns from users' historical interactions, playing a crucial rolein many real-world recommender systems. However, existing approachespredominantly adopt a direct forward computation paradigm, where the finalhidden state of the sequence encoder serves as the user representation. Weargue that this inference paradigm, due to its limited computational depth,struggles to model the complex evolving nature of user preferences and lacks anuanced understanding of long-tail items, leading to suboptimal performance. Toaddress this issue, we propose \textbf{ReaRec}, the first inference-timecomputing framework for recommender systems, which enhances userrepresentations through implicit multi-step reasoning. Specifically, ReaRecautoregressively feeds the sequence's last hidden state into the sequentialrecommender while incorporating special reasoning position embeddings todecouple the original item encoding space from the multi-step reasoning space.Moreover, we introduce two lightweight reasoning-based learning methods,Ensemble Reasoning Learning (ERL) and Progressive Reasoning Learning (PRL), tofurther effectively exploit ReaRec's reasoning potential. Extensive experimentson five public real-world datasets and different SeqRec architecturesdemonstrate the generality and effectiveness of our proposed ReaRec.Remarkably, post-hoc analyses reveal that ReaRec significantly elevates theperformance ceiling of multiple sequential recommendation backbones byapproximately 30\%-50\%. Thus, we believe this work can open a new andpromising avenue for future research in inference-time computing for sequentialrecommendation.