Abstract
Test-Time Scaling (TTS) is a promising approach to progressively elicit themodel's intelligence during inference. Recently, training-based TTS methods,such as continued reinforcement learning (RL), have further surged inpopularity, while training-free TTS methods are gradually fading fromprominence. However, the additional computation overhead of training amplifiesthe burden on test-time scaling. In this paper, we focus on training-free TTSmethods for reasoning. We first design Conditional Step-level Self-refinement,a fine-grained sequential scaling method guided by process verification. On topof its effectiveness, we further combine it with other classical parallelscaling methods at the step level, to introduce a novel inference paradigmcalled Hybrid Test-Time Scaling. Extensive experiments on fiveinstruction-tuned LLMs across different scales (3B-14B) and familiesdemonstrate that hybrid strategy incorporating various training-free TTSmethods at a fine granularity has considerable potential for expanding thereasoning performance boundaries of LLMs.