Abstract
When applying reinforcement learning--typically through GRPO--to largevision-language model reasoning struggles to effectively scale reasoning lengthor generates verbose outputs across all tasks with only marginal gains inaccuracy. To address this issue, we present FAST-GRPO, a variant of GRPO thatdynamically adapts reasoning depth based on question characteristics. Throughempirical analysis, we establish the feasibility of fast-slow thinking in LVLMsby investigating how response length and data distribution affect performance.Inspired by these observations, we introduce two complementary metrics toestimate the difficulty of the questions, guiding the model to determine whenfast or slow thinking is more appropriate. Next, we incorporate adaptivelength-based rewards and difficulty-aware KL divergence into the GRPOalgorithm. Experiments across seven reasoning benchmarks demonstrate that FASTachieves state-of-the-art accuracy with over 10\% relative improvement comparedto the base model, while reducing token usage by 32.7-67.3\% compared toprevious slow-thinking approaches, effectively balancing reasoning length andaccuracy.