Abstract
Dexterous robotic hands often struggle to generalize effectively in complexenvironments due to the limitations of models trained on low-diversity data.However, the real world presents an inherently unbounded range of scenarios,making it impractical to account for every possible variation. A naturalsolution is to enable robots learning from experience in complex environments,an approach akin to evolution, where systems improve through continuousfeedback, learning from both failures and successes, and iterating towardoptimal performance. Motivated by this, we propose EvolvingGrasp, anevolutionary grasp generation method that continuously enhances graspingperformance through efficient preference alignment. Specifically, we introduceHandpose wise Preference Optimization (HPO), which allows the model tocontinuously align with preferences from both positive and negative feedbackwhile progressively refining its grasping strategies. To further enhanceefficiency and reliability during online adjustments, we incorporate aPhysics-aware Consistency Model within HPO, which accelerates inference,reduces the number of timesteps needed for preference finetuning, and ensuresphysical plausibility throughout the process. Extensive experiments across fourbenchmark datasets demonstrate state of the art performance of our method ingrasp success rate and sampling efficiency. Our results validate thatEvolvingGrasp enables evolutionary grasp generation, ensuring robust,physically feasible, and preference-aligned grasping in both simulation andreal scenarios.