Uncertainty Comes for Free: Human-in-the-Loop Policies with Diffusion Models

  • 2025-05-08 18:10:57
  • Zhanpeng He, Yifeng Cao, Matei Ciocarlie
  • 0

Abstract

Human-in-the-loop (HitL) robot deployment has gained significant attention inboth academia and industry as a semi-autonomous paradigm that enables humanoperators to intervene and adjust robot behaviors at deployment time, improvingsuccess rates. However, continuous human monitoring and intervention can behighly labor-intensive and impractical when deploying a large number of robots.To address this limitation, we propose a method that allows diffusion policiesto actively seek human assistance only when necessary, reducing reliance onconstant human oversight. To achieve this, we leverage the generative processof diffusion policies to compute an uncertainty-based metric based on which theautonomous agent can decide to request operator assistance at deployment time,without requiring any operator interaction during training. Additionally, weshow that the same method can be used for efficient data collection forfine-tuning diffusion policies in order to improve their autonomousperformance. Experimental results from simulated and real-world environmentsdemonstrate that our approach enhances policy performance during deployment fora variety of scenarios.

 

Quick Read (beta)

loading the full paper ...