Abstract
Humanoid robots capable of autonomous operation in diverse environments havelong been a goal for roboticists. However, autonomous manipulation by humanoidrobots has largely been restricted to one specific scene, primarily due to thedifficulty of acquiring generalizable skills. Recent advances in 3D visuomotorpolicies, such as the 3D Diffusion Policy (DP3), have shown promise inextending these capabilities to wilder environments. However, 3D visuomotorpolicies often rely on camera calibration and point-cloud segmentation, whichpresent challenges for deployment on mobile robots like humanoids. In thiswork, we introduce the Improved 3D Diffusion Policy (iDP3), a novel 3Dvisuomotor policy that eliminates these constraints by leveraging egocentric 3Dvisual representations. We demonstrate that iDP3 enables a full-sized humanoidrobot to autonomously perform skills in diverse real-world scenarios, usingonly data collected in the lab. Videos are available at:https://humanoid-manipulation.github.io