Abstract
6D object pose estimation has shown strong generalizability to novel objects.However, existing methods often require either a complete, well-reconstructed3D model or numerous reference images that fully cover the object. Estimating6D poses from partial references, which capture only fragments of an object'sappearance and geometry, remains challenging. To address this, we proposeUA-Pose, an uncertainty-aware approach for 6D object pose estimation and onlineobject completion specifically designed for partial references. We assumeaccess to either (1) a limited set of RGBD images with known poses or (2) asingle 2D image. For the first case, we initialize a partial object 3D modelbased on the provided images and poses, while for the second, we useimage-to-3D techniques to generate an initial object 3D model. Our methodintegrates uncertainty into the incomplete 3D model, distinguishing betweenseen and unseen regions. This uncertainty enables confidence assessment in poseestimation and guides an uncertainty-aware sampling strategy for online objectcompletion, enhancing robustness in pose estimation accuracy and improvingobject completeness. We evaluate our method on the YCB-Video, YCBInEOAT, andHO3D datasets, including RGBD sequences of YCB objects manipulated by robotsand human hands. Experimental results demonstrate significant performanceimprovements over existing methods, particularly when object observations areincomplete or partially captured. Project page:https://minfenli.github.io/UA-Pose/