Abstract
This work presents Spacecraft Pose Network v2 (SPNv2), a Convolutional NeuralNetwork (CNN) for pose estimation of noncooperative spacecraft across domaingap. SPNv2 is a multi-scale, multi-task CNN which consists of a sharedmulti-scale feature encoder and multiple prediction heads that performdifferent tasks on a shared feature output. These tasks are all related todetection and pose estimation of a target spacecraft from an image, such asprediction of pre-defined satellite keypoints, direct pose regression, andbinary segmentation of the satellite foreground. It is shown that by jointlytraining on different yet related tasks with extensive data augmentations onsynthetic images only, the shared encoder learns features that are commonacross image domains that have fundamentally different visual characteristicscompared to synthetic images. This work also introduces Online DomainRefinement (ODR) which refines the parameters of the normalization layers ofSPNv2 on the target domain images online at deployment. Specifically, ODRperforms self-supervised entropy minimization of the predicted satelliteforeground, thereby improving the CNN's performance on the target domain imageswithout their pose labels and with minimal computational efforts. The GitHubrepository for SPNv2 will be made available in the near future.