Abstract
This paper addresses the problem of reconstructing a scene online at thelevel of objects given an RGB-D video sequence. While current object-awareneural implicit representations hold promise, they are limited in onlinereconstruction efficiency and shape completion. Our main contributions toalleviate the above limitations are twofold. First, we propose a feature gridinterpolation mechanism to continuously update grid-based object-centric neuralimplicit representations as new object parts are revealed. Second, we constructan object library with previously mapped objects in advance and leverage thecorresponding shape priors to initialize geometric object models in new videos,subsequently completing them with novel views as well as synthesized past viewsto avoid losing original object details. Extensive experiments on syntheticenvironments from the Replica dataset, real-world ScanNet sequences and videoscaptured in our laboratory demonstrate that our approach outperformsstate-of-the-art neural implicit models for this task in terms ofreconstruction accuracy and completeness.