Abstract
Neural Radiance Fields (NeRFs) have revolutionized the reconstruction ofstatic scenes and objects in 3D, offering unprecedented quality. However,extending NeRFs to model dynamic objects or object articulations remains achallenging problem. Previous works have tackled this issue by focusing onpart-level reconstruction and motion estimation for objects, but they oftenrely on heuristics regarding the number of moving parts or object categories,which can limit their practical use. In this work, we introduce LEIA, a novelapproach for representing dynamic 3D objects. Our method involves observing theobject at distinct time steps or "states" and conditioning a hypernetwork onthe current state, using this to parameterize our NeRF. This approach allows usto learn a view-invariant latent representation for each state. We furtherdemonstrate that by interpolating between these states, we can generate novelarticulation configurations in 3D space that were previously unseen. Ourexperimental results highlight the effectiveness of our method in articulatingobjects in a manner that is independent of the viewing angle and jointconfiguration. Notably, our approach outperforms previous methods that rely onmotion information for articulation registration.