Weight Space Representation Learning on Diverse NeRF Architectures

  • 2025-05-29 18:59:55
  • Francesco Ballerini, Pierluigi Zama Ramirez, Samuele Salti, Luigi Di Stefano
  • 0

Abstract

Neural Radiance Fields (NeRFs) have emerged as a groundbreaking paradigm forrepresenting 3D objects and scenes by encoding shape and appearance informationinto the weights of a neural network. Recent studies have demonstrated thatthese weights can be used as input for frameworks designed to address deeplearning tasks; however, such frameworks require NeRFs to adhere to a specific,predefined architecture. In this paper, we introduce the first frameworkcapable of processing NeRFs with diverse architectures and performing inferenceon architectures unseen at training time. We achieve this by training a GraphMeta-Network within an unsupervised representation learning framework, and showthat a contrastive objective is conducive to obtaining an architecture-agnosticlatent space. In experiments conducted across 13 NeRF architectures belongingto three families (MLPs, tri-planes, and, for the first time, hash tables), ourapproach demonstrates robust performance in classification and retrieval tasksinvolving multiple architectures, even unseen at training time, while alsoexceeding the results of existing frameworks limited to single architectures.

 

Quick Read (beta)

loading the full paper ...