Abstract
Feed-forward 3D Gaussian Splatting (3DGS) models have recently emerged as apromising solution for novel view synthesis, enabling one-pass inferencewithout the need for per-scene 3DGS optimization. However, their scalability isfundamentally constrained by the limited capacity of their encoders, leading todegraded performance or excessive memory consumption as the number of inputviews increases. In this work, we analyze feed-forward 3DGS frameworks throughthe lens of the Information Bottleneck principle and introduce ZPressor, alightweight architecture-agnostic module that enables efficient compression ofmulti-view inputs into a compact latent state $Z$ that retains essential sceneinformation while discarding redundancy. Concretely, ZPressor enables existingfeed-forward 3DGS models to scale to over 100 input views at 480P resolution onan 80GB GPU, by partitioning the views into anchor and support sets and usingcross attention to compress the information from the support views into anchorviews, forming the compressed latent state $Z$. We show that integratingZPressor into several state-of-the-art feed-forward 3DGS models consistentlyimproves performance under moderate input views and enhances robustness underdense view settings on two large-scale benchmarks DL3DV-10K and RealEstate10K.The video results, code and trained models are available on our project page:https://lhmd.top/zpressor.