Abstract
Despite having tremendous progress in image-to-3D generation, existingmethods still struggle to produce multi-view consistent images withhigh-resolution textures in detail, especially in the paradigm of 2D diffusionthat lacks 3D awareness. In this work, we present High-resolution Image-to-3Dmodel (Hi3D), a new video diffusion based paradigm that redefines a singleimage to multi-view images as 3D-aware sequential image generation (i.e.,orbital video generation). This methodology delves into the underlying temporalconsistency knowledge in video diffusion model that generalizes well togeometry consistency across multiple views in 3D generation. Technically, Hi3Dfirst empowers the pre-trained video diffusion model with 3D-aware prior(camera pose condition), yielding multi-view images with low-resolution texturedetails. A 3D-aware video-to-video refiner is learnt to further scale up themulti-view images with high-resolution texture details. Such high-resolutionmulti-view images are further augmented with novel views through 3D GaussianSplatting, which are finally leveraged to obtain high-fidelity meshes via 3Dreconstruction. Extensive experiments on both novel view synthesis and singleview reconstruction demonstrate that our Hi3D manages to produce superiormulti-view consistency images with highly-detailed textures. Source code anddata are available at \url{https://github.com/yanghb22-fdu/Hi3D-Official}.