Neural Strands: Learning Hair Geometry and Appearance from Multi-View Images

  • 2022-07-28 14:08:46
  • Radu Alexandru Rosu, Shunsuke Saito, Ziyan Wang, Chenglei Wu, Sven Behnke, Giljoo Nam
  • 35

Abstract

We present Neural Strands, a novel learning framework for modeling accuratehair geometry and appearance from multi-view image inputs. The learned hairmodel can be rendered in real-time from any viewpoint with high-fidelityview-dependent effects. Our model achieves intuitive shape and style controlunlike volumetric counterparts. To enable these properties, we propose a novelhair representation based on a neural scalp texture that encodes the geometryand appearance of individual strands at each texel location. Furthermore, weintroduce a novel neural rendering framework based on rasterization of thelearned hair strands. Our neural rendering is strand-accurate and anti-aliased,making the rendering view-consistent and photorealistic. Combining appearancewith a multi-view geometric prior, we enable, for the first time, the jointlearning of appearance and explicit hair geometry from a multi-view setup. Wedemonstrate the efficacy of our approach in terms of fidelity and efficiencyfor various hairstyles.

 

Quick Read (beta)

loading the full paper ...