IntrinsicNGP: Intrinsic Coordinate based Hash Encoding for Human NeRF

by   Bo Peng, et al.

Recently, many works have been proposed to utilize the neural radiance field for novel view synthesis of human performers. However, most of these methods require hours of training, making them difficult for practical use. To address this challenging problem, we propose IntrinsicNGP, which can train from scratch and achieve high-fidelity results in few minutes with videos of a human performer. To achieve this target, we introduce a continuous and optimizable intrinsic coordinate rather than the original explicit Euclidean coordinate in the hash encoding module of instant-NGP. With this novel intrinsic coordinate, IntrinsicNGP can aggregate inter-frame information for dynamic objects with the help of proxy geometry shapes. Moreover, the results trained with the given rough geometry shapes can be further refined with an optimizable offset field based on the intrinsic coordinate.Extensive experimental results on several datasets demonstrate the effectiveness and efficiency of IntrinsicNGP. We also illustrate our approach's ability to edit the shape of reconstructed subjects.


page 1

page 6

page 7

page 8


SelfNeRF: Fast Training NeRF for Human from Monocular Self-rotating Video

In this paper, we propose SelfNeRF, an efficient neural radiance field b...

SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Video

We propose SelfRecon, a clothed human body reconstruction method that co...

Intrinsic Neural Fields: Learning Functions on Manifolds

Neural fields have gained significant attention in the computer vision c...

Curvature-Aware Training for Coordinate Networks

Coordinate networks are widely used in computer vision due to their abil...

H3D-Net: Few-Shot High-Fidelity 3D Head Reconstruction

Recent learning approaches that implicitly represent surface geometry us...

A Simple Approach to Intrinsic Correspondence Learning on Unstructured 3D Meshes

The question of representation of 3D geometry is of vital importance whe...

Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Poses

Learning-based visual relocalizers exhibit leading pose accuracy, but re...

Please sign up or login with your details

Forgot password? Click here to reset