SelfNeRF: Fast Training NeRF for Human from Monocular Self-rotating Video

by   Bo Peng, et al.

In this paper, we propose SelfNeRF, an efficient neural radiance field based novel view synthesis method for human performance. Given monocular self-rotating videos of human performers, SelfNeRF can train from scratch and achieve high-fidelity results in about twenty minutes. Some recent works have utilized the neural radiance field for dynamic human reconstruction. However, most of these methods need multi-view inputs and require hours of training, making it still difficult for practical use. To address this challenging problem, we introduce a surface-relative representation based on multi-resolution hash encoding that can greatly improve the training speed and aggregate inter-frame information. Extensive experimental results on several different datasets demonstrate the effectiveness and efficiency of SelfNeRF to challenging monocular videos.


page 1

page 4

page 7

page 8


IntrinsicNGP: Intrinsic Coordinate based Hash Encoding for Human NeRF

Recently, many works have been proposed to utilize the neural radiance f...

GHuNeRF: Generalizable Human NeRF from a Monocular Video

In this paper, we tackle the challenging task of learning a generalizabl...

FOF: Learning Fourier Occupancy Field for Monocular Real-time Human Reconstruction

The advent of deep learning has led to significant progress in monocular...

InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds

In this paper, we take a significant step towards real-world applicabili...

MonoHuman: Animatable Human Neural Field from Monocular Video

Animating virtual avatars with free-view control is crucial for various ...

DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Rendering

We introduce DoubleField, a novel representation combining the merits of...

Monocular Dynamic View Synthesis: A Reality Check

We study the recent progress on dynamic view synthesis (DVS) from monocu...

Please sign up or login with your details

Forgot password? Click here to reset