Neural Splines: Fitting 3D Surfaces with Infinitely-Wide Neural Networks

06/24/2020
by   Francis Williams, et al.
6

We present Neural Splines, a technique for 3D surface reconstruction that is based on random feature kernels arising from infinitely-wide shallow ReLU networks. Our method achieves state-of-the-art results, outperforming Screened Poisson Surface Reconstruction and modern neural network based techniques. Because our approach is based on a simple kernel formulation, it is fast to run and easy to analyze. We provide explicit analytical expressions for our kernel and argue that our formulation can be seen as a generalization of cubic spline interpolation to higher dimensions. In particular, the RKHS norm associated with our kernel biases toward smooth interpolants. Finally, we formulate Screened Poisson Surface Reconstruction as a kernel method and derive an analytic expression for its norm in the corresponding RKHS.

READ FULL TEXT

page 2

page 5

page 8

page 18

page 19

page 20

page 21

page 22

research
05/15/2020

Learning the gravitational force law and other analytic functions

Large neural network models have been successful in learning functions o...
research
05/17/2023

Sparsity-depth Tradeoff in Infinitely Wide Deep Neural Networks

We investigate how sparse neural activity affects the generalization per...
research
02/25/2020

Convex Geometry and Duality of Over-parameterized Neural Networks

We develop a convex analytic framework for ReLU neural networks which el...
research
10/03/2020

Cubic Spline Smoothing Compensation for Irregularly Sampled Sequences

The marriage of recurrent neural networks and neural ordinary differenti...
research
09/21/2023

Neural Stochastic Screened Poisson Reconstruction

Reconstructing a surface from a point cloud is an underdetermined proble...
research
11/26/2021

Neural Fields as Learnable Kernels for 3D Reconstruction

We present Neural Kernel Fields: a novel method for reconstructing impli...

Please sign up or login with your details

Forgot password? Click here to reset