PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsampling

by   Yue Qian, et al.

This paper addresses the problem of generating uniform dense point clouds to describe the underlying geometric structures from given sparse point clouds. Due to the irregular and unordered nature, point cloud densification as a generative task is challenging. To tackle the challenge, we propose a novel deep neural network based method, called PUGeo-Net, that learns a 3× 3 linear transformation matrix T for each input point. Matrix T approximates the augmented Jacobian matrix of a local parameterization and builds a one-to-one correspondence between the 2D parametric domain and the 3D tangent plane so that we can lift the adaptively distributed 2D samples (which are also learned from data) to 3D space. After that, we project the samples to the curved surface by computing a displacement along the normal of the tangent plane. PUGeo-Net is fundamentally different from the existing deep learning methods that are largely motivated by the image super-resolution techniques and generate new points in the abstract feature space. Thanks to its geometry-centric nature, PUGeo-Net works well for both CAD models with sharp features and scanned models with rich geometric details. Moreover, PUGeo-Net can compute the normal for the original and generated points, which is highly desired by the surface reconstruction algorithms. Computational results show that PUGeo-Net, the first neural network that can jointly generate vertex coordinates and normals, consistently outperforms the state-of-the-art in terms of accuracy and efficiency for upsampling factor 4∼ 16


page 2

page 7

page 8


PU-Flow: a Point Cloud Upsampling Networkwith Normalizing Flows

Point cloud upsampling aims to generate dense point clouds from given sp...

Deep Magnification-Arbitrary Upsampling over 3D Point Clouds

This paper addresses the problem of generating dense point clouds from g...

GRASP-Net: Geometric Residual Analysis and Synthesis for Point Cloud Compression

Point cloud compression (PCC) is a key enabler for various 3-D applicati...

Point cloud ridge-valley feature enhancement based on position and normal guidance

Ridge-valley features are important elements of point clouds, as they co...

NURBS-Diff: A Differentiable NURBS Layer for Machine Learning CAD Applications

Recent deep-learning-based techniques for the reconstruction of geometri...

MOPS-Net: A Matrix Optimization-driven Network forTask-Oriented 3D Point Cloud Downsampling

Downsampling is a commonly-used technique in 3D point cloudprocessing fo...

RFEPS: Reconstructing Feature-line Equipped Polygonal Surface

Feature lines are important geometric cues in characterizing the structu...

Please sign up or login with your details

Forgot password? Click here to reset