Tensorformer: Normalized Matrix Attention Transformer for High-quality Point Cloud Reconstruction

06/28/2023
by   Hui Tian, et al.
0

Surface reconstruction from raw point clouds has been studied for decades in the computer graphics community, which is highly demanded by modeling and rendering applications nowadays. Classic solutions, such as Poisson surface reconstruction, require point normals as extra input to perform reasonable results. Modern transformer-based methods can work without normals, while the results are less fine-grained due to limited encoding performance in local fusion from discrete points. We introduce a novel normalized matrix attention transformer (Tensorformer) to perform high-quality reconstruction. The proposed matrix attention allows for simultaneous point-wise and channel-wise message passing, while the previous vector attention loses neighbor point information across different channels. It brings more degree of freedom in feature learning and thus facilitates better modeling of local geometries. Our method achieves state-of-the-art on two commonly used datasets, ShapeNetCore and ABC, and attains 4 https://github.com/THHHomas/Tensorformer6.

READ FULL TEXT

page 1

page 2

page 3

page 7

page 8

page 9

page 12

page 13

research
10/11/2022

Point Transformer V2: Grouped Vector Attention and Partition-based Pooling

As a pioneering work exploring transformer architecture for 3D point clo...
research
03/17/2022

Deep Point Cloud Simplification for High-quality Surface Reconstruction

The growing size of point clouds enlarges consumptions of storage, trans...
research
03/02/2022

3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification

Although accurate and fast point cloud classification is a fundamental t...
research
05/11/2022

Surface Representation for Point Clouds

Most prior work represents the shapes of point clouds by coordinates. Ho...
research
08/10/2021

SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformer

Point cloud completion aims to predict a complete shape in high accuracy...
research
12/08/2021

Garment4D: Garment Reconstruction from Point Cloud Sequences

Learning to reconstruct 3D garments is important for dressing 3D human b...
research
05/30/2023

Rethinking Rendering in Generalizable Neural Surface Reconstruction: A Learning-based Solution

Generalizable neural surface reconstruction techniques have attracted gr...

Please sign up or login with your details

Forgot password? Click here to reset