PointMixer: MLP-Mixer for Point Cloud Understanding

11/22/2021
by   Jaesung Choe, et al.
0

MLP-Mixer has newly appeared as a new challenger against the realm of CNNs and transformer. Despite its simplicity compared to transformer, the concept of channel-mixing MLPs and token-mixing MLPs achieves noticeable performance in visual recognition tasks. Unlike images, point clouds are inherently sparse, unordered and irregular, which limits the direct use of MLP-Mixer for point cloud understanding. In this paper, we propose PointMixer, a universal point set operator that facilitates information sharing among unstructured 3D points. By simply replacing token-mixing MLPs with a softmax function, PointMixer can "mix" features within/between point sets. By doing so, PointMixer can be broadly used in the network as inter-set mixing, intra-set mixing, and pyramid mixing. Extensive experiments show the competitive or superior performance of PointMixer in semantic segmentation, classification, and point reconstruction against transformer-based methods.

READ FULL TEXT

page 6

page 7

research
11/24/2021

PU-Transformer: Point Cloud Upsampling Transformer

Given the rapid development of 3D scanners, point clouds are becoming po...
research
04/06/2023

PointCAT: Cross-Attention Transformer for point cloud

Transformer-based models have significantly advanced natural language pr...
research
11/27/2018

Iterative Transformer Network for 3D Point Cloud

3D point cloud is an efficient and flexible representation of 3D structu...
research
12/05/2021

Adaptive Channel Encoding Transformer for Point Cloud Analysis

Transformer plays an increasingly important role in various computer vis...
research
11/23/2021

Deep Point Cloud Reconstruction

Point cloud obtained from 3D scanning is often sparse, noisy, and irregu...
research
01/30/2023

Quantifying Context Mixing in Transformers

Self-attention weights and their transformed variants have been the main...
research
11/18/2022

On the inadequacy of nominal assortativity for assessing homophily in networks

Nominal assortativity (or discrete assortativity) is widely used to char...

Please sign up or login with your details

Forgot password? Click here to reset