Unsupervised Image Semantic Segmentation through Superpixels and Graph Neural Networks

10/21/2022
by   Moshe Eliasof, et al.
0

Unsupervised image segmentation is an important task in many real-world scenarios where labelled data is of scarce availability. In this paper we propose a novel approach that harnesses recent advances in unsupervised learning using a combination of Mutual Information Maximization (MIM), Neural Superpixel Segmentation and Graph Neural Networks (GNNs) in an end-to-end manner, an approach that has not been explored yet. We take advantage of the compact representation of superpixels and combine it with GNNs in order to learn strong and semantically meaningful representations of images. Specifically, we show that our GNN based approach allows to model interactions between distant pixels in the image and serves as a strong prior to existing CNNs for an improved accuracy. Our experiments reveal both the qualitative and quantitative advantages of our approach compared to current state-of-the-art methods over four popular datasets.

READ FULL TEXT

page 1

page 6

research
06/08/2020

Unsupervised Graph Representation by Periphery and Hierarchical Information Maximization

Deep representation learning on non-Euclidean data types, such as graphs...
research
07/01/2021

Unsupervised Image Segmentation by Mutual Information Maximization and Adversarial Regularization

Semantic segmentation is one of the basic, yet essential scene understan...
research
08/18/2023

A Potts model approach to unsupervised graph clustering with Graph Neural Networks

Numerous approaches have been explored for graph clustering, including t...
research
11/29/2022

Every Node Counts: Improving the Training of Graph Neural Networks on Node Classification

Graph Neural Networks (GNNs) are prominent in handling sparse and unstru...
research
07/16/2020

Autoregressive Unsupervised Image Segmentation

In this work, we propose a new unsupervised image segmentation approach ...
research
10/30/2022

Decentralized Channel Management in WLANs with Graph Neural Networks

Wireless local area networks (WLANs) manage multiple access points (APs)...
research
12/12/2022

DeepCut: Unsupervised Segmentation using Graph Neural Networks Clustering

Image segmentation is a fundamental task in computer vision. Data annota...

Please sign up or login with your details

Forgot password? Click here to reset