Unsupervised RGBD Video Object Segmentation Using GANs

by   Maryam Sultana, et al.

Video object segmentation is a fundamental step in many advanced vision applications. Most existing algorithms are based on handcrafted features such as HOG, super-pixel segmentation or texture-based techniques, while recently deep features have been found to be more efficient. Existing algorithms observe performance degradation in the presence of challenges such as illumination variations, shadows, and color camouflage. To handle these challenges we propose a fusion based moving object segmentation algorithm which exploits color as well as depth information using GAN to achieve more accuracy. Our goal is to segment moving objects in the presence of challenging background scenes, in real environments. To address this problem, GAN is trained in an unsupervised manner on color and depth information independently with challenging video sequences. During testing, the trained GAN generates backgrounds similar to that in the test sample. The generated background samples are then compared with the test sample to segment moving objects. The final result is computed by fusion of object boundaries in both modalities, RGB and the depth. The comparison of our proposed algorithm with five state-of-the-art methods on publicly available dataset has shown the strength of our algorithm for moving object segmentation in videos in the presence of challenging real scenarios.


page 8

page 11


Illumination Invariant Foreground Object Segmentation using ForeGANs

The foreground segmentation algorithms suffer performance degradation in...

Graph CNN for Moving Object Detection in Complex Environments from Unseen Videos

Moving Object Detection (MOD) is a fundamental step for many computer vi...

Moving object detection for visual odometry in a dynamic environment based on occlusion accumulation

Detection of moving objects is an essential capability in dealing with d...

Unsupervised Online Video Object Segmentation with Motion Property Understanding

Unsupervised online video object segmentation (VOS) aims to automaticall...

HabitatDyn Dataset: Dynamic Object Detection to Kinematics Estimation

The advancement of computer vision and machine learning has made dataset...

Synthesis of supervised classification algorithm using intelligent and statistical tools

A fundamental task in detecting foreground objects in both static and dy...

CoreDeep: Improving Crack Detection Algorithms Using Width Stochasticity

Automatically detecting or segmenting cracks in images can help in reduc...

Please sign up or login with your details

Forgot password? Click here to reset