Unsupervised Online Video Object Segmentation with Motion Property Understanding

by   Tao Zhuo, et al.

Unsupervised online video object segmentation (VOS) aims to automatically segment the moving objects over an unconstrained video without the requirements of any prior information about the objects or camera motion. It is therefore a very challenging problem for high-level video analysis. So far, limited number of such methods have been reported in literature and most of them still have distance to a satisfactory performance. Targeting this challenging problem,in this paper, we propose a novel unsupervised online VOS framework by understanding the motion property as the meaning of moving in concurrence with a generic object for the segmented regions. By incorporating salient motion detection and object proposal, a pixel-wise fusion strategy is developed to effectively remove detection noises such as background movements and stationary objects. Furthermore, by leveraging the obtained segmentation from immediately preceding frames, a forward propagation algorithm is proposed to deal with the unreliable motion detection and object proposals. Experimental results on DAVIS-2016 and SegTrack-v2 benchmark dataset show that the proposed method outperforms the other state-of-the-art unsupervised online segmentation by achieving 5.6% absolute improvement at least, and additionally even achieves a better performance than the best unsupervised offline method on DAVIS-2016 dataset. Another significant advantage also need to be addressed that in all the experiments, there is only one existing trained model for object proposal (Mask RCNN on COCO dataset) being used without any fine-tuning, which is the demonstration of robustness. The most contribution of this work might sheds light on the potential and to motivate more VOS framework studies based on characteristic motion properties.


page 2

page 4

page 5

page 6

page 8

page 11


Treating Motion as Option to Reduce Motion Dependency in Unsupervised Video Object Segmentation

Unsupervised video object segmentation (VOS) aims to detect the most sal...

Instance Embedding Transfer to Unsupervised Video Object Segmentation

We propose a method for unsupervised video object segmentation by transf...

Tukey-Inspired Video Object Segmentation

We investigate the problem of strictly unsupervised video object segment...

Betrayed by Motion: Camouflaged Object Discovery via Motion Segmentation

The objective of this paper is to design a computational architecture th...

Unsupervised RGBD Video Object Segmentation Using GANs

Video object segmentation is a fundamental step in many advanced vision ...

A Coarse-To-Fine Framework For Video Object Segmentation

In this study, we develop an unsupervised coarse-to-fine video analysis ...

Unsupervised Object-Level Video Summarization with Online Motion Auto-Encoder

Unsupervised video summarization plays an important role on digesting, b...

Please sign up or login with your details

Forgot password? Click here to reset