Model Inconsistent but Correlated Noise: Multi-view Subspace Learning with Regularized Mixture of Gaussians

by   Hongwei Yong, et al.

Multi-view subspace learning (MSL) aims to find a low-dimensional subspace of the data obtained from multiple views. Different from single view case, MSL should take both common and specific knowledge among different views into consideration. To enhance the robustness of model, the complexity, non-consistency and similarity of noise in multi-view data should be fully taken into consideration. Most current MSL methods only assume a simple Gaussian or Laplacian distribution for the noise while neglect the complex noise configurations in each view and noise correlations among different views of practical data. To this issue, this work initiates a MSL method by encoding the multi-view-shared and single-view-specific noise knowledge in data. Specifically, we model data noise in each view as a separated Mixture of Gaussians (MoG), which can fit a wider range of complex noise types than conventional Gaussian/Laplacian. Furthermore, we link all single-view-noise as a whole by regularizing them by a common MoG component, encoding the shared noise knowledge among them. Such regularization component can be formulated as a concise KL-divergence regularization term under a MAP framework, leading to good interpretation of our model and simple EM-based solving strategy to the problem. Experimental results substantiate the superiority of our method.


page 1

page 6

page 7


Multi-view Fuzzy Representation Learning with Rules based Model

Unsupervised multi-view representation learning has been extensively stu...

Multi-view Subspace Adaptive Learning via Autoencoder and Attention

Multi-view learning can cover all features of data samples more comprehe...

Multi-view Laplacian Eigenmaps Based on Bag-of-Neighbors For RGBD Human Emotion Recognition

Human emotion recognition is an important direction in the field of biom...

Multi-view Common Component Discriminant Analysis for Cross-view Classification

Cross-view classification that means to classify samples from heterogene...

Locality Relationship Constrained Multi-view Clustering Framework

In most practical applications, it's common to utilize multiple features...

Classification of weak multi-view signals by sharing factors in a mixture of Bayesian group factor analyzers

We propose a novel classification model for weak signal data, building u...

Dual Memory Neural Computer for Asynchronous Two-view Sequential Learning

One of the core task in multi-view learning is to capture all relations ...

Please sign up or login with your details

Forgot password? Click here to reset