Rethinking Content and Style: Exploring Bias for Unsupervised Disentanglement

02/21/2021
by   Xuanchi Ren, et al.
16

Content and style (C-S) disentanglement intends to decompose the underlying explanatory factors of objects into two independent subspaces. From the unsupervised disentanglement perspective, we rethink content and style and propose a formulation for unsupervised C-S disentanglement based on our assumption that different factors are of different importance and popularity for image reconstruction, which serves as a data bias. The corresponding model inductive bias is introduced by our proposed C-S disentanglement Module (C-S DisMo), which assigns different and independent roles to content and style when approximating the real data distributions. Specifically, each content embedding from the dataset, which encodes the most dominant factors for image reconstruction, is assumed to be sampled from a shared distribution across the dataset. The style embedding for a particular image, encoding the remaining factors, is used to customize the shared distribution through an affine transformation. The experiments on several popular datasets demonstrate that our method achieves the state-of-the-art unsupervised C-S disentanglement, which is comparable or even better than supervised methods. We verify the effectiveness of our method by downstream tasks: domain translation and single-view 3D reconstruction. Project page at https://github.com/xrenaa/CS-DisMo.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 8

research
09/28/2018

Open-Ended Content-Style Recombination Via Leakage Filtering

We consider visual domains in which a class label specifies the content ...
research
05/26/2019

Disentangling Style and Content in Anime Illustrations

Existing methods for AI-generated artworks still struggle with generatin...
research
10/12/2022

Line Search-Based Feature Transformation for Fast, Stable, and Tunable Content-Style Control in Photorealistic Style Transfer

Photorealistic style transfer is the task of synthesizing a realistic-lo...
research
02/24/2022

Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph

This paper addresses the unsupervised learning of content-style decompos...
research
08/27/2020

Metrics for Exposing the Biases of Content-Style Disentanglement

Recent state-of-the-art semi- and un-supervised solutions for challengin...
research
10/31/2020

Pose Randomization for Weakly Paired Image Style Translation

Utilizing the trained model under different conditions without data anno...
research
01/14/2020

Adversarial Disentanglement with Grouped Observations

We consider the disentanglement of the representations of the relevant a...

Please sign up or login with your details

Forgot password? Click here to reset