InfoStyler: Disentanglement Information Bottleneck for Artistic Style Transfer

by   Yueming Lyu, et al.

Artistic style transfer aims to transfer the style of an artwork to a photograph while maintaining its original overall content. Many prior works focus on designing various transfer modules to transfer the style statistics to the content image. Although effective, ignoring the clear disentanglement of the content features and the style features from the first beginning, they have difficulty in balancing between content preservation and style transferring. To tackle this problem, we propose a novel information disentanglement method, named InfoStyler, to capture the minimal sufficient information for both content and style representations from the pre-trained encoding network. InfoStyler formulates the disentanglement representation learning as an information compression problem by eliminating style statistics from the content image and removing the content structure from the style image. Besides, to further facilitate disentanglement learning, a cross-domain Information Bottleneck (IB) learning strategy is proposed by reconstructing the content and style domains. Extensive experiments demonstrate that our InfoStyler can synthesize high-quality stylized images while balancing content structure preservation and style pattern richness.


page 1

page 2

page 4

page 6

page 8

page 9

page 10

page 11


Edge Enhanced Image Style Transfer via Transformers

In recent years, arbitrary image style transfer has attracted more and m...

Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalization

Text style transfer aims to alter the style (e.g., sentiment) of a sente...

A Method for Arbitrary Instance Style Transfer

The ability to synthesize style and content of different images to form ...

Simple Disentanglement of Style and Content in Visual Representations

Learning visual representations with interpretable features, i.e., disen...

StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content Enhancing

Non-parallel text style transfer is an important task in natural languag...

Depth-aware Neural Style Transfer using Instance Normalization

Neural Style Transfer (NST) is concerned with the artistic stylization o...

Cross-Domain Learning for Classifying Propaganda in Online Contents

As news and social media exhibit an increasing amount of manipulative po...

Please sign up or login with your details

Forgot password? Click here to reset