Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer

11/17/2016
by   Xin Wang, et al.
0

Transferring artistic styles onto everyday photographs has become an extremely popular task in both academia and industry. Recently, offline training has replaced on-line iterative optimization, enabling nearly real-time stylization. When those stylization networks are applied directly to high-resolution images, however, the style of localized regions often appears less similar to the desired artistic style. This is because the transfer process fails to capture small, intricate textures and maintain correct texture scales of the artworks. Here we propose a multimodal convolutional neural network that takes into consideration faithful representations of both color and luminance channels, and performs stylization hierarchically with multiple losses of increasing scales. Compared to state-of-the-art networks, our network can also perform style transfer in nearly real-time by conducting much more sophisticated training offline. By properly handling style and texture cues at multiple scales using several modalities, we can transfer not just large-scale, obvious style cues but also subtle, exquisite ones. That is, our scheme can generate results that are visually pleasing and more similar to multiple desired artistic styles with color and texture cues at multiple scales.

READ FULL TEXT

page 2

page 3

page 5

page 6

page 7

page 8

research
11/18/2018

GLStyleNet: Higher Quality Style Transfer Combining Global and Local Pyramid Features

Recent studies using deep neural networks have shown remarkable success ...
research
12/27/2022

Scaling Painting Style Transfer

Neural style transfer is a deep learning technique that produces an unpr...
research
03/30/2022

Online Motion Style Transfer for Interactive Character Control

Motion style transfer is highly desired for motion generation systems fo...
research
11/23/2016

Controlling Perceptual Factors in Neural Style Transfer

Neural Style Transfer has shown very exciting results enabling new forms...
research
10/20/2020

Real-time Localized Photorealistic Video Style Transfer

We present a novel algorithm for transferring artistic styles of semanti...
research
01/31/2017

Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses

Recently, methods have been proposed that perform texture synthesis and ...
research
08/02/2022

Learning to Incorporate Texture Saliency Adaptive Attention to Image Cartoonization

Image cartoonization is recently dominated by generative adversarial net...

Please sign up or login with your details

Forgot password? Click here to reset