Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artworks

by   Alex J. Champandard, et al. Conference

Convolutional neural networks (CNNs) have proven highly effective at image synthesis and style transfer. For most users, however, using them as tools can be a challenging task due to their unpredictable behavior that goes against common intuitions. This paper introduces a novel concept to augment such generative architectures with semantic annotations, either by manually authoring pixel labels or using existing solutions for semantic segmentation. The result is a content-aware generative algorithm that offers meaningful control over the outcome. Thus, we increase the quality of images generated by avoiding common glitches, make the results look significantly more plausible, and extend the functional range of these algorithms---whether for portraits or landscapes, etc. Applications include semantic style transfer and turning doodles with few colors into masterful paintings!


page 1

page 2

page 3

page 4

page 5

page 6


Automated Deep Photo Style Transfer

Photorealism is a complex concept that cannot easily be formulated mathe...

CAMS: Color-Aware Multi-Style Transfer

Image style transfer aims to manipulate the appearance of a source image...

Neural Style Transfer for Remote Sensing

The well-known technique outlined in the paper of Leon A. Gatys et al., ...

Deepfake Style Transfer Mixture: a First Forensic Ballistics Study on Synthetic Images

Most recent style-transfer techniques based on generative architectures ...

Level generation and style enhancement – deep learning for game development overview

We present practical approaches of using deep learning to create and enh...

Son of Zorn's Lemma: Targeted Style Transfer Using Instance-aware Semantic Segmentation

Style transfer is an important task in which the style of a source image...

Style transfer based data augmentation in material microscopic image processing

Recently progress in material microscopic image semantic segmentation ha...

Code Repositories


A hit and go photo restoration pipeline

view repo

Please sign up or login with your details

Forgot password? Click here to reset