A Closed-form Solution to Photorealistic Image Stylization

02/19/2018
by   Yijun Li, et al.
0

Photorealistic image style transfer algorithms aim at stylizing a content photo using the style of a reference photo with the constraint that the stylized photo should remains photorealistic. While several methods exist for this task, they tend to generate spatially inconsistent stylizations with noticeable artifacts. In addition, these methods are computationally expensive, requiring several minutes to stylize a VGA photo. In this paper, we present a novel algorithm to address the limitations. The proposed algorithm consists of a stylization step and a smoothing step. While the stylization step transfers the style of the reference photo to the content photo, the smoothing step encourages spatially consistent stylizations. Unlike existing algorithms that require iterative optimization, both steps in our algorithm have closed-form solutions. Experimental results show that the stylized photos generated by our algorithm are twice more preferred by human subjects in average. Moreover, our method runs 60 times faster than the state-of-the-art approach. Code and additional results are available at https://github.com/NVIDIA/FastPhotoStyle.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

page 10

research
01/12/2019

Automated Deep Photo Style Transfer

Photorealism is a complex concept that cannot easily be formulated mathe...
research
05/09/2020

Photo style transfer with consistency losses

We address the problem of style transfer between two photos and propose ...
research
12/05/2019

Ultrafast Photorealistic Style Transfer via Neural Architecture Search

The key challenge in photorealistic style transfer is that an algorithm ...
research
11/18/2018

GLStyleNet: Higher Quality Style Transfer Combining Global and Local Pyramid Features

Recent studies using deep neural networks have shown remarkable success ...
research
03/09/2020

GPUAccelerated Mobile Multiview Style Transfer

An estimated 60% of smartphones sold in 2018 were equipped with multiple...
research
08/28/2017

Stylizing Face Images via Multiple Exemplars

We address the problem of transferring the style of a headshot photo to ...
research
04/09/2018

Deep Painterly Harmonization

Copying an element from a photo and pasting it into a painting is a chal...

Please sign up or login with your details

Forgot password? Click here to reset