FaceShop: Deep Sketch-based Face Image Editing

by   Tiziano Portenier, et al.

We present a novel system for sketch-based face image editing, enabling users to edit images in an intuitive manner by sketching a few strokes on a region of interest. Our interface features tools to express a desired image manipulation by providing both geometry and color constraints as user-drawn strokes. As an alternative to the direct user input, our proposed system naturally supports a copy-paste mode, which allows users to edit a given image region by using parts of another exemplar image without the need of hand-drawn sketching at all. The proposed interface runs in real-time and facilitates an interactive and iterative workflow to quickly express the intended edits. Our system is based on a novel sketch domain and a convolutional neural network trained end-to-end to automatically learn to render image regions corresponding to the input strokes. To achieve high quality and semantically consistent results we train our neural network on two simultaneous tasks, namely image completion and image translation. To the best of our knowledge, we are the first to combine these two tasks in a unified framework for interactive image editing. Our results show that the proposed sketch domain, network architecture, and training procedure generalize well to real user input and enable high quality synthesis results without additional post-processing. Moreover, the proposed fully-convolutional model does not rely on any multi-scale or cascaded network architecture to synthesize high-resolution images and can be trained end-to-end to produce images of arbitrary size.


page 1

page 3

page 4

page 5

page 7

page 8

page 12

page 13


SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Color

We present a novel image editing system that generates images as the use...

Facelet-Bank for Fast Portrait Manipulation

Digital face manipulation has become a popular and fascinating way to to...

Smart, Deep Copy-Paste

In this work, we propose a novel system for smart copy-paste, enabling t...

Interactive Sketch & Fill: Multiclass Sketch-to-Image Translation

Arnab Ghosh 6:32 PM We propose an interactive GAN-based sketch-to-image ...

Flexible Portrait Image Editing with Fine-Grained Control

We develop a new method for portrait image editing, which supports fine-...

SketchHairSalon: Deep Sketch-based Hair Image Synthesis

Recent deep generative models allow real-time generation of hair images ...

Photorealistic Material Editing Through Direct Image Manipulation

Creating photorealistic materials for light transport algorithms require...

Please sign up or login with your details

Forgot password? Click here to reset