Paint it Black: Generating paintings from text descriptions

by   Mahnoor Shahid, et al.
Universität Saarland

Two distinct tasks - generating photorealistic pictures from given text prompts and transferring the style of a painting to a real image to make it appear as though it were done by an artist, have been addressed many times, and several approaches have been proposed to accomplish them. However, the intersection of these two, i.e., generating paintings from a given caption, is a relatively unexplored area with little data available. In this paper, we have explored two distinct strategies and have integrated them together. First strategy is to generate photorealistic images and then apply style transfer and the second strategy is to train an image generation model on real images with captions and then fine-tune it on captioned paintings later. These two models are evaluated using different metrics as well as a user study is conducted to get human feedback on the produced results.


page 1

page 3

page 5

page 6

page 7


Self-Contained Stylization via Steganography for Reverse and Serial Style Transfer

Style transfer has been widely applied to give real-world images a new a...

Prose for a Painting

Painting captions are often dry and simplistic which motivates us to des...

Selective Style Transfer for Text

This paper explores the possibilities of image style transfer applied to...

Deepfake Style Transfer Mixture: a First Forensic Ballistics Study on Synthetic Images

Most recent style-transfer techniques based on generative architectures ...

SemStyle: Learning to Generate Stylised Image Captions using Unaligned Text

Linguistic style is an essential part of written communication, with the...

Generating objects going well with the surroundings

Since the generative adversarial network has made a breakthrough in the ...

Image Generation With Neural Cellular Automatas

In this paper, we propose a novel approach to generate images (or other ...

Please sign up or login with your details

Forgot password? Click here to reset