StyleCLIPDraw: Coupling Content and Style in Text-to-Drawing Synthesis

11/04/2021
by   Peter Schaldenbrand, et al.
0

Generating images that fit a given text description using machine learning has improved greatly with the release of technologies such as the CLIP image-text encoder model; however, current methods lack artistic control of the style of image to be generated. We introduce StyleCLIPDraw which adds a style loss to the CLIPDraw text-to-drawing synthesis model to allow artistic control of the synthesized drawings in addition to control of the content via text. Whereas performing decoupled style transfer on a generated image only affects the texture, our proposed coupled approach is able to capture a style in both texture and shape, suggesting that the style of the drawing is coupled with the drawing process itself. More results and our code are available at https://github.com/pschaldenbrand/StyleCLIPDraw

READ FULL TEXT

page 1

page 3

research
02/24/2022

StyleCLIPDraw: Coupling Content and Style in Text-to-Drawing Translation

Generating images that fit a given text description using machine learni...
research
08/14/2019

Dual Adversarial Inference for Text-to-Image Synthesis

Synthesizing images from a given text description involves engaging two ...
research
06/28/2021

CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoders

This work presents CLIPDraw, an algorithm that synthesizes novel drawing...
research
11/23/2022

BiasBed – Rigorous Texture Bias Evaluation

The well-documented presence of texture bias in modern convolutional neu...
research
05/06/2017

Sukiyaki in French style: A novel system for transformation of dietary patterns

We propose a novel system which can transform a recipe into any selected...
research
09/13/2023

DreamStyler: Paint by Style Inversion with Text-to-Image Diffusion Models

Recent progresses in large-scale text-to-image models have yielded remar...
research
08/04/2023

Painterly Image Harmonization using Diffusion Model

Painterly image harmonization aims to insert photographic objects into p...

Please sign up or login with your details

Forgot password? Click here to reset