Realistic text replacement with non-uniform style conditioning

06/07/2020
by   Arseny Nerinovsky, et al.
0

In this work, we study the possibility of realistic text replacement, the goal of which is to replace text present in the image with user-supplied text. The replacement should be performed in a way that will not allow distinguishing the resulting image from the original one. We achieve this goal by developing a novel non-uniform style conditioning layer and apply it to an encoder-decoder ResNet based architecture. The resulting model is a single-stage model, with no post-processing. The proposed model achieves realistic text replacement and outperforms existing approaches on ICDAR MLT.

READ FULL TEXT

page 2

page 5

page 6

research
04/25/2018

Two monads for graphs

An introduction to algebras for graphs, based on Courcelle's algebras of...
research
09/06/2021

STRIVE: Scene Text Replacement In Videos

We propose replacing scene text in videos using deep style transfer and ...
research
05/24/2023

DiffBlender: Scalable and Composable Multimodal Text-to-Image Diffusion Models

The recent progress in diffusion-based text-to-image generation models h...
research
10/26/2020

Optimal Importance Sampling for Federated Learning

Federated learning involves a mixture of centralized and decentralized p...
research
06/04/2020

Hash Cracking Benchmarking of Replacement Patterns

In this paper, we explain our methodology to identify replacement patter...
research
08/26/2021

Can the Transformer Be Used as a Drop-in Replacement for RNNs in Text-Generating GANs?

In this paper we address the problem of fine-tuned text generation with ...
research
07/06/2023

Synthesizing Artistic Cinemagraphs from Text

We introduce Text2Cinemagraph, a fully automated method for creating cin...

Please sign up or login with your details

Forgot password? Click here to reset