ParGAN: Learning Real Parametrizable Transformations

11/09/2022
by   Diego Martin Arroyo, et al.
0

Current methods for image-to-image translation produce compelling results, however, the applied transformation is difficult to control, since existing mechanisms are often limited and non-intuitive. We propose ParGAN, a generalization of the cycle-consistent GAN framework to learn image transformations with simple and intuitive controls. The proposed generator takes as input both an image and a parametrization of the transformation. We train this network to preserve the content of the input image while ensuring that the result is consistent with the given parametrization. Our approach does not require paired data and can learn transformations across several tasks and datasets. We show how, with disjoint image domains with no annotated parametrization, our framework can create smooth interpolations as well as learn multiple transformations simultaneously.

READ FULL TEXT

page 13

page 15

page 16

page 18

page 19

page 22

page 23

page 25

research
10/11/2018

SingleGAN: Image-to-Image Translation by a Single-Generator Network using Multiple Generative Adversarial Learning

Image translation is a burgeoning field in computer vision where the goa...
research
02/25/2019

TraVeLGAN: Image-to-image Translation by Transformation Vector Learning

Interest in image-to-image translation has grown substantially in recent...
research
06/23/2020

Image-to-image Mapping with Many Domains by Sparse Attribute Transfer

Unsupervised image-to-image translation consists of learning a pair of m...
research
11/25/2021

Quantised Transforming Auto-Encoders: Achieving Equivariance to Arbitrary Transformations in Deep Networks

In this work we investigate how to achieve equivariance to input transfo...
research
10/24/2019

Guided Image-to-Image Translation with Bi-Directional Feature Transformation

We address the problem of guided image-to-image translation where we tra...
research
07/10/2017

Deep Bilateral Learning for Real-Time Image Enhancement

Performance is a critical challenge in mobile image processing. Given a ...
research
12/09/2020

Lipschitz Regularized CycleGAN for Improving Semantic Robustness in Unpaired Image-to-image Translation

For unpaired image-to-image translation tasks, GAN-based approaches are ...

Please sign up or login with your details

Forgot password? Click here to reset