Semantic Image Inpainting Through Improved Wasserstein Generative Adversarial Networks

12/03/2018
by   Patricia Vitoria, et al.
0

Image inpainting is the task of filling-in missing regions of a damaged or incomplete image. In this work we tackle this problem not only by using the available visual data but also by incorporating image semantics through the use of generative models. Our contribution is twofold: First, we learn a data latent space by training an improved version of the Wasserstein generative adversarial network, for which we incorporate a new generator and discriminator architecture. Second, the learned semantic information is combined with a new optimization loss for inpainting whose minimization infers the missing content conditioned by the available data. It takes into account powerful contextual and perceptual content inherent in the image itself. The benefits include the ability to recover large regions by accumulating semantic information even it is not fully present in the damaged image. Experiments show that the presented method obtains qualitative and quantitative top-tier results in different experimental situations and also achieves accurate photo-realism comparable to state-of-the-art works.

READ FULL TEXT

page 1

page 2

page 7

page 8

page 9

page 10

research
07/26/2016

Semantic Image Inpainting with Deep Generative Models

Semantic image inpainting is a challenging task where large missing regi...
research
11/30/2018

Void Filling of Digital Elevation Models with Deep Generative Models

In recent years, advances in machine learning algorithms, cheap computat...
research
01/15/2023

Inpainting borehole images using Generative Adversarial Networks

In this paper, we propose a GAN-based approach for gap filling in boreho...
research
09/19/2019

Physics-informed semantic inpainting: Application to geostatistical modeling

A fundamental problem in geostatistical modeling is to infer the heterog...
research
06/16/2020

Reconstruction of turbulent data with deep generative models for semantic inpainting from TURB-Rot database

We study the applicability of tools developed by the computer vision com...
research
07/15/2021

Semantic Image Cropping

Automatic image cropping techniques are commonly used to enhance the aes...
research
10/13/2022

Two approaches to inpainting microstructure with deep convolutional generative adversarial networks

Imaging is critical to the characterisation of materials. However, even ...

Please sign up or login with your details

Forgot password? Click here to reset