Image Inpainting for High-Resolution Textures using CNN Texture Synthesis

12/08/2017
by   Pascal Laube, et al.
0

Deep neural networks have been successfully applied to problems such as image segmentation, image super-resolution, coloration and image inpainting. In this work we propose the use of convolutional neural networks (CNN) for image inpainting of large regions in high-resolution textures. Due to limited computational resources processing high-resolution images with neural networks is still an open problem. Existing methods separate inpainting of global structure and the transfer of details, which leads to blurry results and loss of global coherence in the detail transfer step. Based on advances in texture synthesis using CNNs we propose patch-based image inpainting by a single network topology that is able to optimize for global as well as detail texture statistics. Our method is capable of filling large inpainting regions, oftentimes exceeding quality of comparable methods for images of high-resolution (2048x2048px). For reference patch look-up we propose to use the same summary statistics that are used in the inpainting process.

READ FULL TEXT

page 2

page 4

page 5

page 7

page 8

page 9

page 10

research
12/04/2020

Generator Pyramid for High-Resolution Image Inpainting

Inpainting high-resolution images with large holes challenges existing d...
research
04/27/2021

Deep Two-Stage High-Resolution Image Inpainting

In recent years, the field of image inpainting has developed rapidly, le...
research
09/28/2020

Texture Memory-Augmented Deep Patch-Based Image Inpainting

Patch-based methods and deep networks have been employed to tackle image...
research
11/30/2016

High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesis

Recent advances in deep learning have shown exciting promise in filling ...
research
11/24/2012

Texture Modeling with Convolutional Spike-and-Slab RBMs and Deep Extensions

We apply the spike-and-slab Restricted Boltzmann Machine (ssRBM) to text...
research
04/10/2018

Large Field and High Resolution: Detecting Needle in Haystack

The growing use of convolutional neural networks (CNN) for a broad range...
research
02/01/2020

Large Hole Image Inpainting With Compress-Decompression Network

Image inpainting technology can patch images with missing pixels. Existi...

Please sign up or login with your details

Forgot password? Click here to reset