DeepAI AI Chat
Log In Sign Up

Maximum entropy methods for texture synthesis: theory and practice

by   Valentin De Bortoli, et al.

Recent years have seen the rise of convolutional neural network techniques in exemplar-based image synthesis. These methods often rely on the minimization of some variational formulation on the image space for which the minimizers are assumed to be the solutions of the synthesis problem. In this paper we investigate, both theoretically and experimentally, another framework to deal with this problem using an alternate sampling/minimization scheme. First, we use results from information geometry to assess that our method yields a probability measure which has maximum entropy under some constraints in expectation. Then, we turn to the analysis of our method and we show, using recent results from the Markov chain literature, that its error can be explicitly bounded with constants which depend polynomially in the dimension even in the non-convex setting. This includes the case where the constraints are defined via a differentiable neural network. Finally, we present an extensive experimental study of the model, including a comparison with state-of-the-art methods and an extension to style transfer.


page 25

page 27

page 32

page 33

page 34

page 35

page 36

page 37


Macrocanonical Models for Texture Synthesis

In this article we consider macrocanonical models for texture synthesis....

Photo-realistic Facial Texture Transfer

Style transfer methods have achieved significant success in recent years...

Style-Transfer via Texture-Synthesis

Style-transfer is a process of migrating a style from a given image to t...

Optimal Textures: Fast and Robust Texture Synthesis and Style Transfer through Optimal Transport

This paper presents a light-weight, high-quality texture synthesis algor...

Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses

Recently, methods have been proposed that perform texture synthesis and ...

Maximum Entropy on the Mean: A Paradigm Shift for Regularization in Image Deblurring

Image deblurring is a notoriously challenging ill-posed inverse problem....

On Using Backpropagation for Speech Texture Generation and Voice Conversion

Inspired by recent work on neural network image generation which rely on...