Video Restoration with a Deep Plug-and-Play Prior

by   Antoine Monod, et al.

This paper presents a novel method for restoring digital videos via a Deep Plug-and-Play (PnP) approach. Under a Bayesian formalism, the method consists in using a deep convolutional denoising network in place of the proximal operator of the prior in an alternating optimization scheme. We distinguish ourselves from prior PnP work by directly applying that method to restore a digital video from a degraded video observation. This way, a network trained once for denoising can be repurposed for other video restoration tasks. Our experiments in video deblurring, super-resolution, and interpolation of random missing pixels all show a clear benefit to using a network specifically designed for video denoising, as it yields better restoration performance and better temporal stability than a single image network with similar denoising performance using the same PnP formulation. Moreover, our method compares favorably to applying a different state-of-the-art PnP scheme separately on each frame of the sequence. This opens new perspectives in the field of video restoration.


page 6

page 7

page 8


CurvPnP: Plug-and-play Blind Image Restoration with Deep Curvature Denoiser

Due to the development of deep learning-based denoisers, the plug-and-pl...

Generic 3D Convolutional Fusion for image restoration

Also recently, exciting strides forward have been made in the area of im...

On the Generalization of BasicVSR++ to Video Deblurring and Denoising

The exploitation of long-term information has been a long-standing probl...

Image Restoration using Plug-and-Play CNN MAP Denoisers

Plug-and-play denoisers can be used to perform generic image restoration...

Restore from Restored: Video Restoration with Pseudo Clean Video

In this paper, we propose a self-supervised video denoising method calle...

Manifold Modeling in Embedded Space: A Perspective for Interpreting "Deep Image Prior"

Deep image prior (DIP), which utilizes a deep convolutional network (Con...

EVRNet: Efficient Video Restoration on Edge Devices

Video transmission applications (e.g., conferencing) are gaining momentu...

Code Repositories

Please sign up or login with your details

Forgot password? Click here to reset