Deep Video Harmonization with Color Mapping Consistency

05/02/2022
by   Xinyuan Lu, et al.
21

Video harmonization aims to adjust the foreground of a composite video to make it compatible with the background. So far, video harmonization has only received limited attention and there is no public dataset for video harmonization. In this work, we construct a new video harmonization dataset HYouTube by adjusting the foreground of real videos to create synthetic composite videos. Moreover, we consider the temporal consistency in video harmonization task. Unlike previous works which establish the spatial correspondence, we design a novel framework based on the assumption of color mapping consistency, which leverages the color mapping of neighboring frames to refine the current frame. Extensive experiments on our HYouTube dataset prove the effectiveness of our proposed framework. Our dataset and code are available at https://github.com/bcmi/Video-Harmonization-Dataset-HYouTube.

READ FULL TEXT

page 1

page 4

page 6

page 9

page 11

page 12

research
09/18/2021

HYouTube: Video Harmonization Dataset

Video composition aims to generate a composite video by combining the fo...
research
06/01/2022

CcHarmony: Color-checker based Image Harmonization Dataset

Image harmonization targets at adjusting the foreground in a composite i...
research
08/09/2023

Foreground Object Search by Distilling Composite Image Feature

Foreground object search (FOS) aims to find compatible foreground object...
research
09/07/2023

The Making and Breaking of Camouflage

Not all camouflages are equally effective, as even a partially visible c...
research
08/18/2021

A New Journey from SDRTV to HDRTV

Nowadays modern displays are capable to render video content with high d...
research
12/17/2022

Painterly Image Harmonization in Dual Domains

Image harmonization aims to produce visually harmonious composite images...
research
04/28/2022

Two Decades of Colorization and Decolorization for Images and Videos

Colorization is a computer-aided process, which aims to give color to a ...

Please sign up or login with your details

Forgot password? Click here to reset