UG^2: a Video Benchmark for Assessing the Impact of Image Restoration andEnhancement on Automatic Visual Recognition

by   Rosaura G. Vidal, et al.

Advances in image restoration and enhancement techniques have led to discussion about how such algorithmscan be applied as a pre-processing step to improve automatic visual recognition. In principle, techniques like deblurring and super-resolution should yield improvements by de-emphasizing noise and increasing signal in an input image. But the historically divergent goals of the computational photography and visual recognition communities have created a significant need for more work in this direction. To facilitate new research, we introduce a new benchmark dataset called UG^2, which contains three difficult real-world scenarios: uncontrolled videos taken by UAVs and manned gliders, as well as controlled videos taken on the ground. Over 160,000 annotated frames forhundreds of ImageNet classes are available, which are used for baseline experiments that assess the impact of known and unknown image artifacts and other conditions on common deep learning-based object classification approaches. Further, current image restoration and enhancement techniques are evaluated by determining whether or not theyimprove baseline classification performance. Results showthat there is plenty of room for algorithmic innovation, making this dataset a useful tool going forward.


page 3

page 4


Bridging the Gap Between Computational Photography and Visual Recognition

What is the current state-of-the-art for image restoration and enhanceme...

Temporal Kernel Consistency for Blind Video Super-Resolution

Deep learning-based blind super-resolution (SR) methods have recently ac...

Punctuation Restoration

Given the increasing number of livestreaming videos, automatic speech re...

Towards True Detail Restoration for Super-Resolution: A Benchmark and a Quality Metric

Super-resolution (SR) has become a widely researched topic in recent yea...

A deep learning framework for quality assessment and restoration in video endoscopy

Endoscopy is a routine imaging technique used for both diagnosis and min...

Long Scale Error Control in Low Light Image and Video Enhancement Using Equivariance

Image frames obtained in darkness are special. Just multiplying by a con...

Please sign up or login with your details

Forgot password? Click here to reset