Spatial and Angular Resolution Enhancement of Light Fields Using Convolutional Neural Networks

07/04/2017
by   M. Shahzeb Khan Gul, et al.
0

Light field imaging extends the traditional photography by capturing both spatial and angular distribution of light, which enables new capabilities, including post-capture refocusing, post-capture aperture control, and depth estimation from a single shot. Micro-lens array (MLA) based light field cameras offer a cost-effective approach to capture light field. A major drawback of MLA based light field cameras is low spatial resolution, which is due to the fact that a single image sensor is shared to capture both spatial and angular information. In this paper, we present a learning based light field enhancement approach. Both spatial and angular resolution of captured light field is enhanced using convolutional neural networks. The proposed method is tested with real light field data captured with a Lytro light field camera, clearly demonstrating spatial and angular resolution improvement.

READ FULL TEXT

page 2

page 3

page 6

page 7

page 8

page 9

research
09/27/2017

Light field super resolution through controlled micro-shifts of light field sensor

Light field cameras presents new capabilities, such as post-capture refo...
research
09/05/2020

Deep Sparse Light Field Refocusing

Light field photography enables to record 4D images, containing angular ...
research
04/06/2018

EPINET: A Fully-Convolutional Neural Network Using Epipolar Geometry for Depth from Light Field Images

Light field cameras capture both the spatial and the angular properties ...
research
05/08/2017

Light Field Video Capture Using a Learning-Based Hybrid Imaging System

Light field cameras have many advantages over traditional cameras, as th...
research
03/10/2021

Model-inspired Deep Learning for Light-Field Microscopy with Application to Neuron Localization

Light-field microscopes are able to capture spatial and angular informat...
research
11/27/2022

Quantifying spatial, temporal, angular and spectral structure of effective daylight in perceptually meaningful ways

We present a method to capture the 7-dimensional light field structure, ...
research
03/24/2021

Light Field Reconstruction Using Convolutional Network on EPI and Extended Applications

In this paper, a novel convolutional neural network (CNN)-based framewor...

Please sign up or login with your details

Forgot password? Click here to reset