SILVR: A Synthetic Immersive Large-Volume Plenoptic Dataset

04/20/2022
by   Martijn Courteaux, et al.
0

In six-degrees-of-freedom light-field (LF) experiences, the viewer's freedom is limited by the extent to which the plenoptic function was sampled. Existing LF datasets represent only small portions of the plenoptic function, such that they either cover a small volume, or they have limited field of view. Therefore, we propose a new LF image dataset "SILVR" that allows for six-degrees-of-freedom navigation in much larger volumes while maintaining full panoramic field of view. We rendered three different virtual scenes in various configurations, where the number of views ranges from 642 to 2226. One of these scenes (called Zen Garden) is a novel scene, and is made publicly available. We chose to position the virtual cameras closely together in large cuboid and spherical organisations (2.2m^3 to 48m^3), equipped with 180 fish-eye lenses. Every view is rendered to a color image and depth map of 2048px × 2048px. Additionally, we present the software used to automate the multi-view rendering process, as well as a lens-reprojection tool that converts between images with panoramic or fish-eye projection to a standard rectilinear (i.e., perspective) projection. Finally, we demonstrate how the proposed dataset and software can be used to evaluate LF coding/rendering techniques(in this case for training NeRFs with instant-ngp). As such, we provide the first publicly-available LF dataset for large volumes of light with full panoramic field of view

READ FULL TEXT
research
05/29/2018

Surface Light Field Compression using a Point Cloud Codec

Light field (LF) representations aim to provide photo-realistic, free-vi...
research
12/08/2022

ORCa: Glossy Objects as Radiance Field Cameras

Reflections on glossy objects contain valuable and hidden information ab...
research
03/31/2022

Casual 6-DoF: free-viewpoint panorama using a handheld 360 camera

Six degrees-of-freedom (6-DoF) video provides telepresence by enabling u...
research
03/10/2023

Aleth-NeRF: Low-light Condition View Synthesis with Concealing Fields

Common capture low-light scenes are challenging for most computer vision...
research
11/23/2021

Dataset of Spatial Room Impulse Responses in a Variable Acoustics Room for Six Degrees-of-Freedom Rendering and Analysis

Room acoustics measurements are used in many areas of audio research, fr...
research
10/10/2022

NeRF2Real: Sim2real Transfer of Vision-guided Bipedal Motion Skills using Neural Radiance Fields

We present a system for applying sim2real approaches to "in the wild" sc...
research
03/24/2019

PLMP - Point-Line Minimal Problems in Complete Multi-View Visibility

We present a complete classification of all minimal problems for generic...

Please sign up or login with your details

Forgot password? Click here to reset