Lensless multicore-fiber microendoscope for real-time tailored light field generation with phase encoder neural network (CoreNet)

11/24/2021
by   Jiawei Sun, et al.
0

The generation of tailored light with multi-core fiber (MCF) lensless microendoscopes is widely used in biomedicine. However, the computer-generated holograms (CGHs) used for such applications are typically generated by iterative algorithms, which demand high computation effort, limiting advanced applications like in vivo optogenetic stimulation and fiber-optic cell manipulation. The random and discrete distribution of the fiber cores induces strong spatial aliasing to the CGHs, hence, an approach that can rapidly generate tailored CGHs for MCFs is highly demanded. We demonstrate a novel phase encoder deep neural network (CoreNet), which can generate accurate tailored CGHs for MCFs at a near video-rate. Simulations show that CoreNet can speed up the computation time by two magnitudes and increase the fidelity of the generated light field compared to the conventional CGH techniques. For the first time, real-time generated tailored CGHs are on-the-fly loaded to the phase-only SLM for dynamic light fields generation through the MCF microendoscope in experiments. This paves the avenue for real-time cell rotation and several further applications that require real-time high-fidelity light delivery in biomedicine.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
07/25/2019

A Compact Light Field Camera for Real-Time Depth Estimation

Depth cameras are utilized in many applications. Recently light field ap...
research
11/30/2021

Sparse deep computer-generated holography for optical microscopy

Computer-generated holography (CGH) has broad applications such as direc...
research
10/23/2022

HiFi-WaveGAN: Generative Adversarial Network with Auxiliary Spectrogram-Phase Loss for High-Fidelity Singing Voice Generation

Entertainment-oriented singing voice synthesis (SVS) requires a vocoder ...
research
10/15/2018

Deep Surface Light Fields

A surface light field represents the radiance of rays originating from a...
research
04/29/2023

NSLF-OL: Online Learning of Neural Surface Light Fields alongside Real-time Incremental 3D Reconstruction

Immersive novel view generation is an important technology in the field ...
research
11/24/2021

Deep learning-based reduced order models for the real-time simulation of the nonlinear dynamics of microstructures

We propose a non-intrusive Deep Learning-based Reduced Order Model (DL-R...
research
03/26/2023

Hardware Acceleration of Progressive Refinement Radiosity using Nvidia RTX

A vital component of photo-realistic image synthesis is the simulation o...

Please sign up or login with your details

Forgot password? Click here to reset