Transfer Learning in General Lensless Imaging through Scattering Media

by   Yukuan Yang, et al.

Recently deep neural networks (DNNs) have been successfully introduced to the field of lensless imaging through scattering media. By solving an inverse problem in computational imaging, DNNs can overcome several shortcomings in the conventional lensless imaging through scattering media methods, namely, high cost, poor quality, complex control, and poor anti-interference. However, for training, a large number of training samples on various datasets have to be collected, with a DNN trained on one dataset generally performing poorly for recovering images from another dataset. The underlying reason is that lensless imaging through scattering media is a high dimensional regression problem and it is difficult to obtain an analytical solution. In this work, transfer learning is proposed to address this issue. Our main idea is to train a DNN on a relatively complex dataset using a large number of training samples and fine-tune the last few layers using very few samples from other datasets. Instead of the thousands of samples required to train from scratch, transfer learning alleviates the problem of costly data acquisition. Specifically, considering the difference in sample sizes and similarity among datasets, we propose two DNN architectures, namely LISMU-FCN and LISMU-OCN, and a balance loss function designed for balancing smoothness and sharpness. LISMU-FCN, with much fewer parameters, can achieve imaging across similar datasets while LISMU-OCN can achieve imaging across significantly different datasets. What's more, we establish a set of simulation algorithms which are close to the real experiment, and it is of great significance and practical value in the research on lensless scattering imaging. In summary, this work provides a new solution for lensless imaging through scattering media using transfer learning in DNNs.


page 6

page 11

page 12

page 13

page 14


All-Transfer Learning for Deep Neural Networks and its Application to Sepsis Classification

In this article, we propose a transfer learning method for deep neural n...

Physics-guided Loss Functions Improve Deep Learning Performance in Inverse Scattering

Solving electromagnetic inverse scattering problems (ISPs) is challengin...

Automatic Differentiation for All Photons Imaging to See Inside Volumetric Scattering Media

Imaging through dense scattering media - such as biological tissue, fog,...

Overfreezing Meets Overparameterization: A Double Descent Perspective on Transfer Learning of Deep Neural Networks

We study the generalization behavior of transfer learning of deep neural...

Neural network for estimation of optical characteristics of optically active and turbid scattering media

One native source of quality deterioration in medical imaging, and espec...

Deep network series for large-scale high-dynamic range imaging

We propose a new approach for large-scale high-dynamic range computation...

Solving 3D Radar Imaging Inverse Problems with a Multi-cognition Task-oriented Framework

This work focuses on 3D Radar imaging inverse problems. Current methods ...

Please sign up or login with your details

Forgot password? Click here to reset