Adaptive Image Sampling using Deep Learning and its Application on X-Ray Fluorescence Image Reconstruction

by   Qiqin Dai, et al.

This paper presents an adaptive image sampling algorithm based on Deep Learning (DL). The adaptive sampling mask generation network is jointly trained with an image inpainting network. The sampling rate is controlled in the mask generation network, and a binarization strategy is investigated to make the sampling mask binary. Besides the image sampling and reconstruction application, we show that the proposed adaptive sampling algorithm is able to speed up raster scan processes such as the X-Ray fluorescence (XRF) image scanning process. Recently XRF laboratory-based systems have evolved to lightweight and portable instruments thanks to technological advancements in both X-Ray generation and detection. However, the scanning time of an XRF image is usually long due to the long exposures requires (e.g., 100 μ s-1ms per point). We propose an XRF image inpainting approach to address the issue of long scanning time, thus speeding up the scanning process while still maintaining the possibility to reconstruct a high quality XRF image. The proposed adaptive image sampling algorithm is applied to the RGB image of the scanning target to generate the sampling mask. The XRF scanner is then driven according to the sampling mask to scan a subset of the total image pixels. Finally, we inpaint the scanned XRF image by fusing the RGB image to reconstruct the full scan XRF image. The experiments show that the proposed adaptive sampling algorithm is able to effectively sample the image and achieve a better reconstruction accuracy than that of the existing methods.


page 1

page 3

page 4

page 6

page 7

page 8

page 9

page 13


High-Quality Supersampling via Mask-reinforced Deep Learning for Real-time Rendering

To generate high quality rendering images for real time applications, it...

Learning Sparse Masks for Diffusion-based Image Inpainting

Diffusion-based inpainting is a powerful tool for the reconstruction of ...

Learning to Scan: A Deep Reinforcement Learning Approach for Personalized Scanning in CT Imaging

Computed Tomography (CT) takes X-ray measurements on the subjects to rec...

Adaptive sampling for scanning pixel cameras

A scanning pixel camera is a novel low-cost, low-power sensor that is no...

Deep Learning Guided Undersampling Mask Design for MR Image Reconstruction

In this paper, we propose a cross-domain networks that can achieve under...

A Deep Learning Framework to Reconstruct Face under Mask

While deep learning-based image reconstruction methods have shown signif...

Mask Iterative Hard Thresholding Algorithms for Sparse Image Reconstruction of Objects with Known Contour

We develop mask iterative hard thresholding algorithms (mask IHT and mas...

Please sign up or login with your details

Forgot password? Click here to reset