Diffusion Model Based Low-Light Image Enhancement for Space Satellite

06/25/2023
by   Yiman Zhu, et al.
0

Space-based visible camera is an important sensor for space situation awareness during proximity operations. However, visible camera can be easily affected by the low illumination in the space environment. Recently, deep learning approaches have achieved remarkable success in image enhancement of natural images datasets, but seldom applied in space due to the data bottleneck. In this article, we propose a data-driven method for low-light image enhancement (LLIE) of spin targets in space environment based on diffusion model. Firstly, a dataset collection scheme is devised. To reduce the domain gap and improve the diversity and quality of the dataset, we collect the data with the camera on a ground-test system imitating the low lighting conditions and relative attitude change of satellite in space. The satellite motion is controlled by a 6-DoF robot. To generate different poses, a advanced sampling method is combined with collision detection in physical simulation. The entire process is automated. Based on our dataset, a novel diffusion model is proposed. The diffusion and denoising process are directly conducted on the grayscale channel to save computational resources. To take advantage of the inner information of RGB channels, we rescale the RGB feature maps and insert them into the downsampling layers to help feature extraction. The enhanced results with our method have been verified to be better in image light enhancement and competitive in image quality compared with previous methods. To the best of our knowledge, this is the first work of LLIE using diffusion model.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

research
08/26/2020

Better Than Reference In Low Light Image Enhancement: Conditional Re-Enhancement Networks

Low light images suffer from severe noise, low brightness, low contrast,...
research
07/20/2023

Lighting up NeRF via Unsupervised Decomposition and Enhancement

Neural Radiance Field (NeRF) is a promising approach for synthesizing no...
research
05/17/2023

Pyramid Diffusion Models For Low-light Image Enhancement

Recovering noise-covered details from low-light images is challenging, a...
research
10/02/2022

Seeing Through The Noisy Dark: Toward Real-world Low-Light Image Enhancement and Denoising

Images collected in real-world low-light environment usually suffer from...
research
08/21/2020

Coloring panchromatic nighttime satellite images: Elastic maps vs. kernel smoothing and multivariate regression approach

Artificial light-at-night (ALAN), emitted from the ground and visible fr...
research
08/31/2023

Diffusion Models for Interferometric Satellite Aperture Radar

Probabilistic Diffusion Models (PDMs) have recently emerged as a very pr...
research
01/05/2019

Stereoscopic Dark Flash for Low-light Photography

In this work, we present a camera configuration for acquiring "stereosco...

Please sign up or login with your details

Forgot password? Click here to reset