DeepAI AI Chat
Log In Sign Up

Exploring the Limits of Synthetic Creation of Solar EUV Images via Image-to-Image Translation

by   Valentina Salvatelli, et al.

The Solar Dynamics Observatory (SDO), a NASA multi-spectral decade-long mission that has been daily producing terabytes of observational data from the Sun, has been recently used as a use-case to demonstrate the potential of machine learning methodologies and to pave the way for future deep-space mission planning. In particular, the idea of using image-to-image translation to virtually produce extreme ultra-violet channels has been proposed in several recent studies, as a way to both enhance missions with less available channels and to alleviate the challenges due to the low downlink rate in deep space. This paper investigates the potential and the limitations of such a deep learning approach by focusing on the permutation of four channels and an encoder–decoder based architecture, with particular attention to how morphological traits and brightness of the solar surface affect the neural network predictions. In this work we want to answer the question: can synthetic images of the solar corona produced via image-to-image translation be used for scientific studies of the Sun? The analysis highlights that the neural network produces high-quality images over three orders of magnitude in count rate (pixel intensity) and can generally reproduce the covariance across channels within a 1 correspondence of extremely high energetic events like flares, and we argue that the reason is related to the rareness of such events posing a challenge to model training.


page 3

page 6

page 7

page 8

page 9

page 11

page 14

page 15


High Resolution Solar Image Generation using Generative Adversarial Networks

We applied Deep Learning algorithm known as Generative Adversarial Netwo...

Using U-Nets to Create High-Fidelity Virtual Observations of the Solar Corona

Understanding and monitoring the complex and dynamic processes of the Su...

A Machine-Learning-Ready Dataset Prepared from the Solar and Heliospheric Observatory Mission

We present a Python tool to generate a standard dataset from solar image...

Unrestricted Facial Geometry Reconstruction Using Image-to-Image Translation

It has been recently shown that neural networks can recover the geometri...

Paired Image to Image Translation for Strikethrough Removal From Handwritten Words

Transcribing struck-through, handwritten words, for example for the purp...

Adaptive Gradient Balancing for UndersampledMRI Reconstruction and Image-to-Image Translation

Recent accelerated MRI reconstruction models have used Deep Neural Netwo...

A Machine Learning Dataset Prepared From the NASA Solar Dynamics Observatory Mission

In this paper we present a curated dataset from the NASA Solar Dynamics ...