Machine Learning for automatic identification of new minor species

by   Frederic Schmidt, et al.

One of the main difficulties to analyze modern spectroscopic datasets is due to the large amount of data. For example, in atmospheric transmittance spectroscopy, the solar occultation channel (SO) of the NOMAD instrument onboard the ESA ExoMars2016 satellite called Trace Gas Orbiter (TGO) had produced ∼10 millions of spectra in 20000 acquisition sequences since the beginning of the mission in April 2018 until 15 January 2020. Other datasets are even larger with ∼billions of spectra for OMEGA onboard Mars Express or CRISM onboard Mars Reconnaissance Orbiter. Usually, new lines are discovered after a long iterative process of model fitting and manual residual analysis. Here we propose a new method based on unsupervised machine learning, to automatically detect new minor species. Although precise quantification is out of scope, this tool can also be used to quickly summarize the dataset, by giving few endmembers ("source") and their abundances. We approximate the dataset non-linearity by a linear mixture of abundance and source spectra (endmembers). We used unsupervised source separation in form of non-negative matrix factorization to estimate those quantities. Several methods are tested on synthetic and simulation data. Our approach is dedicated to detect minor species spectra rather than precisely quantifying them. On synthetic example, this approach is able to detect chemical compounds present in form of 100 hidden spectra out of 10^4, at 1.5 times the noise level. Results on simulated spectra of NOMAD-SO targeting CH_4 show that detection limits goes in the range of 100-500 ppt in favorable conditions. Results on real martian data from NOMAD-SO show that CO_2 and H_2O are present, as expected, but CH_4 is absent. Nevertheless, we confirm a set of new unexpected lines in the database, attributed by ACS instrument Team to the CO_2 magnetic dipole.


Blind Source Separation for NMR Spectra with Negative Intensity

NMR spectral datasets, especially in systems with limited samples, can b...

Analyzing Raman Spectral Data without Separability Assumption

Raman spectroscopy is a well established tool for the analysis of vibrat...

Measuring chemical likeness of stars with RSCA

Identification of chemically similar stars using elemental abundances is...

Bayesian Source Separation Applied to Identifying Complex Organic Molecules in Space

Emission from a class of benzene-based molecules known as Polycyclic Aro...

Feature Selection for Better Spectral Characterization or: How I Learned to Start Worrying and Love Ensembles

An ever-looming threat to astronomical applications of machine learning ...

Data-driven Discovery of Diffuse Interstellar Bands with APOGEE Spectra

Data-driven models of stellar spectra are useful tools to study non-stel...

Please sign up or login with your details

Forgot password? Click here to reset