Using Convolutional Neural Networks for Relative Pose Estimation of a Non-Cooperative Spacecraft with Thermal Infrared Imagery

05/28/2021
by   Maxwell Hogan, et al.
0

Recent interest in on-orbit servicing and Active Debris Removal (ADR) missions have driven the need for technologies to enable non-cooperative rendezvous manoeuvres. Such manoeuvres put heavy burden on the perception capabilities of a chaser spacecraft. This paper demonstrates Convolutional Neural Networks (CNNs) capable of providing an initial coarse pose estimation of a target from a passive thermal infrared camera feed. Thermal cameras offer a promising alternative to visible cameras, which struggle in low light conditions and are susceptible to overexposure. Often, thermal information on the target is not available a priori; this paper therefore proposes using visible images to train networks. The robustness of the models is demonstrated on two different targets, first on synthetic data, and then in a laboratory environment for a realistic scenario that might be faced during an ADR mission. Given that there is much concern over the use of CNN in critical applications due to their black box nature, we use innovative techniques to explain what is important to our network and fault conditions.

READ FULL TEXT

page 4

page 5

page 6

page 7

page 9

page 11

page 12

page 13

research
03/01/2021

Unsupervised Depth and Ego-motion Estimation for Monocular Thermal Video using Multi-spectral Consistency Loss

Most of the deep-learning based depth and ego-motion networks have been ...
research
01/07/2021

A Large-Scale, Time-Synchronized Visible and Thermal Face Dataset

Thermal face imagery, which captures the naturally emitted heat from the...
research
01/23/2021

Real-Time, Flight-Ready, Non-Cooperative Spacecraft Pose Estimation Using Monocular Imagery

A key requirement for autonomous on-orbit proximity operations is the es...
research
08/23/2021

ChiNet: Deep Recurrent Convolutional Learning for Multimodal Spacecraft Pose Estimation

This paper presents an innovative deep learning pipeline which estimates...
research
06/24/2019

Pose Estimation for Non-Cooperative Rendezvous Using Neural Networks

This work introduces the Spacecraft Pose Network (SPN) for on-board esti...
research
09/19/2018

Pose Estimation for Non-Cooperative Spacecraft Rendezvous Using Convolutional Neural Networks

On-board estimation of the pose of an uncooperative target spacecraft is...
research
03/15/2023

Privacy-Preserving Video Conferencing via Thermal-Generative Images

Due to the COVID-19 epidemic, video conferencing has evolved as a new pa...

Please sign up or login with your details

Forgot password? Click here to reset