AeroRIT: A New Scene for Hyperspectral Image Analysis

by   Aneesh Rangnekar, et al.

Hyperspectral imagery oriented research like image super-resolution and image fusion is often conducted on open source datasets captured via point and shoot camera setups (ICVL, CAVE) that have high signal to noise ratio. In contrast, spectral images captured from aircrafts have low spatial resolution and suffer from higher noise interference due to factors pertaining to atmospheric conditions. This leads to challenges in extracting contextual information from the captured data as convolutional neural networks are very noise-sensitive and slight atmospheric changes can often lead to a large distribution spread in spectral values overlooking the same object. To understand the challenges faced with aerial spectral data, we collect and label a flight line over the university campus, AeroRIT, and explore the task of semantic segmentation. To the best of our knowledge, this is the first comprehensive large-scale hyperspectral scene with nearly seven million semantic annotations for identifying cars, roads and buildings. We compare the performance of three popular architectures - SegNet, U-Net and Res-U-Net, for scene understanding and object identification. To date, aerial hyperspectral image analysis has been restricted to small datasets with limited train/test splits capabilities. We believe AeroRIT will help advance the research in the field with a more complex object distribution.


page 1

page 3

page 4

page 5

page 7


Aerial Spectral Super-Resolution using Conditional Adversarial Networks

Inferring spectral signatures from ground based natural images has acqui...

Fusformer: A Transformer-based Fusion Approach for Hyperspectral Image Super-resolution

Hyperspectral image has become increasingly crucial due to its abundant ...

Aerial hyperspectral imagery and deep neural networks for high-throughput yield phenotyping in wheat

Crop production needs to increase in a sustainable manner to meet the gr...

3D Terrain Segmentation in the SWIR Spectrum

We focus on the automatic 3D terrain segmentation problem using hyperspe...

Coupled Convolutional Neural Network with Adaptive Response Function Learning for Unsupervised Hyperspectral Super-Resolution

Due to the limitations of hyperspectral imaging systems, hyperspectral i...

HPFormer: Hyperspectral image prompt object tracking

Hyperspectral imagery contains abundant spectral information beyond the ...

Needles in Haystacks: On Classifying Tiny Objects in Large Images

In some computer vision domains, such as medical or hyperspectral imagin...

Please sign up or login with your details

Forgot password? Click here to reset