ClusterNet: Detecting Small Objects in Large Scenes by Exploiting Spatio-Temporal Information

by   Rodney LaLonde, et al.

Object detection in wide area motion imagery (WAMI) has drawn the attention of the computer vision research community for a number of years. WAMI proposes a number of unique challenges including extremely small object sizes, both sparse and densely-packed objects, and extremely large search spaces (large video frames). Nearly all state-of-the-art methods in WAMI object detection report that appearance-based classifiers fail in this challenging data and instead rely almost entirely on motion information in the form of background subtraction or frame-differencing. In this work, we experimentally verify the failure of appearance-based classifiers in WAMI, such as Faster R-CNN and a heatmap-based fully convolutional neural network (CNN), and propose a novel two-stage spatio-temporal CNN which effectively and efficiently combines both appearance and motion information to significantly surpass the state-of-the-art in WAMI object detection. To reduce the large search space, the first stage (ClusterNet) takes in a set of extremely large video frames, combines the motion and appearance information within the convolutional architecture, and proposes regions of objects of interest (ROOBI). These ROOBI can contain from one to clusters of several hundred objects due to the large video frame size and varying object density in WAMI. The second stage (FoveaNet) then estimates the centroid location of all objects in that given ROOBI simultaneously via heatmap estimation. The proposed method exceeds state-of-the-art results on the WPAFB 2009 dataset by 5-16 objects, as well as being the first proposed method in wide area motion imagery to detect completely stationary objects.


page 5

page 10

page 11

page 12

page 13

page 14

page 15

page 16


HM-Net: A Regression Network for Object Center Detection and Tracking on Wide Area Motion Imagery

Wide Area Motion Imagery (WAMI) yields high resolution images with a lar...

Detecting and Tracking Small Moving Objects in Wide Area Motion Imagery (WAMI) Using Convolutional Neural Networks (CNNs)

This paper proposes an approach to detect moving objects in Wide Area Mo...

Robust Detection of Objects under Periodic Motion with Gaussian Process Filtering

Object Detection (OD) is an important task in Computer Vision with many ...

DeepSperm: A robust and real-time bull sperm-cell detection in densely populated semen videos

Background and Objective: Object detection is a primary research interes...

Forecasting Hands and Objects in Future Frames

This paper presents an approach to forecast future presence and location...

Felzenszwalb-Baum-Welch: Event Detection by Changing Appearance

We propose a method which can detect events in videos by modeling the ch...

FMODetect: Robust Detection and Trajectory Estimation of Fast Moving Objects

We propose the first learning-based approach for detection and trajector...

Please sign up or login with your details

Forgot password? Click here to reset