EventDrop: data augmentation for event-based learning

06/07/2021
by   Fuqiang Gu, et al.
0

The advantages of event-sensing over conventional sensors (e.g., higher dynamic range, lower time latency, and lower power consumption) have spurred research into machine learning for event data. Unsurprisingly, deep learning has emerged as a competitive methodology for learning with event sensors; in typical setups, discrete and asynchronous events are first converted into frame-like tensors on which standard deep networks can be applied. However, over-fitting remains a challenge, particularly since event datasets remain small relative to conventional datasets (e.g., ImageNet). In this paper, we introduce EventDrop, a new method for augmenting asynchronous event data to improve the generalization of deep models. By dropping events selected with various strategies, we are able to increase the diversity of training data (e.g., to simulate various levels of occlusion). From a practical perspective, EventDrop is simple to implement and computationally low-cost. Experiments on two event datasets (N-Caltech101 and N-Cars) demonstrate that EventDrop can significantly improve the generalization performance across a variety of deep networks.

READ FULL TEXT
research
07/24/2022

Improved Regularization of Event-based Learning by Reversing and Drifting

Event camera has an enormous potential in challenging scenes for its adv...
research
10/27/2022

A Novel Approach for Neuromorphic Vision Data Compression based on Deep Belief Network

A neuromorphic camera is an image sensor that emulates the human eyes ca...
research
09/28/2020

Learning to Detect Objects with a 1 Megapixel Event Camera

Event cameras encode visual information with high temporal precision, lo...
research
12/10/2020

An Asynchronous Kalman Filter for Hybrid Event Cameras

We present an Asynchronous Kalman Filter (AKF) to reconstruct High Dynam...
research
12/21/2022

AEStream: Accelerated event-based processing with coroutines

Neuromorphic sensors imitate the sparse and event-based communication se...
research
05/21/2021

Deep-Learned Event Variables for Collider Phenomenology

The choice of optimal event variables is crucial for achieving the maxim...
research
11/02/2016

Deep counter networks for asynchronous event-based processing

Despite their advantages in terms of computational resources, latency, a...

Please sign up or login with your details

Forgot password? Click here to reset