The Spatio-Temporal Poisson Point Process: A Simple Model for the Alignment of Event Camera Data

by   Cheng Gu, et al.

Event cameras, inspired by biological vision systems, provide a natural and data efficient representation of visual information. Visual information is acquired in the form of events that are triggered by local brightness changes. Each pixel location of the camera's sensor records events asynchronously and independently with very high temporal resolution. However, because most brightness changes are triggered by relative motion of the camera and the scene, the events recorded at a single sensor location seldom correspond to the same world point. To extract meaningful information from event cameras, it is helpful to register events that were triggered by the same underlying world point. In this work we propose a new model of event data that captures its natural spatio-temporal structure. We start by developing a model for aligned event data. That is, we develop a model for the data as though it has been perfectly registered already. In particular, we model the aligned data as a spatio-temporal Poisson point process. Based on this model, we develop a maximum likelihood approach to registering events that are not yet aligned. That is, we find transformations of the observed events that make them as likely as possible under our model. In particular we extract the camera rotation that leads to the best event alignment. We show new state of the art accuracy for rotational velocity estimation on the DAVIS 240C dataset. In addition, our method is also faster and has lower computational complexity than several competing methods.


page 1

page 7


Real-Time Panoramic Tracking for Event Cameras

Event cameras are a paradigm shift in camera technology. Instead of full...

Event-based Motion Segmentation with Spatio-Temporal Graph Cuts

Identifying independently moving objects is an essential task for dynami...

Transformer-Based Neural Marked Spatio Temporal Point Process Model for Football Match Events Analysis

With recently available football match event data that record the detail...

Neural multi-event forecasting on spatio-temporal point processes using probabilistically enriched transformers

Predicting discrete events in time and space has many scientific applica...

A Bayesian aoristic logistic regression to model spatio-temporal crime risk under the presence of interval-censored event times

From a statistical point of view, crime data present certain peculiariti...

ELM Solutions for Event-Based Systems

Whilst most engineered systems use signals that are continuous in time, ...

Ranking, and other Properties, of Elite Swimmers using Extreme Value Theory

The International Swimming Federation (FINA) uses a very simple points s...

Please sign up or login with your details

Forgot password? Click here to reset