Quadtree Driven Lossy Event Compression

05/03/2020
by   Srutarshi Banerjee, et al.
0

Event cameras are emerging bio-inspired sensors that offer salient benefits over traditional cameras. With high speed, high dynamic range, and low power consumption, event cameras have been increasingly employed to solve existing as well as novel visual and robotics tasks. Despite rapid advancement in event-based vision, event data compression is facing growing demand, yet remains elusively challenging and not effectively addressed. The major challenge is the unique data form, i.e., a stream of four-attribute events, encoding the spatial locations and the timestamp of each event, with a polarity representing the brightness increase/decrease. While events encode temporal variations at high speed, they omit rich spatial information, which is critical for image/video compression. In this paper, we perform lossy event compression (LEC) based on a quadtree (QT) segmentation map derived from an adjacent image. The QT structure provides a priority map for the 3D space-time volume, albeit in a 2D manner. LEC is performed by first quantizing the events over time, and then variably compressing the events within each QT block via Poisson Disk Sampling in 2D space for each quantized time. Our QT-LEC has flexibility in accordance with the bit-rate requirement. Experimentally, we show results with state-of-the-art coding performance. We further evaluate the performance in event-based applications such as image reconstruction and corner detection.

READ FULL TEXT

page 7

page 10

page 11

research
04/17/2019

Event-based Vision: A Survey

Event cameras are bio-inspired sensors that work radically different fro...
research
10/27/2022

A Novel Approach for Neuromorphic Vision Data Compression based on Deep Belief Network

A neuromorphic camera is an image sensor that emulates the human eyes ca...
research
03/22/2021

AET-EFN: A Versatile Design for Static and Dynamic Event-Based Vision

The neuromorphic event cameras, which capture the optical changes of a s...
research
03/17/2018

Robust event-stream pattern tracking based on correlative filter

Object tracking based on retina-inspired and event-based dynamic vision ...
research
06/09/2022

How Asynchronous Events Encode Video

As event-based sensing gains in popularity, theoretical understanding is...
research
03/10/2021

Time-Ordered Recent Event (TORE) Volumes for Event Cameras

Event cameras are an exciting, new sensor modality enabling high-speed i...
research
02/26/2019

Event-driven Video Frame Synthesis

Video frame synthesis is an active computer vision problem which has app...

Please sign up or login with your details

Forgot password? Click here to reset