SpikeCV: Open a Continuous Computer Vision Era

03/21/2023
by   Yajing Zheng, et al.
0

SpikeCV is a new open-source computer vision platform for the spike camera, which is a neuromorphic visual sensor that has developed rapidly in recent years. In the spike camera, each pixel position directly accumulates the light intensity and asynchronously fires spikes. The output binary spikes can reach a frequency of 40,000 Hz. As a new type of visual expression, spike sequence has high spatiotemporal completeness and preserves the continuous visual information of the external world. Taking advantage of the low latency and high dynamic range of the spike camera, many spike-based algorithms have made significant progress, such as high-quality imaging and ultra-high-speed target detection. To build up a community ecology for the spike vision to facilitate more users to take advantage of the spike camera, SpikeCV provides a variety of ultra-high-speed scene datasets, hardware interfaces, and an easy-to-use modules library. SpikeCV focuses on encapsulation for spike data, standardization for dataset interfaces, modularization for vision tasks, and real-time applications for challenging scenes. With the advent of the open-source Python ecosystem, modules of SpikeCV can be used as a Python library to fulfilled most of the numerical analysis needs of researchers. We demonstrate the efficiency of the SpikeCV on offline inference and real-time applications. The project repository address are <https://openi.pcl.ac.cn/Cordium/SpikeCV> and <https://github.com/Zyj061/SpikeCV>

READ FULL TEXT

page 1

page 4

page 7

page 8

research
08/06/2023

Recurrent Spike-based Image Restoration under General Illumination

Spike camera is a new type of bio-inspired vision sensor that records li...
research
01/04/2022

A Robust Visual Sampling Model Inspired by Receptive Field

Spike camera mimicking the retina fovea can report per-pixel luminance i...
research
04/10/2021

Spike Camera and Its Coding Methods

This paper introduces a spike camera with a distinct video capture schem...
research
07/03/2023

Unveiling the Potential of Spike Streams for Foreground Occlusion Removal from Densely Continuous Views

The extraction of a clean background image by removing foreground occlus...
research
07/20/2019

A Retina-inspired Sampling Method for Visual Texture Reconstruction

Conventional frame-based camera is not able to meet the demand of rapid ...
research
12/20/2019

An Efficient Coding Method for Spike Camera using Inter-Spike Intervals

Recently, a novel bio-inspired spike camera has been proposed, which con...
research
06/25/2023

SpikeCodec: An End-to-end Learned Compression Framework for Spiking Camera

Recently, the bio-inspired spike camera with continuous motion recording...

Please sign up or login with your details

Forgot password? Click here to reset