Elixir: A system to enhance data quality for multiple analytics on a video stream

by   Sibendu Paul, et al.

IoT sensors, especially video cameras, are ubiquitously deployed around the world to perform a variety of computer vision tasks in several verticals including retail, healthcare, safety and security, transportation, manufacturing, etc. To amortize their high deployment effort and cost, it is desirable to perform multiple video analytics tasks, which we refer to as Analytical Units (AUs), off the video feed coming out of every camera. In this paper, we first show that in a multi-AU setting, changing the camera setting has disproportionate impact on different AUs performance. In particular, the optimal setting for one AU may severely degrade the performance for another AU, and further the impact on different AUs varies as the environmental condition changes. We then present Elixir, a system to enhance the video stream quality for multiple analytics on a video stream. Elixir leverages Multi-Objective Reinforcement Learning (MORL), where the RL agent caters to the objectives from different AUs and adjusts the camera setting to simultaneously enhance the performance of all AUs. To define the multiple objectives in MORL, we develop new AU-specific quality estimator values for each individual AU. We evaluate Elixir through real-world experiments on a testbed with three cameras deployed next to each other (overlooking a large enterprise parking lot) running Elixir and two baseline approaches, respectively. Elixir correctly detects 7.1 (22,068) and 5.0 670.4 time-sharing approaches, respectively. It also detects 115 license plates, far more than the time-sharing approach (7) and the default setting (0).


page 4

page 5

page 10


APT: Adaptive Perceptual quality based camera Tuning using reinforcement learning

Cameras are increasingly being deployed in cities, enterprises and roads...

CamTuner: Reinforcement-Learning based System for Camera Parameter Tuning to enhance Analytics

Complex sensors like video cameras include tens of configurable paramete...

Scaling Video Analytics Systems to Large Camera Deployments

New computer vision techniques, which enable accurate extraction of insi...

CONVINCE: Collaborative Cross-Camera Video Analytics at the Edge

Today, video cameras are deployed in dense for monitoring physical place...

Detect and Classify IoT Camera Traffic

Deployment of IoT cameras in an organization threatens security and priv...

A Reinforcement-Learning-Based Energy-Efficient Framework for Multi-Task Video Analytics Pipeline

Deep-learning-based video processing has yielded transformative results ...

Detecting Work Zones in SHRP 2 NDS Videos Using Deep Learning Based Computer Vision

Naturalistic driving studies seek to perform the observations of human d...

Please sign up or login with your details

Forgot password? Click here to reset