Let's Roll: Synthetic Dataset Analysis for Pedestrian Detection Across Different Shutter Types

by   Yue Hu, et al.

Computer vision (CV) pipelines are typically evaluated on datasets processed by image signal processing (ISP) pipelines even though, for resource-constrained applications, an important research goal is to avoid as many ISP steps as possible. In particular, most CV datasets consist of global shutter (GS) images even though most cameras today use a rolling shutter (RS). This paper studies the impact of different shutter mechanisms on machine learning (ML) object detection models on a synthetic dataset that we generate using the advanced simulation capabilities of Unreal Engine 5 (UE5). In particular, we train and evaluate mainstream detection models with our synthetically-generated paired GS and RS datasets to ascertain whether there exists a significant difference in detection accuracy between these two shutter modalities, especially when capturing low-speed objects (e.g., pedestrians). The results of this emulation framework indicate the performance between them are remarkably congruent for coarse-grained detection (mean average precision (mAP) for IOU=0.5), but have significant differences for fine-grained measures of detection accuracy (mAP for IOU=0.5:0.95). This implies that ML pipelines might not need explicit correction for RS for many object detection applications, but mitigating RS effects in ISP-less ML pipelines that target fine-grained location of the objects may need additional research.


page 2

page 3


Commonsense Knowledge Assisted Deep Learning for Resource-constrained and Fine-grained Object Detection

In this paper, we consider fine-grained image object detection in resour...

Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines

Input pipelines, which ingest and transform input data, are an essential...

REIN: A Comprehensive Benchmark Framework for Data Cleaning Methods in ML Pipelines

Nowadays, machine learning (ML) plays a vital role in many aspects of ou...

SI-Score: An image dataset for fine-grained analysis of robustness to object location, rotation and size

Before deploying machine learning models it is critical to assess their ...

Validation of object detection in UAV-based images using synthetic data

Object detection is increasingly used onboard Unmanned Aerial Vehicles (...

Assessing gender fairness in EEG-based machine learning detection of Parkinson's disease: A multi-center study

As the number of automatic tools based on machine learning (ML) and rest...

Towards practical object detection for weed spraying in precision agriculture

The evolution of smaller, faster processors and cheaper digital storage ...

Please sign up or login with your details

Forgot password? Click here to reset