Dynamic Object Comprehension: A Framework For Evaluating Artificial Visual Perception

02/17/2022
by   Scott Y. L. Chin, et al.
0

Augmented and Mixed Reality are emerging as likely successors to the mobile internet. However, many technical challenges remain. One of the key requirements of these systems is the ability to create a continuity between physical and virtual worlds, with the user's visual perception as the primary interface medium. Building this continuity requires the system to develop a visual understanding of the physical world. While there has been significant recent progress in computer vision and AI techniques such as image classification and object detection, success in these areas has not yet led to the visual perception required for these critical MR and AR applications. A significant issue is that current evaluation criteria are insufficient for these applications. To motivate and evaluate progress in this emerging area, there is a need for new metrics. In this paper we outline limitations of current evaluation criteria and propose new criteria.

READ FULL TEXT

page 3

page 4

research
01/15/2022

Realtime 3D Object Detection for Headsets

Mobile headsets should be capable of understanding 3D physical environme...
research
09/12/2018

Are object detection assessment criteria ready for maritime computer vision?

Maritime vessels equipped with visible and infrared cameras can compleme...
research
01/10/2020

Exploratory Study on User's Dynamic Visual Acuity and Quality Perception of Impaired Images

In this paper we assess the impact of head movement on user's visual acu...
research
07/19/2022

HoloLens 2 Technical Evaluation as Mixed Reality Guide

Mixed Reality (MR) is an evolving technology lying in the continuum span...
research
03/08/2019

Challenges in the Deployment of Visuo-Haptic Virtual Environments on the Internet

Haptic sensory feedback has been shown to complement the visual and audi...
research
04/14/2020

RoboTHOR: An Open Simulation-to-Real Embodied AI Platform

Visual recognition ecosystems (e.g. ImageNet, Pascal, COCO) have undenia...
research
03/15/2023

HoloTouch: Interacting with Mixed Reality Visualizations Through Smartphone Proxies

We contribute interaction techniques for augmenting mixed reality (MR) v...

Please sign up or login with your details

Forgot password? Click here to reset