EdgeXAR: A 6-DoF Camera Multi-target Interaction Framework for MAR with User-friendly Latency Compensation

by   Wenxiao Zhang, et al.

The computational capabilities of recent mobile devices enable the processing of natural features for Augmented Reality (AR), but the scalability is still limited by the devices' computation power and available resources. In this paper, we propose EdgeXAR, a mobile AR framework that utilizes the advantages of edge computing through task offloading to support flexible camera-based AR interaction. We propose a hybrid tracking system for mobile devices that provides lightweight tracking with 6 Degrees of Freedom and hides the offloading latency from users' perception. A practical, reliable and unreliable communication mechanism is used to achieve fast response and consistency of crucial information. We also propose a multi-object image retrieval pipeline that executes fast and accurate image recognition tasks on the cloud and edge servers. Extensive experiments are carried out to evaluate the performance of EdgeXAR by building mobile AR Apps upon it. Regarding the Quality of Experience (QoE), the mobile AR Apps powered by EdgeXAR framework run on average at the speed of 30 frames per second with precise tracking of only 1 2 pixel errors and accurate image recognition of at least 97 Vuforia, one of the leading commercial AR frameworks, EdgeXAR transmits 87 less data while providing a stable 30 FPS performance and reducing the offloading latency by 50 to 70 facilitates the large-scale deployment of AR as the next generation of ubiquitous interfaces.


page 2

page 6

page 8

page 9

page 11

page 13

page 14


CloudAR: A Cloud-based Framework for Mobile Augmented Reality

Computation capabilities of recent mobile devices enable natural feature...

An Edge-Computing Based Architecture for Mobile Augmented Reality

In order to mitigate the long processing delay and high energy consumpti...

Improving Image-recognition Edge Caches with a Generative Adversarial Network

Image recognition is an essential task in several mobile applications. F...

Emergent communication for AR

Mobile augmented reality (MAR) is widely acknowledged as one of the ubiq...

Immersion on the Edge: A Cooperative Framework for Mobile Immersive Computing

Immersive computing (IC) technologies such as virtual reality and augmen...

Mixed reality hologram slicer (mxdR-HS): a marker-less tangible user interface for interactive holographic volume visualization

Mixed reality head-mounted displays (mxdR-HMD) have the potential to vis...

Diffusing Your Mobile Apps: Extending In-Network Function Virtualization to Mobile Function Offloading

Motivated by the huge disparity between the limited battery capacity of ...

Please sign up or login with your details

Forgot password? Click here to reset