Integration of Convolutional Neural Networks in Mobile Applications

by   Roger Creus Castanyer, et al.

When building Deep Learning (DL) models, data scientists and software engineers manage the trade-off between their accuracy, or any other suitable success criteria, and their complexity. In an environment with high computational power, a common practice is making the models go deeper by designing more sophisticated architectures. However, in the context of mobile devices, which possess less computational power, keeping complexity under control is a must. In this paper, we study the performance of a system that integrates a DL model as a trade-off between the accuracy and the complexity. At the same time, we relate the complexity to the efficiency of the system. With this, we present a practical study that aims to explore the challenges met when optimizing the performance of DL models becomes a requirement. Concretely, we aim to identify: (i) the most concerning challenges when deploying DL-based software in mobile applications; and (ii) the path for optimizing the performance trade-off. We obtain results that verify many of the identified challenges in the related work such as the availability of frameworks and the software-data dependency. We provide a documentation of our experience when facing the identified challenges together with the discussion of possible solutions to them. Additionally, we implement a solution to the sustainability of the DL models when deployed in order to reduce the severity of other identified challenges. Moreover, we relate the performance trade-off to a new defined challenge featuring the impact of the complexity in the obtained accuracy. Finally, we discuss and motivate future work that aims to provide solutions to the more open challenges found.


Energy Efficiency of Training Neural Network Architectures: An Empirical Study

The evaluation of Deep Learning models has traditionally focused on crit...

An Empirical Study towards Characterizing Deep Learning Development and Deployment across Different Frameworks and Platforms

Deep Learning (DL) has recently achieved tremendous success. A variety o...

OODIn: An Optimised On-Device Inference Framework for Heterogeneous Mobile Devices

Radical progress in the field of deep learning (DL) has led to unprecede...

Future Mobile Network Architecture: Challenges and Issues

The future mobile networks facing many challenges and to cope these chal...

An Empirical Study of Challenges in Converting Deep Learning Models

There is an increase in deploying Deep Learning (DL)-based software syst...

Model-Driven Beamforming Neural Networks

Beamforming is evidently a core technology in recent generations of mobi...

OpenDR: An Open Toolkit for Enabling High Performance, Low Footprint Deep Learning for Robotics

Existing Deep Learning (DL) frameworks typically do not provide ready-to...

Please sign up or login with your details

Forgot password? Click here to reset