Continual Learning at the Edge: Real-Time Training on Smartphone Devices

05/24/2021
by   Lorenzo Pellegrini, et al.
21

On-device training for personalized learning is a challenging research problem. Being able to quickly adapt deep prediction models at the edge is necessary to better suit personal user needs. However, adaptation on the edge poses some questions on both the efficiency and sustainability of the learning process and on the ability to work under shifting data distributions. Indeed, naively fine-tuning a prediction model only on the newly available data results in catastrophic forgetting, a sudden erasure of previously acquired knowledge. In this paper, we detail the implementation and deployment of a hybrid continual learning strategy (AR1*) on a native Android application for real-time on-device personalization without forgetting. Our benchmark, based on an extension of the CORe50 dataset, shows the efficiency and effectiveness of our solution.

READ FULL TEXT
05/05/2021

Continual Learning on the Edge with TensorFlow Lite

Deploying sophisticated deep learning models on embedded devices with th...
02/15/2022

Improving Pedestrian Prediction Models with Self-Supervised Continual Learning

Autonomous mobile robots require accurate human motion predictions to sa...
06/12/2020

Collaborative and continual learning for classification tasks in a society of devices

Today we live in a context in which devices are increasingly interconnec...
12/02/2019

Latent Replay for Real-Time Continual Learning

Training deep networks on light computational devices is nowadays very c...
04/10/2022

Edge Continual Learning for Dynamic Digital Twins over Wireless Networks

Digital twins (DTs) constitute a critical link between the real-world an...
02/19/2021

Continual Learning for Blind Image Quality Assessment

The explosive growth of image data facilitates the fast development of i...

Please sign up or login with your details

Forgot password? Click here to reset