Horizontal Federated Learning and Secure Distributed Training for Recommendation System with Intel SGX

by   Siyuan Hui, et al.

With the advent of big data era and the development of artificial intelligence and other technologies, data security and privacy protection have become more important. Recommendation systems have many applications in our society, but the model construction of recommendation systems is often inseparable from users' data. Especially for deep learning-based recommendation systems, due to the complexity of the model and the characteristics of deep learning itself, its training process not only requires long training time and abundant computational resources but also needs to use a large amount of user data, which poses a considerable challenge in terms of data security and privacy protection. How to train a distributed recommendation system while ensuring data security has become an urgent problem to be solved. In this paper, we implement two schemes, Horizontal Federated Learning and Secure Distributed Training, based on Intel SGX(Software Guard Extensions), an implementation of a trusted execution environment, and TensorFlow framework, to achieve secure, distributed recommendation system-based learning schemes in different scenarios. We experiment on the classical Deep Learning Recommendation Model (DLRM), which is a neural network-based machine learning model designed for personalization and recommendation, and the results show that our implementation introduces approximately no loss in model performance. The training speed is within acceptable limits.


Homomorphic Encryption and Federated Learning based Privacy-Preserving CNN Training: COVID-19 Detection Use-Case

Medical data is often highly sensitive in terms of data privacy and secu...

Cali3F: Calibrated Fast Fair Federated Recommendation System

The increasingly stringent regulations on privacy protection have sparke...

ESMFL: Efficient and Secure Models for Federated Learning

Deep Neural Networks are widely applied to various domains. The successf...

Big Data Intelligence Using Distributed Deep Neural Networks

Large amount of data is often required to train and deploy useful machin...

Shared MF: A privacy-preserving recommendation system

Matrix factorization is one of the most commonly used technologies in re...

OpenFed: An Open-Source Security and Privacy Guaranteed Federated Learning Framework

The broad application of artificial intelligence techniques ranging from...

TEE-based decentralized recommender systems: The raw data sharing redemption

Recommenders are central in many applications today. The most effective ...

Please sign up or login with your details

Forgot password? Click here to reset