Towards Scalable and Privacy-Preserving Deep Neural Network via Algorithmic-Cryptographic Co-design

by   Chaochao Chen, et al.

Deep Neural Networks (DNNs) have achieved remarkable progress in various real-world applications, especially when abundant training data are provided. However, data isolation has become a serious problem currently. Existing works build privacy preserving DNN models from either algorithmic perspective or cryptographic perspective. The former mainly splits the DNN computation graph between data holders or between data holders and server, which demonstrates good scalability but suffers from accuracy loss and potential privacy risks. In contrast, the latter leverages time-consuming cryptographic techniques, which has strong privacy guarantee but poor scalability. In this paper, we propose SPNN - a Scalable and Privacy-preserving deep Neural Network learning framework, from algorithmic-cryptographic co-perspective. From algorithmic perspective, we split the computation graph of DNN models into two parts, i.e., the private data related computations that are performed by data holders and the rest heavy computations that are delegated to a server with high computation ability. From cryptographic perspective, we propose using two types of cryptographic techniques, i.e., secret sharing and homomorphic encryption, for the isolated data holders to conduct private data related computations privately and cooperatively. Furthermore, we implement SPNN in a decentralized setting and introduce user-friendly APIs. Experimental results conducted on real-world datasets demonstrate the superiority of SPNN.


Privacy-Preserving Graph Neural Network for Node Classification

Recently, Graph Neural Network (GNN) has achieved remarkable progresses ...

Privacy-Preserving Inference in Machine Learning Services Using Trusted Execution Environments

This work presents Origami, which provides privacy-preserving inference ...

Privacy-preserving Cloud-based DNN Inference

Deep learning as a service (DLaaS) has been intensively studied to facil...

POSEIDON: Privacy-Preserving Federated Neural Network Learning

In this paper, we address the problem of privacy-preserving training and...

Towards Fast and Scalable Private Inference

Privacy and security have rapidly emerged as first order design constrai...

VeriDL: Integrity Verification of Outsourced Deep Learning Services (Extended Version)

Deep neural networks (DNNs) are prominent due to their superior performa...

Please sign up or login with your details

Forgot password? Click here to reset