Privacy protection method for collaborative deep learning model training

A technology of deep learning and model training, which is applied in the field of privacy protection, can solve the problems of high computational overhead and the inability to guarantee the accuracy of model training, and achieve the effects of fairness, secure release, and data privacy

Active Publication Date: 2020-07-28
XIDIAN UNIV +1
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The present invention proposes a privacy protection method for collaborative deep learning model training, which can solve the problem of multi-source data-oriented deep learning model security training, and solve the problems of traditional privacy protection schemes such as high computational overhead and model training accuracy cannot be guaranteed. In order to provide technical support for large-scale security applications of deep learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Privacy protection method for collaborative deep learning model training
  • Privacy protection method for collaborative deep learning model training
  • Privacy protection method for collaborative deep learning model training

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments, where the schematic embodiments and descriptions of the present invention are used to explain the present invention, but not to limit the present invention.

[0051] The present invention designs a privacy protection system for collaborative deep learning model training, which is composed of a key generation center, a parameter server and multiple participants. The key generation center is mainly responsible for generating keys and distributing keys for parameter servers and participants. In this system, the key generation center is the only trusted entity; the parameter server is mainly responsible for managing the global parameters of the deep learning model, and providing certain computing power to update the model parameters. In this system, the parameter server is a semi-trusted entity that can correctly manage data and implement calculati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a privacy protection method for collaborative deep learning model training, and the method comprises the steps: proposing a collaborative distributed deep learning model training method, wherein a participant makes model parameter gradient calculation locally through existing training data, transmitting the gradient data obtained through calculation to a parameter server,and updating model parameters ; proposing a privacy protection mechanism based on a double-trap-door public key cryptographic algorithm so that participants can realize safety training of a deep learning model on the premise of ensuring the privacy of respective training data; and designing a fine-grained deep learning model release method to ensure that only the data owners participating in training can obtain the model, so that the model training fairness is ensured. A simulation test result shows that the method can provide accurate model training service on the premise of ensuring data privacy of participants. Privacy protection can be provided for artificial intelligence and other new-generation computer technologies.

Description

technical field [0001] The invention belongs to the field of information security and relates to a privacy protection method, which can be used for collaborative security training of deep learning models in large-scale data. Background technique [0002] Machine learning is becoming a new engine for the development of the digital economy, especially driven by new theories and technologies such as mobile Internet, big data, supercomputing, sensor networks, and brain science, as well as the strong demand for economic and social development, machine learning will further empower All walks of life can promote the in-depth development of the digital economy. As a branch of machine learning, deep learning has also received more and more attention in industry and academia, and is widely used in medical diagnosis, speech recognition, image recognition and other fields. Deep learning is often based on massive data for model training. By analyzing the hidden correlation between data,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F21/60G06F21/62H04L9/00G06N3/04G06N3/08
CPCG06F21/602G06F21/6245H04L9/008G06N3/08G06N3/044
Inventor 马鑫迪卢锴马建峰沈玉龙习宁卢笛李腾冯鹏斌谢康
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products