Joint deep learning method capable of resisting generative adversarial network attacks

A deep learning and network attack technology, applied in the fields of privacy data protection and deep learning, can solve problems such as privacy destruction of deep learning model training data, and achieve the effect of strengthening initialization methods, preventing privacy leakage, and improving robustness

Active Publication Date: 2019-11-15
NANJING UNIV OF SCI & TECH
View PDF5 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the problem of model protection is also an important topic in the field of machine learning outsourcing computing. A complete and highly robust deep learning model often contains a lar...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Joint deep learning method capable of resisting generative adversarial network attacks
  • Joint deep learning method capable of resisting generative adversarial network attacks

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] A joint deep learning method that can resist generational confrontational network attacks, and realize the system structure diagram of the present invention as shown in figure 1 As shown, four types of entities are included: Parameter Server (Parameter Server, PS), Blinding Server (Blinding Server, BS), Loyal User (Loyal User, LU), and Common Trainer (Common Trainer, CT). The parameter server PS is the initiator and scheduler of the entire joint learning task. It is responsible for initializing the joint learning system model, organizing and scheduling various entities to participate in joint learning according to the training process, and responsible for updating and distributing system model parameters during the joint learning process. It can be served by a cloud server that is semi-honest (curious about the private data of the trainer but does not initiate malicious attacks). The parameter server BS is a newly introduced third-party cloud server that does not collud...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a joint deep learning method capable of resisting GAN (Generative Adversarial Network) attacks. The joint deep learning method comprises the following steps: initializing a deeplearning model; performing blind server initialization; and performing model protection joint learning and the like. By combining a matrix blinding technology and a random gradient descent method, blinding of input vectors and part of model parameters can be realized. According to the method, modeling and updating of an attacker local generative adversarial network are limited; meanwhile, the modes such as deep learning model right of use are limited, distributed trainees are allowed to utilize private data sets locally to train to obtain gradient update of model parameters, gradient update of each trainee is aggregated by a parameter server, and global update of a system model is achieved. According to the method, the GAN attack is resisted, the joint deep learning system model is protected, and the model accuracy and training data privacy protection requirements are greatly balanced.

Description

technical field [0001] The invention belongs to the fields of privacy data protection and deep learning, and specifically relates to a joint deep learning method capable of resisting generational confrontation network attacks. Background technique [0002] Joint deep learning refers to the use of cloud servers by multiple users to complete deep learning model training tasks under the premise of locally saving private training data. With the increasing demand for processing massive data, deep learning, as a machine learning method based on artificial neural network, has become more and more popular because of its powerful data feature learning ability, and has been widely used in computer vision, speech, etc. Among many practical problems such as recognition and natural language processing. Thanks to the high accuracy of classification and prediction results of various models, deep learning has now become the basis of Internet intelligent services. [0003] During deep lear...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/06H04L12/24
CPCH04L41/145H04L63/1433H04L63/1441
Inventor 吴介付安民曾凡健王永利俞研陈珍珠
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products