Vertical federated learning defense method based on auto-encoder

An autoencoder and encoder technology, applied in the field of vertical federated learning defense based on autoencoders, can solve the problems of reducing the accuracy of the original task, achieve the effects of preventing privacy leakage, protecting private information, and improving performance

Pending Publication Date: 2021-03-09
ZHEJIANG UNIV OF TECH
View PDF0 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the defense method against differential privacy attacks greatly reduces the accuracy of the original task while protecting the embedded feature information of nodes, which is not suitable for this vertical federated learning scenario for processing graph data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Vertical federated learning defense method based on auto-encoder
  • Vertical federated learning defense method based on auto-encoder
  • Vertical federated learning defense method based on auto-encoder

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, and do not limit the protection scope of the present invention.

[0018] Aiming at how to protect the privacy security of the data in the joint training process and minimize the impact on the joint training effect of the model, and at the same time aiming at the scene where the attacker can obtain the background knowledge of the global model of the server, the present invention proposes a vertical algorithm based on an autoencoder. In the federated learning defense method, when the attacker can infer the encoded node embedding information of other participants through a part of the global model, the method based on the autoencoder will ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a vertical federated learning defense method based on an auto-encoder. The method comprises the steps that (1) a terminal trains an edge model through local data, and aggregates the embedding features of adjacent nodes of each layer in the edge model in a training process; (2) the terminal constructs and trains an auto-encoder comprising an encoder and a decoder to obtain encoder parameters and decoder parameters, and encodes the embedded features by using the encoder to obtain encoding information; (3) the terminal uploads the decoder parameters to the server, and after the server constructs a decoding model according to the decoder parameters and carries out message verification with the terminal, the terminal uploads coded information to the server; and (4) the server decodes the received coded information by using the decoding model to obtain decoded information, aggregates all decoded information to obtain embedded information, trains the global model by using the embedded information, and feeds back gradient information to each terminal after training. The malicious participant can be effectively prevented from stealing the private data.

Description

technical field [0001] The invention relates to the technical fields of deep learning and privacy security, in particular to an autoencoder-based vertical federated learning defense method. Background technique [0002] With the research results of deep neural network (DNN), it has been widely used in machine translation, image recognition, unmanned driving, natural language processing, network map analysis, electromagnetic space countermeasures, biomedicine, finance and other fields. With its powerful feature extraction capabilities, deep learning gradually replaces humans in various fields for autonomous decision-making. However, once data and models are leaked, it will cause significant personal injury and property loss. [0003] Since Google proposed the concept of federated learning (FL) in 2016, all participants in the process of federated learning jointly train the joint model by exchanging gradient information or intermediate results, which effectively solves the pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F21/62G06T9/00G06N3/04G06N3/08
CPCG06F21/6245G06T9/002G06N3/08G06N3/045
Inventor 陈晋音李荣昌张龙源吴长安刘涛
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products