Federated learning method and device based on differential privacy and storage medium

A technology of differential privacy and learning methods, applied in the field of federated learning methods, devices and storage media based on differential privacy, can solve the problems of fixedness, loud noise, and inability to fully guarantee data privacy and security, so as to ensure privacy security and improve accuracy Effect

Active Publication Date: 2020-05-01
HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL
View PDF5 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 1. The user directly uploads the model parameters to the server, exposing the model parameters to the data transmission channel and the server, which cannot fully guarantee data privacy and security;
[0006] 2. Users with large or small data volumes all use the same model building method and training rounds, which makes it difficult to guarantee th

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Federated learning method and device based on differential privacy and storage medium
  • Federated learning method and device based on differential privacy and storage medium
  • Federated learning method and device based on differential privacy and storage medium

Examples

Experimental program
Comparison scheme
Effect test

no. 3 example

[0083] The third embodiment provides a computer-readable storage medium, the computer-readable storage medium includes a stored computer program, wherein, when the computer program is running, the device where the computer-readable storage medium is located is controlled to execute the method described in the first implementation. The federated learning method based on differential privacy described in the example, and achieve the same beneficial effect.

[0084] In summary, the embodiments of the present invention have the following beneficial effects:

[0085] By sending the preset first model parameters, including the privacy budget, to the user terminal, the user terminal can update the local deep learning model of the user terminal based on the differential privacy technology according to the first model parameters and return the second model parameters, and then pass Perform parameter averaging on the second model parameters uploaded by the client, and deliver the obtain...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a federated learning method and device based on differential privacy and a storage medium. The method comprises the steps that S1, a preset first model parameter is issued to auser side, so that the user side updates a local deep learning model of the user side based on a differential privacy technology according to the first model parameter and returns a second model parameter; wherein the first model parameter comprises a privacy budget; S2, performing parameter equalization on the second model parameter to obtain a third model parameter, and issuing the third modelparameter to the user side; and S3, taking the total execution times of the steps S1 to S2 as a model training round, and repeatedly executing the steps S1 and S2 when the model training round does not reach a preset threshold, otherwise, ending the model training. According to the invention, the data privacy safety can be ensured, and the accuracy of the training model is improved.

Description

technical field [0001] The present invention relates to the technical field of artificial intelligence, in particular to a federated learning method, device and storage medium based on differential privacy. Background technique [0002] At present, most users, such as enterprises or institutions, want to jointly train AI models with other users' data. For data privacy protection and security considerations, each user cannot directly exchange data, and it is difficult to achieve cross-user collaborative training of AI models. and Applying the federated learning method proposed by Google can solve the above problems. [0003] Federated learning establishes a common model through parameter exchange and optimization under encryption mechanism or perturbation mechanism on the premise that the user's respective data does not go out of the local area. This requires the user to use their own data to train the user model, and upload the model parameters of the user model to the serv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N20/00
CPCG06N20/00
Inventor 廖清黄茜茜柏思远丁烨李京竹
Owner HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products