A federated learning model training method and system

A learning model and model training technology, applied in the information field, can solve problems such as difficult trade-offs between accuracy and privacy

Active Publication Date: 2021-05-04
索信达(北京)数据技术有限公司 +1
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to solve the problem that the existing federated learning method is difficult to balance the accuracy and privacy, the present invention provides a federated learning model training method and system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A federated learning model training method and system
  • A federated learning model training method and system
  • A federated learning model training method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] In order to better understand the above-mentioned technical solution, the above-mentioned technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0046] refer to figure 1 , in some embodiments, a federated learning model training method is provided, including:

[0047] S1. The central server sends the initial parameters to each node device;

[0048] S2. Each node device performs model training based on the initial parameters and the local data set, and obtains a gradient value;

[0049] S3. The central server generates a key pair and sends the public key to each node device;

[0050] S4. Each node device uses the public key to encrypt the gradient value to obtain an encrypted gradient;

[0051] S5. Each node device calculates the encrypted gradient sum in a point-to-point manner, and sends the encrypted gradient sum to the central server;

[0052] S6. The central server decrypts the en...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a federated learning model training method and system, wherein the method includes: a central server sends initial parameters to each node device; each node device performs model training based on the initial parameters and a local data set, and obtains a gradient value; the central server Generate a key pair and send the public key to each node device; each node device uses the public key to encrypt the gradient value to obtain an encrypted gradient; each node device calculates the encrypted gradient sum in a point-to-point manner, and sends the encrypted gradient sum to to the central server; the central server decrypts the encrypted gradient sum through the private key, obtains the gradient sum, and sends it to each node device; the node device updates the parameters of the model based on the gradient sum, according to the updated parameters and the local data set. In the next round of model training, until the training stop condition is met, this method can guarantee the privacy data of all participants and the accuracy of model training.

Description

technical field [0001] The present application relates to the field of information technology, in particular to a federated learning model training method and system. Background technique [0002] Federated learning is dedicated to solving the problem of multi-user collaborative model training without disclosing their respective data sets. For example, in the medical big data modeling scenario, each hospital has different patient sample data. Due to the limited amount of data owned by each hospital, if the model is trained only based on its own data, the effect of the model is difficult to meet expectations due to the limitation of the sample size. If the data of various companies can be aggregated for training, the accuracy of the model can be greatly improved. However, due to the competition among hospitals and the requirements for the privacy protection of patient data, it is impossible for hospitals to release their own customer data to any third party, and it is not f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L9/08H04L9/00H04L9/30H04L29/06G06N3/08G06K9/62
CPCH04L9/0863H04L9/30H04L9/008H04L63/0442G06N3/08G06F18/214
Inventor 邵俊向爱平洪城
Owner 索信达(北京)数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products