Model parameter training method and device based on federated learning, equipment and medium

A technology of model parameters and training methods, which is applied in the field of data processing and can solve problems such as limited application of federated learning

Pending Publication Date: 2019-06-14
WEBANK (CHINA)
View PDF0 Cites 79 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current federated learning technology must rely on a trusted third party to aggregate and model the data of b...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model parameter training method and device based on federated learning, equipment and medium
  • Model parameter training method and device based on federated learning, equipment and medium
  • Model parameter training method and device based on federated learning, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0072] refer to figure 1 , figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present invention.

[0073] The model parameter training device based on federated learning in the embodiment of the present invention may be a terminal device such as a smart phone, a PC (Personal Computer, personal computer), a tablet computer, a portable computer, and a server.

[0074] Such as figure 1 As shown, the model parameter training device based on federated learning may include: a processor 1001 , such as a CPU, a communication bus 1002 , a user interface 1003 , a network interface 1004 , and a memory 1005 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user inter...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a model parameter training method and device based on federal learning, equipment and a medium. The method comprises the following steps: when a first terminal receives encrypted second data sent by a second terminal, obtaining a corresponding loss encryption value and a first gradient encryption value; randomly generating a random vector with the same dimension as the first gradient encryption value, performing fuzzy on the first gradient encryption value based on the random vector, and sending the fuzzy first gradient encryption value and the loss encryption value toa second terminal; when the decrypted first gradient value and the loss value returned by the second terminal are received, detecting whether the model to be trained is in a convergence state or not according to the decrypted loss value; and if yes, obtaining a second gradient value according to the random vector and the decrypted first gradient value, and determining the sample parameter corresponding to the second gradient value as the model parameter. According to the method, model training can be carried out only by using data of two federated parties without a trusted third party, so thatapplication limitation is avoided.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a model parameter training method, device, equipment and medium based on federated learning. Background technique [0002] "Machine learning" is one of the core research fields of artificial intelligence, and how to continue machine learning on the premise of protecting data privacy and meeting legal and compliance requirements is a trend that the field of machine learning is now paying attention to. In this context, people The research proposes the concept of "federated learning". [0003] Federated learning uses technical algorithms to encrypt the built model. Both sides of the federation can also conduct model training to obtain model parameters without giving their own data. Federated learning protects user data privacy through parameter exchange under the encryption mechanism, data and the model itself It will not be transmitted, nor can it guess the other p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N20/00G06F21/60G06F21/62
CPCG06N20/00H04L9/008H04L9/0891G06F21/606G06F21/6254H04L9/30
Inventor 刘洋陈天健杨强
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products