Federation learning model training method, device and system and storage medium
A technology for learning models and training methods, which is applied in the field of data processing, and can solve problems such as the inability to take into account the training time and model quality of federated learning models
Pending Publication Date: 2019-09-20
WEBANK (CHINA)
View PDF0 Cites 36 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The main purpose of the present invention is to provide a federated learning model training method, equipment, system and storage medium, aiming to solve the problem that the training time and model quality of the federated learning model cannot be well considered in the current horizontal federated learning model training process
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0053] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
[0054] Such as figure 1 as shown, figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present invention.
[0055] It should be noted that the device in this embodiment of the present invention is a coordinating device, and the coordinating device may be a smart phone, a personal computer, a server, etc., and no specific limitation is set here.
[0056] Such as figure 1 As shown, the device may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a federation learning model training method, device and system and a storage medium. The method comprises the following steps of sending a model updating request message carrying the joint model parameters and the waiting duration to each participating device; receiving the model parameter update which is sent when each participating device carries out local training on the to-be-trained model according to the local data and the joint model parameters and determines that time participates in the model update; updating the model parameters to obtain the latest joint model parameters; counting the participation state of each participation device for updating the model, and obtaining the waiting duration for updating the model next time according to the counting result, wherein the model updating request message of the next model updating carries the latest joint model parameters and the waiting duration of the next model updating until when the to-be-trained model is in a convergence state, the latest joint model parameters are used as the final parameters of the to-be-trained model. According to the method, the training time and quality of the federation learning model are well considered simultaneously.
Description
technical field [0001] The present invention relates to the technical field of data processing, in particular to a federated learning model training method, device, system and storage medium. Background technique [0002] With the development of artificial intelligence, in order to solve the problem of data islands, people put forward the concept of "federated learning", so that both sides of the federation can also conduct model training to obtain model parameters without giving their own data, and can avoid data The issue of privacy breaches. [0003] In the current model parameter update process of horizontal federated learning, each participating device only uses its own locally owned data to train the model, and sends model parameter updates to the coordinating device, and the coordinating device updates the model parameters received from different participating devices Fusion is carried out, and the updated model parameters after fusion are distributed to each partici...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/02G06N3/08
CPCG06N3/02G06N3/08
Inventor 程勇蔡杭衣志昊刘洋陈天健
Owner WEBANK (CHINA)