Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Federation learning method and device based on evolutionary computation, equipment and medium

A technology of evolutionary computing and learning methods, applied in the central server and readable storage medium, in the field of federated learning based on evolutionary computing, it can solve the problems of low efficiency of optimizing hyperparameters and affecting the performance of federated learning models.

Pending Publication Date: 2020-09-29
WEBANK (CHINA)
View PDF0 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of the present invention is to provide a federated learning method, device, central server and readable storage medium based on evolutionary computing, aiming to solve the problem of low efficiency of optimizing hyperparameters in existing federated learning and affecting the performance of federated learning models question

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Federation learning method and device based on evolutionary computation, equipment and medium
  • Federation learning method and device based on evolutionary computation, equipment and medium
  • Federation learning method and device based on evolutionary computation, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0090] Based on the first embodiment, the second embodiment of the federated learning method based on evolutionary computation of the present invention is proposed. In this embodiment, the federated learning method based on evolutionary computation also includes:

[0091] Step A10, receiving the target hyperparameters sent by the central server, the participant and other participants participating in the federated learning determine their respective initial model parameters based on the target hyperparameters, and perform federated learning based on the respective initial model parameters, get the target model;

[0092] Step A20, sending the target model to the central server.

[0093] In this embodiment, federated machine learning (Federated machine learning / Federated Learning), also known as federated learning, federated learning, federated learning. Federated learning is a machine learning framework that can effectively help multiple organizations perform data usage and ma...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a federated learning method and device based on evolutionary computation, a central server and a readable storage medium. The method comprises the following steps of: acquiringa hyper-parameter of each participant group, and sending the hyper-parameters to each participant of each participant group to enable the participants in each participant group to carry out federatedlearning; acquiring sub-target models obtained by trained through federated learning of the participant groups, and performing iterative evolutionary computation based on the performance index of each sub-target model and the hyper-parameter corresponding to each participant group to obtain a target hyper-parameter; and sending the target hyper-parameter to each participant participating in federated learning to enable the participants to determine respective initial model parameters based on the target hyper-parameter and perform federated learning based on the initial model parameters to obtain a target model. The hyper-parameter optimization efficiency in federated learning is improved through evolutionary computation, and meanwhile, the performance of a federated learning model is remarkably improved.

Description

technical field [0001] The present invention relates to the field of financial technology, in particular to a federated learning method, device, central server and readable storage medium based on evolutionary computation. Background technique [0002] In federated learning, complex models such as neural networks are often used. This type of model has a large number of hyperparameters, such as learning rate, number of network layers, and the dimension of each convolution kernel. The existing federated learning can only train the neural network on the set fixed hyperparameters. Since the artificially set fixed hyperparameters are often not the optimal hyperparameters, the federated learning model trained under the artificially given hyperparameters often cannot achieve the best results. In order to obtain a good federated learning model, it is necessary to continuously adjust the hyperparameters artificially based on experience, and to perform federated learning again. The ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N20/20
CPCG06N20/20
Inventor 高大山鞠策
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products