A training method and device for a federated learning model

A technology for learning models and training methods, applied in the field of artificial intelligence, and can solve problems such as equipment disconnection

Active Publication Date: 2021-06-04
WEBANK (CHINA)
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the current federated learning product scenario, due to the influence of device bandwidth, network and other factors, devices participating in federated training often go offline

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A training method and device for a federated learning model
  • A training method and device for a federated learning model
  • A training method and device for a federated learning model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0034] It should be understood that "at least one" in the embodiments of the present application refers to one or more, and "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and / or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone, where A, B can be singular or plural. The ch...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to the field of artificial intelligence, and discloses a federated learning model training method and device, wherein the method includes: before the server issues the global parameters of the k+1th training cycle, according to the connection status of the terminals participating in the federated learning model, Determining the first terminal and the second terminal; the first terminal is a terminal that cannot be connected; the second terminal is a terminal that is normally connected; the server determines the second local parameters of the M network layers whose contribution meets the set condition in the first terminal; According to the second local parameters of the M network layers of the first terminal in the kth training cycle and the first local parameters of the N network layers uploaded by the second terminal, the server determines that the k+1th training cycle is sent to the second The global parameters of the N network layers of the terminal are used to reduce the impact on the training effect of the model due to the terminal being offline.

Description

technical field [0001] The invention relates to the field of artificial intelligence, in particular to a training method and device for a federated learning model. Background technique [0002] With the development of computer technology, more and more technologies are applied in the financial field. The traditional financial industry is gradually transforming into technology finance (Fintech). The technology of the federated learning model is no exception. However, due to the security and real-time nature of the financial industry Requirements, but also higher requirements for technology. [0003] In the field of deep learning technology, users can obtain deep learning network models with better prediction effects through training models. However, deep learning network models with better prediction effects usually have relatively complex network structures, thus occupying a large storage space. Correspondingly, when using the deep learning network model to predict the data...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06N3/04G06N3/08G06N20/00
CPCG06N3/08G06N20/00G06N3/045
Inventor 黄安埠
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products