Federated learning training method and device for high-delay network environment robustness

A technology for learning and training, delay network, applied in the direction of integrated learning, data exchange network, digital transmission system, etc., can solve problems such as reducing training efficiency

Active Publication Date: 2020-11-27
PING AN TECH (SHENZHEN) CO LTD
View PDF8 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present invention provides a federated learning training method, device, computer equipment and storage medium robust in a high-delay network environment, aiming to solve the problem of the synchronous stochastic gradient descent method of federated learning in the prior art when the network delay is relatively serious , the problem that the training efficiency is greatly reduced

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Federated learning training method and device for high-delay network environment robustness
  • Federated learning training method and device for high-delay network environment robustness
  • Federated learning training method and device for high-delay network environment robustness

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0029] It should be understood that when used in this specification and the appended claims, the terms "comprising" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude one or Presence or addition of multiple other features, integers, steps, operations, elements, components and / or collections thereof.

[0030] It should also be understood that the terminology used ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a federated learning training method and device for high-delay network environment robustness, computer equipment and a storage medium, and relates to the artificial intelligence technology. The method comprises: obtaining the current system time, and obtaining a corresponding target data uploading terminal if the encrypted data uploaded by a plurality of data uploading terminals is not received; obtaining a current network time delay value of each target data uploading terminal to obtain a maximum network time delay value; calculating to obtain a delay step length according to the maximum network delay value and the unit time sequence interval step length; summing the current system time and the delay step length to obtain target system time; and if the current time is the target system time and the target encrypted data uploaded by the target data uploading terminal is not received, stopping the local federation learning training until the target encrypted data uploaded by all the target data uploading terminals is received, and recovering the local federation learning training. Under the condition of network delay, the training efficiency of federated learning is kept in a time delay sparse updating mode.

Description

technical field [0001] The present invention relates to the technical field of artificial intelligence model hosting, and in particular to a federated learning training method, device, computer equipment and storage medium robust to high-delay network environments. Background technique [0002] Federated machine learning is a machine learning framework based on distributed parameter aggregation technology. It focuses on distributed multi-users and the corresponding federated parameter aggregation mechanism. It can effectively help multiple organizations to conduct data usage and machine learning modeling while meeting the requirements of user privacy protection, data security and government regulations. As a distributed machine learning paradigm, federated learning can effectively solve the problem of data islands, allowing participants to jointly model without sharing data, technically breaking data islands, and realizing AI collaboration. [0003] The current mainstream f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N20/20H04L12/26H04L29/06H04L29/08
CPCG06N20/20H04L43/0852H04L63/0442H04L67/10
Inventor 曾昱为王健宗瞿晓阳
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products