Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Transverse federation learning system optimization method and device and readable storage medium

A technology of learning system and optimization method, applied in the field of machine learning, can solve the problems of high consumption of computing resources and high cost of model training time, and achieve the effect of reducing interaction and improving generalization ability

Active Publication Date: 2020-06-12
WEBANK (CHINA)
View PDF6 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The main purpose of the present invention is to provide a horizontal federated learning system optimization method, equipment and readable storage medium, aiming at solving the problem that existing solutions for avoiding overfitting phenomenon are applied to federated learning scenarios, the time cost of model training is high, and the computing resources Problems with high consumption

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Transverse federation learning system optimization method and device and readable storage medium
  • Transverse federation learning system optimization method and device and readable storage medium
  • Transverse federation learning system optimization method and device and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0036] Such as figure 1 as shown, figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present invention.

[0037] It should be noted that the horizontal federated learning system optimization device in this embodiment of the present invention may be a smart phone, a personal computer, a server, etc., and no specific limitation is set here.

[0038] Such as figure 1 As shown, the horizontal federated learning system optimization device may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user interface 1003 may include ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a transverse federated learning system optimization method and device, and a readable storage medium. The method comprises the steps of randomly determining a neuron on-off mode of a to-be-trained neural network model; sending the neuron on-off mode to each participating device, so that each participating device carries out on-off processing on neurons in respective local neural network models according to the neuron on-off mode, and carries out local training on the processed neural network models to obtain local model parameter updates; and fusing the local model parameter updates, and sending global model parameter updates obtained by fusion to the participation devices, so that the participation devices perform model updating on the local neural network models according to the global model parameter updates. Compared with an existing scheme for avoiding an over-fitting phenomenon, the strategy for randomly selecting neuron closing adopted in the method can be well combined with federated learning, and excessive extra time cost and computing resource consumption cannot be brought.

Description

technical field [0001] The present invention relates to the technical field of machine learning, in particular to a horizontal federated learning system optimization method, device and readable storage medium. Background technique [0002] With the development of artificial intelligence, in order to solve the problem of data islands, people put forward the concept of "federated learning", so that both sides of the federation can also conduct model training to obtain model parameters without giving their own data, and can avoid data The issue of privacy breaches. Horizontal federated learning, also known as feature-aligned federated learning, is to take out the participants when the data features of each participant overlap more (that is, the data features are aligned) and the users overlap less. Joint machine learning is performed on the part of the data that has the same characteristics as the previous data but not exactly the same users. [0003] In practical application...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N3/08G06N3/06
CPCG06N3/061G06N3/082
Inventor 程勇梁新乐刘洋陈天健
Owner WEBANK (CHINA)
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More