Transverse federated learning optimization method and device based on semi-supervision and storage medium

An optimization method and semi-supervised technology, applied in the field of machine learning, can solve problems such as inability to train models, and achieve the effect of saving labor costs

Pending Publication Date: 2020-06-16
WEBANK (CHINA)
View PDF0 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of the present invention is to provide a semi-supervised-based horizontal federated learning optimization method, device and storage medium, aiming to solve the problem that the horizontal federated learning cannot be used when there is a small amount of label data in the existing clients or even some clients have no label data. The problem of federated learning to train models

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Transverse federated learning optimization method and device based on semi-supervision and storage medium
  • Transverse federated learning optimization method and device based on semi-supervision and storage medium
  • Transverse federated learning optimization method and device based on semi-supervision and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0045] Such as figure 1 as shown,figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present invention.

[0046] It should be noted that the semi-supervised horizontal federated learning optimization device in this embodiment of the present invention may be a smart phone, a personal computer, a server, etc., and no specific limitation is made here.

[0047] Such as figure 1 As shown, the semi-supervised-based horizontal federated learning optimization device may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user inte...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a transverse federated learning optimization method and device based on semi-supervision and a storage medium. The method comprises the steps of receiving global model parameters which are issued by a server and updated by a label-free global model this time; performing self-supervised training on a local model to be trained according to the global model parameters and thetraining samples, and updating encoder parameters and decoder parameters in the model to be trained to obtain local model parameters; sending the local model parameters to a server, so that the serverperforms supervised training on the to-be-trained model according to the local model parameters sent by each client to obtain global model parameters updated by the new label-free global model and issues the global model parameters to each client; and repeating until a preset condition is met to stop training to obtain a target model. According to the invention, transverse federated learning canbe carried out when the client only has a small amount of label data or even does not have label data completely, so that the method is suitable for a real scene lacking label data, and the labor costis saved.

Description

technical field [0001] The present invention relates to the technical field of machine learning, in particular to a semi-supervised horizontal federated learning optimization method, equipment and storage medium. Background technique [0002] With the development of artificial intelligence, in order to solve the problem of data islands, people put forward the concept of "federated learning", so that both sides of the federation can also conduct model training to obtain model parameters without giving their own data, and can avoid data The issue of privacy breaches. Horizontal federated learning, also known as feature-aligned federated learning, is to take out the client when the data features of each client overlap more (that is, the data features are aligned) and the user overlaps less. The part of the data with the same data characteristics but not exactly the same users is subjected to joint machine learning. [0003] The current horizontal federated learning usually as...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N20/00
CPCG06N20/00
Inventor 魏锡光李权鞠策高大山曹祥刘洋陈天健
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products