Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Transverse federated learning optimization method and device based on semi-supervision and storage medium

An optimization method and semi-supervised technology, applied in the field of machine learning, can solve problems such as inability to train models, and achieve the effect of saving labor costs and avoiding waste

Pending Publication Date: 2020-06-12
WEBANK (CHINA)
View PDF0 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of the present invention is to provide a semi-supervised horizontal federated learning optimization method, device and storage medium, aiming to solve the problem that the horizontal federated learning cannot be used to train the model in the case of unlabeled data in the existing client

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Transverse federated learning optimization method and device based on semi-supervision and storage medium
  • Transverse federated learning optimization method and device based on semi-supervision and storage medium
  • Transverse federated learning optimization method and device based on semi-supervision and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0043] Such as figure 1 as shown, figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present invention.

[0044] It should be noted that the semi-supervised horizontal federated learning optimization device in this embodiment of the present invention may be a smart phone, a personal computer, a server, etc., and no specific limitation is made here.

[0045] Such as figure 1 As shown, the semi-supervised-based horizontal federated learning optimization device may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a transverse federated learning optimization method and device based on semi-supervision and a storage medium. The method comprises the steps that global model parameters updated by a global model this time and issued by a server side are received; after the first model is updated based on the global model parameters, self-supervised training on the first model is performedbased on a local label-free sample and an augmented sample of the label-free sample to obtain local model parameters; the local model parameters are sent to a server, so that the server performs supervised training on the second model according to the labeled samples and the local model parameters received from each client to obtain new global model parameters updated by the global model and issues the global model parameters to each client; and the process is repeated until a preset condition is met to stop training to obtain a target model. According to the invention, transverse federatedlearning can be carried out when only a small number of labeled samples exist at the server side and no label data exists at the client side, so that the method is suitable for a real scene lacking label data and the labor cost is saved.

Description

technical field [0001] The present invention relates to the technical field of machine learning, in particular to a semi-supervised horizontal federated learning optimization method, equipment and storage medium. Background technique [0002] With the development of artificial intelligence, in order to solve the problem of data islands, people put forward the concept of "federated learning", so that both sides of the federation can also conduct model training to obtain model parameters without giving their own data, and can avoid data The issue of privacy breaches. Horizontal federated learning, also known as feature-aligned federated learning, is to take out the client when the data features of each client overlap more (that is, the data features are aligned) and the user overlaps less. The part of the data with the same data characteristics but not exactly the same users is subjected to joint machine learning. [0003] The current horizontal federated learning usually as...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06N20/20G06K9/62
CPCG06N20/00G06F18/2155
Inventor 魏锡光鞠策李权曹祥刘洋陈天健
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products