Decision tree-oriented transverse federation learning method

A learning method and decision tree technology, applied in neural learning methods, instruments, biological neural network models, etc., can solve problems such as long running time and low efficiency, and achieve the effects of ensuring safety, easy use, and improving transmission efficiency

Active Publication Date: 2021-02-02
ZHEJIANG UNIV
View PDF8 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a decision tree-oriented horizontal federated learning method, which solves the problems of low efficiency and long running time in the process of horizontal federated learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Decision tree-oriented transverse federation learning method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0049] Using the data of four hospitals A, B, C, and D to jointly train a model through the federated learning method of the present invention, it is used to calculate the probability of a patient suffering from a certain disease. Since the number of patients in a single hospital is limited and the training data is limited, it is feasible to use data from multiple hospitals to train the model at the same time. The four hospitals hold data respectively (X A ,y A ), (X B ,y B ), (X C ,y C ), (X D ,y D ),in For the training data, for its corresponding label, The training data of the four hospitals contain different samples but have the same characteristics. Due to patient privacy considerations or other reasons, each hospital cannot share data with any other hospital, so the data is stored locally. To solve this situation, four hospitals can jointly train a model using the decision tree-oriented horizontal federated learning method shown below:

[0050] Step S101, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a decision tree-oriented transverse federation learning method. The method comprises the steps that all participants search a quantile sketch of each feature in a data featureset based on a dichotomy; the participants construct a local histogram for each feature by using locally held data features according to the quantile sketch; noise meeting differential privacy is added to all the local histograms, and the noise is sent to a coordinator after being processed through a safety aggregation method; the coordinator merges the local histogram of each feature into a global histogram, and trains a root node of a first decision tree according to the histogram; the coordinator sends the node information to other participants; and all participants update the local histogram and repeat the above process for training to obtain a trained decision tree. The transverse federated learning method has the advantages of being easy and convenient to use, efficient in training and the like, data privacy can be protected, and quantitative support is provided for the data protection level.

Description

technical field [0001] The invention relates to the technical field of federated learning, in particular to a decision tree-oriented horizontal federated learning method. Background technique [0002] Federated learning, also known as ensemble learning, is a machine learning technique that jointly trains models on multiple distributed devices or servers that store data. Unlike traditional centralized learning, this method does not require data to be merged together, so the data exists independently. [0003] The concept of federated learning was first proposed by Google in 2017, and now it has been greatly developed, and its application scenarios are becoming more and more extensive. According to different data division methods, it is mainly divided into horizontal federated learning and vertical federated learning. In horizontal federated learning, researchers distribute the training process of neural networks over multiple participants, iteratively aggregating locally tr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/24323
Inventor 田志华张睿侯潇扬刘健任奎
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products