Quality-aware edge intelligent federated learning method and system

A learning method and quality technology, applied in the direction of integrated learning, data processing applications, instruments, etc., can solve the problems that the aggregation model does not consider the node learning quality incentive system and deteriorates the quality of the global model

Active Publication Date: 2020-10-09
TSINGHUA UNIV +1
View PDF5 Cites 41 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a quality-aware edge intelligent federated learning method and system to solve the technical problem that the existing aggregation model ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Quality-aware edge intelligent federated learning method and system
  • Quality-aware edge intelligent federated learning method and system
  • Quality-aware edge intelligent federated learning method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] The embodiments of the present invention will be described in detail below with reference to the accompanying drawings, but the present invention can be implemented in many different ways defined and covered by the claims.

[0062] figure 1 It is a typical distributed federated learning system, including a cloud platform and some mobile computing nodes, mobile computing nodes use Represents, where i represents the set The i-th node in . The system manages the interaction between the cloud platform and computing nodes in the form of time slots, and divides the time into T consecutive iterations of equal length. In each iteration t, the cloud platform will issue a set of learning tasks, using said, among them express The jth learning task in . For the learning task in iteration t Cloud platform as task publisher will provide learning budget To recruit suitable computing nodes to train the model collaboratively. The node first downloads the global model, th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a quality-aware edge intelligent federated learning method and a quality-aware edge intelligent federated learning system. The method comprises the following steps that: a cloud platform constructs a federated learning quality optimization problem by taking the maximum sum of aggregation model qualities of a plurality of learning tasks in each iteration as an optimization target and solves the problem: in each iteration, the learning quality of participating nodes is predicted by utilizing historical learning quality records of the participating nodes, and the learningquality of the node training data is quantified by using the reduction amount of a loss function value in each iteration; in each iteration, the cloud platform stimulates nodes with high learning quality to participate in federated learning through a reverse auction mechanism; therefore, the distribution of learning tasks and learning rewards is carried out; in each iteration, for each learning task, each participation node uploads its local model parameters to the cloud platform to aggregate to obtain a global model. According to the method and the system, richer data and more computing powercan be provided for model training under the condition of protecting data privacy so that the quality of the model is improved.

Description

technical field [0001] The invention relates to a performance optimization technology of a large-scale distributed intelligent learning system, in particular to a quality-aware edge intelligent federated learning method and system. Background technique [0002] With the rapid development of the Internet of Things (IoT, Internet of Things), a large amount of data is continuously generated at the edge of the network, which provides opportunities for realizing intelligent services based on machine learning. Traditionally, centralized machine learning frameworks need to aggregate huge training data to cloud centers for model training. Although the centralized machine learning method can achieve satisfactory learning performance, the data transmission and centralized storage will have the risk of privacy leakage, and the data transmission overhead will affect the number of power-constrained mobile devices and the cost of cloud center data maintenance. , are huge obstacles to sys...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N20/20G06Q30/08
CPCG06N20/20G06Q30/08
Inventor 张尧学邓永恒吕丰任炬
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products