Multi-task federal learning method and device for edge device

An edge device and learning method technology, applied in the computer field, can solve problems such as unreasonable scheduling of device resources and low efficiency of federated learning, and achieve the effects of improving efficiency, improving accuracy, and improving training efficiency

Pending Publication Date: 2021-07-09
苏州联电能源发展有限公司
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] This application provides a multi-task federated learning method and device for edge devices, which can solve the problem that when there are multiple learning tasks, device resources cannot be reasonably scheduled, resulting in low efficiency of federated learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-task federal learning method and device for edge device
  • Multi-task federal learning method and device for edge device
  • Multi-task federal learning method and device for edge device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The specific implementation manners of the present application will be further described in detail below in conjunction with the drawings and embodiments. The following examples are used to illustrate the present application, but not to limit the scope of the present application.

[0056] The multi-task federated learning method for edge devices provided by this application mainly optimizes the training efficiency of the submitted multiple learning tasks, so that the sum of the completion time of the submitted J learning tasks is the smallest, even if multiple learning tasks can be completed as much as possible. may converge rapidly. J is an integer greater than 1.

[0057] In addition, since the completion time includes calculation time and communication time, in this application, the calculation time and communication time are combined to calculate the training efficiency, which can further improve the accuracy of determining the scheduling strategy, thereby improvin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a multi-task federal learning method and device for edge devices, and belongs to the technical field of computers. The method comprises the following steps: after at least two learning tasks are created, sending a resource query request to multiple edge devices; determining a resource scheduling strategy of the plurality of edge devices according to resource information queried by the resource query request and a Bayesian optimization algorithm; distributing learning tasks to the plurality of edge devices according to a resource scheduling strategy; for the global model corresponding to each learning task, obtaining model parameters uploaded by each edge device corresponding to the learning task; determining final model parameters of the global model based on the model parameters. The problem that when multiple learning tasks exist, equipment resources cannot be reasonably scheduled, and consequently federal learning efficiency is not high can be solved. By minimizing the sum of the completion durations of the at least two submitted learning tasks, even if a plurality of learning tasks can be converged as quickly as possible, the multi-task learning efficiency can be improved.

Description

【Technical field】 [0001] The present application relates to a multi-task federated learning method and device oriented to edge devices, belonging to the field of computer technology. 【Background technique】 [0002] Federated Learning (Federated Learning) is a machine learning framework. Its design goal is to ensure information security during big data exchange, protect terminal data and personal data privacy, and ensure compliance with laws and regulations. Efficient machine learning between nodes. Among them, the machine learning algorithms that can be used in federated learning are not limited to neural networks, but also include important algorithms such as random forests. [0003] When there are multiple machine learning tasks in the federated learning process, if only one learning task can be run at the same time, the tasks cannot be parallelized, which will increase the waiting time of the tasks and be extremely inefficient. Therefore, when running multiple machine l...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50G06N7/00G06N20/00
CPCG06F9/5072G06F9/5027G06F9/5044G06N20/00G06F2209/502G06N7/01
Inventor 唐玉维
Owner 苏州联电能源发展有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products