Mobile user equipment clustering training method for wireless federated learning

A technology for mobile user equipment and training methods, applied in the field of improving centralized aggregation servers for federated learning, can solve problems such as slow convergence speed of machine learning, achieve the effects of reducing training convergence time, reasonable division, and reducing training delay

Active Publication Date: 2022-05-27
NANJING UNIV OF POSTS & TELECOMM
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, the traditional centralized FL aggregation server may stop working due to security attacks or physical damage, and with the client training delay and client upload delay, it will cause slow convergence of machine learning. The distributed architecture The server can improve the system's high concurrency, high availability, and scalable performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mobile user equipment clustering training method for wireless federated learning
  • Mobile user equipment clustering training method for wireless federated learning
  • Mobile user equipment clustering training method for wireless federated learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0056] According to a mobile user equipment clustering method for wireless federated learning in the edge environment of the Internet of Things proposed by the present invention, the user is divided into multiple layers through the DBSCAN density clustering and the LEACH algorithm, and then the cluster head is selected by scoring weighting, so that each The user transmits the local training parameters to the most reasonable cluster head for aggregation, so as to reduce the communication delay and local training delay of the entire distributed federated learning, and achieve rapid convergence.

[0057] In this example, the distribution of users participating in the distributed federated learning architecture under the Internet of Things is as follows:...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a wireless federated learning-oriented mobile user equipment clustering training method, which is characterized in that an edge service server and a plurality of mobile user equipment are arranged in a wireless network, and each user equipment belongs to a local data set. Firstly, a DBSCAN algorithm and an LEACH algorithm are used to divide users into a plurality of clusters and select cluster heads. Then, each user uses local data to train respective model parameters and uploads the model parameters to a cluster head of a cluster where the user is located for aggregation, and the cluster head further uploads the aggregated model to an edge server for aggregation; and the edge server distributes the aggregated model parameters to the cluster head, and the cluster head further distributes the aggregated model parameters to the user equipment in the cluster for the next round of training. And repeating the steps until convergence. By using the clustering training method, the communication overhead and the training time delay of wireless federal learning can be reduced.

Description

technical field [0001] The present invention is oriented to the technical field of federated learning under the Internet of Things environment, and is especially aimed at improving the situation that the centralized aggregation server of federated learning may stop working due to physical damage or security attacks by malicious users, thereby interrupting the training process. Background technique [0002] At present, artificial intelligence (AI) has entered all aspects of life. As we all know, the core supporting AI training is data, especially high-quality data that is accurate and representative of the distribution. In real life, except for a few giant companies that can meet the requirements, most enterprises have the problem of small amount of data and poor data quality, which is not enough to support the realization of artificial intelligence technology; at the same time, domestic and foreign regulatory environments are gradually strengthening data protection, and succe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L41/042H04L41/044H04L41/0823H04L41/14H04L41/16H04L45/12G06K9/62G06N20/00
CPCH04L41/0823H04L41/145H04L41/042H04L41/044H04L41/16H04L45/12G06N20/00G06F18/2321G06F18/214Y02D30/70
Inventor 赵海涛张晨虎陈泽超夏文超倪艺洋孔志鹏彭敏鑫徐婧徐林林
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products