A Method of Spectrum Resource Management and Allocation Based on Federated Learning

A spectrum resource and allocation method technology, applied in the direction of advanced technology, climate sustainability, sustainable communication technology, etc., can solve the problem of consuming large communication resources

Active Publication Date: 2022-06-03
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the wide distribution of data in the real environment, the base station collects these scattered data for centralized learning to complete resource scheduling. The danger of deriving private information such as the location of the secondary user and the communication frequency band from the sent information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method of Spectrum Resource Management and Allocation Based on Federated Learning
  • A Method of Spectrum Resource Management and Allocation Based on Federated Learning
  • A Method of Spectrum Resource Management and Allocation Based on Federated Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] S

[0072] Because the state information includes the last moment action of the terminal device and the environmental information observed by the terminal device,

[0074]

[0080] a

[0086]

[0089]

[0092]

[0093]

[0094]

[0095]

[0101] The loss function expression of the critic network is:

[0102] L(θ)=[r(s, a)+γQ(s', π(s'; θ

[0103] where r(s, a) is the reward obtained by the action taken in the current state, γ is the discount factor, and θ is the main critic

[0105]

[0106] Calculate the gradient of the critic network loss function, and its expression is:

[0107]

[0109]

[0111] Update the critic network parameters of the main network, and its expression is:

[0112]

[0114] The terminal device can complete the iterative update of the local network through the above process.

[0121]

[0122]

[0123]

[0130] The present invention combines asynchronous federated learning with full spectrum management for the first time, wherein the asynchronous is embod...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for managing and allocating frequency spectrum resources based on federated learning. The method includes that the terminal device collects state information from the environment; if the information change exceeds a threshold value, making a decision on the frequency spectrum, sub-channel and transmission power of the channel transmission; the terminal device collects the state information and reward information at the next moment after the decision, And use the gradient descent method to train the actor network and critic network in the main network; when the cumulative gradient of the terminal device reaches the preset gradient threshold, the main network parameters are uploaded to the base station; the main network parameters collected by the base station reach the threshold After the value is set, the main network parameters are aggregated and broadcast to all terminal devices according to the preset weight; the terminal devices update the parameters of their main network and target network after receiving the aggregated parameters. In order to solve the problems of low spectrum utilization rate and easy disclosure of user privacy in the prior art, the present invention adopts an asynchronous federated learning method, and has the advantage of low communication consumption while solving the above problems.

Description

A Spectrum Resource Management and Allocation Method Based on Federated Learning technical field The present invention relates to a kind of spectrum resource management allocation method, relate in particular to a kind of spectrum resource based on federated learning Manage distribution methods. Background technique In the future communication network, the increasing scale of terminal equipment and the continuous emergence of diversified service types, the network The network capacity creates enormous pressure. Even if the full spectrum is used, there are still challenges in the face of huge bandwidth requirements. only full Only by improving the utilization rate of the full spectrum can the network load be effectively relieved and the service quality of users can be satisfied to the greatest extent. However, compared to In the existing wireless communication system, the spectrum resources of the full-spectrum network show differences and high dynamics, while the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04W72/04H04L41/142
CPCH04W72/0453H04L41/142H04W72/53Y02D30/70
Inventor 张科袁鑫
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products