Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed dynamic spectrum access method based on multi-agent reinforcement learning

A dynamic spectrum access, multi-agent technology, applied in neural learning methods, character and pattern recognition, instruments, etc., can solve the problems of primary user interference and low throughput of communication systems, reduce access conflicts, and improve utilization Efficiency, the effect of scalable network scale

Pending Publication Date: 2022-01-11
NAT UNIV OF DEFENSE TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention provides a distributed dynamic spectrum access method and system based on multi-agent reinforcement learning, which is used to overcome the interference of the primary user during data transmission when the cognitive user has the opportunity to access the spectrum hole of the authorized user in the prior art , at the same time, there will be access conflicts between cognitive users, which will lead to defects such as low throughput of the communication system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed dynamic spectrum access method based on multi-agent reinforcement learning
  • Distributed dynamic spectrum access method based on multi-agent reinforcement learning
  • Distributed dynamic spectrum access method based on multi-agent reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0024] In addition, the technical solutions of the various embodiments of the present invention can be combined with each other, but it must be based on the realization of those skilled in the art. When the combination of technical solutions is contradictory or cannot be realized, it should be considered as a combination of technical solutions. Does not exist, nor is it within the scope of protection required by the present invention.

[0025] Unless ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed dynamic spectrum access method based on multi-agent reinforcement learning, and the method enables a multi-user distributed dynamic spectrum access problem to be modeled into a multi-agent Markov cooperative game model, and constructs a centralized training and distributed execution multi-agent reinforcement learning framework. The multi-agent reinforcement learning framework comprises an offline training module and an online execution module, the online execution module performs spectrum access of the cognitive user by using a learned access strategy, and the offline training module dynamically updates the online execution module according to a spectrum access result of the cognitive user. The invention provides a multi-user cooperative spectrum access method with self-adaptive communication environment and extensible network scale, which reduces access conflicts among cognitive users while avoiding interference to authorized users, thereby maximizing the access success rate of the cognitive users and improving the utilization efficiency of the spectrum.

Description

technical field [0001] The invention relates to the technical field of wireless communication networks, in particular to a distributed dynamic spectrum access method and system based on multi-agent reinforcement learning. Background technique [0002] In cognitive wireless networks, cognitive users use the overlay method to opportunistically access spectrum holes of authorized users for data transmission. Distributed multi-user dynamic spectrum access faces two major challenges: one is to avoid the interference of cognitive users to the primary user, that is, when the primary user occupies the licensed spectrum for data transmission, the cognitive user cannot access the corresponding spectrum; the other is Avoid access conflicts between cognitive users, that is, prevent more than two cognitive users from accessing the same spectrum hole, resulting in unsuccessful data transmission. Due to the limited perception ability of a single cognitive node, only part of the channel st...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04W74/08H04W24/08G06K9/62G06N3/08
CPCH04W74/0833H04W74/085H04W24/08G06N3/08G06F18/214G06F18/295
Inventor 周力谭翔魏急波赵海涛熊俊高文颖唐麒张姣曹阔刘潇然
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products