Intelligent Spectrum Cooperative Sensing Method Based on Reinforcement Learning

A technology of reinforcement learning and collaborative sensing, applied in the field of spectrum sensing, can solve the problems that node detection capabilities are vulnerable to weakening and shadow effects, and achieve the effect of reducing scanning overhead and improving detection probability

Active Publication Date: 2021-02-02
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In a cognitive radio network, since the channel occupancy of the PU is unknown to the SU, the SU needs to detect the occupancy of each channel by the PU successively, so the above traditional algorithms will cause excessive scanning overhead and delay. Appropriate selection of the sensing and access sequence of the authorized channel plays a crucial role in determining the average delay and effective throughput; secondly, because the detection ability of the node is easily affected by fading and shadow effects, the detection ability of the node is dynamically changed, How to select appropriate sub-users for cooperation in the case of dynamic changes in node detection capabilities is also a problem worthy of attention

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent Spectrum Cooperative Sensing Method Based on Reinforcement Learning
  • Intelligent Spectrum Cooperative Sensing Method Based on Reinforcement Learning
  • Intelligent Spectrum Cooperative Sensing Method Based on Reinforcement Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to facilitate those of ordinary skill in the art to understand the present invention, at first the technical terms are defined as follows:

[0038] Primary user: The user who has the priority to use the spectrum and is authorized to use the spectrum.

[0039] Secondary user: A user who can share spectrum resources with the primary user without posing a threat to the normal communication of the primary user.

[0040]Cooperative secondary user: a secondary user that helps other secondary users to perform spectrum sensing.

[0041] Q-Learning: A reinforcement learning algorithm, the agent perceives the environment by performing actions in the environment to obtain a certain reward, so as to learn the mapping strategy from state to action to maximize the reward value.

[0042] Bandit gambling machine: A reinforcement learning algorithm with n arms, each of which generates a reward with a certain unknown probability. The purpose of the algorithm is to obtain the ma...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent spectrum cooperative sensing method based on reinforcement learning, which is applied in the field of spectrum sensing. k , when a call request arrives, firstly, according to the channel priority list obtained by learning the latest channel status of each user based on Q-Learning technology, a decision to perceive the channel is made to minimize the scanning overhead; secondly, the node can detect the channel Request other SUs to perform cooperative spectrum sensing to improve the detection probability, and select secondary users with strong detection capabilities to cooperate through the bandit gambling machine mechanism to improve the detection probability; once the channel is detected, broadcast the status and detection weight of the detected channel to notify other SUs For the secondary user, the method of the invention effectively reduces the average channel scanning times, reduces the call blocking rate, and improves the detection probability.

Description

technical field [0001] The invention belongs to the technical field of spectrum sensing in wireless mobile communication networks, and in particular relates to a cooperative spectrum sensing method in wireless mobile communication networks. Background technique [0002] With the rapid development of the information industry, especially the wireless mobile communication industry, the demand for wireless spectrum resources has increased sharply, and the contradiction between the scarcity of spectrum resources and the inefficiency of existing fixed radio spectrum resource allocation strategies has become increasingly obvious. Spectrum utilization has become the core problem to be solved urgently in wireless communication. Facing the severe challenge of the scarcity of wireless communication spectrum resources, changing the traditional fixed resource allocation to dynamic resource allocation, so as to effectively improve the utilization of spectrum resources has been more and mo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04B17/382H04W24/04
CPCH04W24/04H04B17/382
Inventor 吴凡宁文丽黄晓燕马立香冷甦鹏
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products