A method for cognitive radio anti-interference intelligent decision based on reinforcement learning

A cognitive radio and reinforcement learning technology, applied in the field of intelligent cognitive radio

Active Publication Date: 2018-10-26
TIANJIN UNIV
View PDF3 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The traditional decision-making technology generally considers the performance of the optimal secondary user under the constraint of the interference of the secondary user to the authori...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for cognitive radio anti-interference intelligent decision based on reinforcement learning
  • A method for cognitive radio anti-interference intelligent decision based on reinforcement learning
  • A method for cognitive radio anti-interference intelligent decision based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The present invention will be described below in conjunction with the accompanying drawings and embodiments.

[0019] 1. Model Construction

[0020] The basis for describing the decision-making learning problem as a Markov decision process is to assume that the learning process is a problem with Markov properties, that is, the transition of the environment state at the next moment and the received reward function R only depend on the previous moment. The state S is related to the action a taken. Considering the existence of a single cognitive user and a single interferer, the channel selection and power selection problems of users and interferers are modeled. Assume that the transmit power level of the cognitive user is E, and the transmit power level of the jammer is F. Considering the division of multiple channels, the channels are divided into M according to different channel gains, and it is clearly pointed out that in a certain time slot, both cognitive users and...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for cognitive radio anti-interference intelligent decision based on reinforcement learning. The method includes the following steps: under the multichannel cognitivescene, a cognitive user takes perceived channel information and transmission power and channel selection information of an interference unit as state information S and actively selects transmission power and channel selection information to be action information a; the ratio of the signal to interference plus noise ratio SINR to the energy consumption E of the cognitive user is defined as an utility function R which serves as a measuring standard of the action selection performance of the cognitive user; in the cognitive decision model, the state information serves as a known condition, the action selection is decided by the cognition user as a body, the utility function serves as an instant return function in the reinforcement learning, a Q-learning reinforcement learning model is established, and the action decision optimized by the cognitive user is obtained.

Description

technical field [0001] The invention belongs to the field of intelligent cognitive radio, especially for the interaction between a cognitive user and a jammer, and uses a reinforcement learning algorithm in a machine learning algorithm to realize a cognitive radio anti-jamming decision-making problem. Background technique [0002] With the development of cognitive radio communication technology, the problem of lack of available spectrum resources is becoming more and more severe, and the number of cognitive users is increasing rapidly. Finding an effective strategy is very important for the allocation of idle spectrum. With the gradual maturity of cognitive radio technology, the role and status of military communication in modern warfare have been continuously improved, and the problem of anti-jamming in military communication has become increasingly prominent. The traditional decision-making technology generally considers the performance of the optimal secondary user under ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04W16/14H04W72/08
CPCH04W16/14H04W72/541
Inventor 马永涛朱芮
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products