Cognitive radio space-frequency two-dimensional anti-hostility jamming method based on deep reinforcement learning

A technology of cognitive radio and reinforcement learning, applied in the field of two-dimensional anti-hostile interference of cognitive radio space frequency, can solve the problem of rapid decline in learning speed, achieve the effect of improving communication efficiency and speeding up learning speed

Inactive Publication Date: 2017-07-18
XIAMEN UNIV
View PDF3 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a recognition method based on deep reinforcement learning that can overcome the problem that the artificial neural network needs to classify the data first in the training process and that the learning speed of the Q learning algorithm will decrease rapidly when the state set and action set dimensions are large. Two-dimensional anti-hostile jamming method for radio space frequency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cognitive radio space-frequency two-dimensional anti-hostility jamming method based on deep reinforcement learning
  • Cognitive radio space-frequency two-dimensional anti-hostility jamming method based on deep reinforcement learning
  • Cognitive radio space-frequency two-dimensional anti-hostility jamming method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The technical solutions of the present invention will be further described below in conjunction with the examples.

[0036] A cognitive radio air frequency two-dimensional anti-hostile jamming method based on deep reinforcement learning includes the following steps:

[0037] Step 1: Construct a deep convolutional neural network, including 2 convolutional layers and 2 fully connected layers. The first layer is a convolutional layer with an input size of 36, including 20 convolution kernels of 3×3 with a step of 1 and an output size of 20×4×4; the second layer is a convolutional layer with an input size of 20×4×4, including 40 2×2 convolution kernels, the step is 1, and the output size is 40×3×3; the third layer is a fully connected layer, the input size is 360, and the output size is 180; The last layer is a fully connected layer with an input size of 180 and an output size of 129. All four layers use the ReLU function as the activation function.

[0038] Step 2: Initi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a cognitive radio space-frequency two-dimensional anti-hostility jamming method based on deep reinforcement learning. A cognitive radio secondary user observes an access state of a cognitive radio primary user and a signal to jamming ratio of a wireless signal under a state of unknowing a jammer attack mode and a wireless channel environment, and decides whether to leave the located interfered region or select an appropriate frequency point to send the signal by use of a deep reinforcement learning mechanism. A deep convolutional nerve network and Q learning are combined, the Q learning is used for learning an optimal anti-jamming strategy in a wireless dynamic game, and an observation state and acquired benefit are input into the deep convolutional nerve network as a training set to accelerate the learning speed. By use of the deep reinforcement learning mechanism, the communication efficiency for competing hostility jammer by the cognitive radio under a wireless network environment scene in dynamic change is improved. A problem that the learning speed is fast reduced since an artificial nerve network needs to firstly classify the data in the training process and the Q learning algorithm is large in dimension in a state set and an action set can be overcome.

Description

technical field [0001] The invention relates to wireless network security, in particular to a cognitive radio space-frequency two-dimensional anti-hostile interference method based on deep reinforcement learning. Background technique [0002] With the rapid development of wireless communication, problems such as the shortage and utilization of spectrum resources are becoming more and more serious. The proposal of cognitive radio (Cognitive Radio, CR) technology can effectively improve the utilization of spectrum. Since cognitive radio adopts an open spectrum and a dynamic access method, it is extremely vulnerable to hostile interference attacks, and its security issues need to be resolved urgently. [0003] The hostile jammer prevents legitimate users from forwarding normal data by occupying the communication channel of network nodes, and then launches a denial of service attack (DoS). As a traditional anti-interference technology, spread spectrum communication can effectiv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04W16/14H04W24/02G06N3/08G06N99/00
CPCH04W16/14G06N3/08G06N3/084G06N20/00H04W24/02
Inventor 肖亮韩国安李炎达
Owner XIAMEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products