Millimeter wave hybrid beam forming design method based on deep reinforcement learning

A technology of reinforcement learning and hybrid beams, applied in neural learning methods, diversity/multi-antenna systems, space transmit diversity, etc., can solve problems such as time complexity reduction, weak penetration, and practical application difficulties

Active Publication Date: 2020-05-19
SOUTHEAST UNIV
View PDF4 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the time complexity is reduced after applying these methods, certain system performance is sacrificed
The deep supervised learning method has high requirements on the amount of training data and is very sensitive to channel fading changes. For millimeter-wave channels with weak penetration and fast attenuation, it is still difficult to apply in practice.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Millimeter wave hybrid beam forming design method based on deep reinforcement learning
  • Millimeter wave hybrid beam forming design method based on deep reinforcement learning
  • Millimeter wave hybrid beam forming design method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The present invention will be further described below in conjunction with the accompanying drawings.

[0043] Considering a mmWave massive MIMO point-to-point downlink, the base station performs hybrid beamforming design according to the following steps:

[0044] Step 1, step 1, time t=0, the base station configures N t A uniform linear antenna array with antenna elements, sending N s = 6 independent data streams, the user side is equipped with N r = A uniform linear antenna array of 32 antenna units; the base station and the user side are equipped with and RF links; the base station knows the channel matrix between itself and the user where N cl =10 is the number of scattering clusters, N ray =8 is the number of scattering and reflection paths of each scattering cluster, α ij is the path gain of the j-th path in the i-th cluster, and the normalized transmitter channel response vector Normalized Receiver Channel Response Vector Antenna Element Spacing ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a millimeter wave hybrid beam forming design method based on deep reinforcement learning, and the method comprises the steps that a base station obtains an analog precoding matrix of a user through the calculation of cross-correlation according to the obtained channel state information of the user; constructing a deep reinforcement learning intelligent agent for jointly optimizing the digital precoding matrix and the analog merging matrix of the user, inputting user channel information and the analog precoding matrix into the intelligent agent, and outputting the corresponding digital precoding matrix and the analog merging matrix; and calculating a digital merging matrix of the user based on a minimum mean square error criterion. According to the invention, the millimeter wave hybrid beam forming design method based on deep reinforcement learning is high in convergence speed and good in robustness, and the spectral efficiency of the system can be effectively improved.

Description

technical field [0001] The invention relates to a millimeter-wave hybrid beamforming design method based on deep reinforcement learning, and belongs to the technical field of adaptive transmission of a point-to-point MIMO downlink system configured with a uniform linear antenna array at a base station. Background technique [0002] As an effective method that can increase network transmission rate and alleviate the shortage of spectrum resources, millimeter wave communication is regarded as one of the key technologies of the new generation wireless communication network. The millimeter-wave communication system combined with massive multiple-input multiple-output (MIMO) can make full use of space resources, realize multiple transmission and multiple reception through multiple antennas, and double the system channel capacity without increasing spectrum resources and antenna transmission power , and at the same time effectively solve the problems of weak penetrating power and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04B7/06G06N3/08G06N3/04
CPCH04B7/0617G06N3/08G06N3/045
Inventor 李潇王琪胜金石
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products