Design method of mu-miso hybrid precoding based on multi-agent deep reinforcement learning

A technology of reinforcement learning and design method, which is applied in the field of MU-MISO hybrid precoding design, can solve the problems of high complexity of hybrid precoding and poor attainable rate performance, and achieve shortened learning time, fast calculation convergence, and accelerated explore the effect

Active Publication Date: 2022-02-01
SOUTHEAST UNIV
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Technical problem: Aiming at the deficiencies of the above technologies, provide a solution to the problem of high complexity of hybrid precoding design and poor attainable rate performance in massive MIMO systems, and has strong robustness to the channel environment. MU-MISO hybrid precoding design method for multi-agent deep reinforcement learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Design method of mu-miso hybrid precoding based on multi-agent deep reinforcement learning
  • Design method of mu-miso hybrid precoding based on multi-agent deep reinforcement learning
  • Design method of mu-miso hybrid precoding based on multi-agent deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] Below in conjunction with accompanying drawing, the present invention will be further described:

[0053] Such as figure 1 As shown, the MU-MISO hybrid precoding design method based on multi-agent deep reinforcement learning of the present invention considers a MU-MISO downlink, and the base station performs hybrid beamforming design according to the following steps:

[0054] Step 1. Base station configuration N t = 64 transmitting antennas, serving K = 8 single-antenna users; the base station knows the channel matrix h between it and each user k k ; Let t=0; Initialize Y=2 deep reinforcement learning agents composed of neural networks to learn the simulated precoding matrix F respectively RF,i And calculate the corresponding digital precoding matrix F D,i ; An evaluation network is used to coordinate the behavior of each agent; a reward value prediction network is used to accelerate the exploration of each agent; the evaluation network and reward value prediction ne...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a MU-MISO hybrid precoding design method based on multi-agent deep reinforcement learning, which is suitable for downlink systems in communication. In this method, the base station constructs multiple deep reinforcement learning agents for calculating the simulated precoding matrix, each agent includes an action prediction network and an experience pool with priority, and each agent shares a centralized reward value prediction network and a centralized evaluation network to jointly explore analog precoding strategies. In this method, the base station obtains the channel state information of multiple users, inputs the user channel information into the constructed agent, and outputs the corresponding analog precoding matrix; and then calculates the digital precoding vector of each user through the zero-forcing precoding and water injection algorithm. Digital precoding matrix. It can effectively solve the problems of high complexity of hybrid precoding design and poor performance of attainable rate in massive MIMO system, and has strong robustness to channel environment.

Description

technical field [0001] The invention relates to a MU-MISO hybrid precoding design method, and is especially suitable for the MU-MISO hybrid precoding design method based on multi-agent deep reinforcement learning used in downlink systems in communication. Background technique [0002] Massive Multiple-Input Multiple-Output (MIMO), as an effective method to improve network transmission rate and energy efficiency, is regarded as one of the key technologies of the new generation wireless communication network. The MIMO system can make full use of space resources and double the system capacity without increasing spectrum resources and antenna transmission power. [0003] However, massive MIMO systems still face many challenges in practical applications. The design of beamforming matrices in mmWave systems is constrained by expensive RF hardware. The traditional all-digital beamforming structure needs to be equipped with a radio frequency link for each transmitting antenna and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04B7/0413H04B7/0456G06N3/08G06N3/04G06F17/15
CPCH04B7/0413H04B7/0456G06N3/08G06F17/15G06N3/045
Inventor 李潇王琪胜金石
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products