Wireless network resource allocation method based on deep reinforcement learning

A wireless network resource and enhanced learning technology, applied in the field of wireless communication and artificial intelligence decision-making, can solve the problem of ineffective allocation of wireless resources in a time-varying channel environment

Active Publication Date: 2019-03-15
UNIV OF SCI & TECH BEIJING
View PDF9 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the present invention is to provide a wireless network resource allocation method based on deep enhanced learning to solve the problem in the prior art that wireless resource allocation in a time-varying channel environment cannot be effectively realized

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Wireless network resource allocation method based on deep reinforcement learning
  • Wireless network resource allocation method based on deep reinforcement learning
  • Wireless network resource allocation method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, the following will describe in detail with reference to the drawings and specific embodiments.

[0052] Aiming at the existing problem that wireless resource allocation in a time-varying channel environment cannot be effectively realized, the present invention provides a wireless network resource allocation method based on deep enhanced learning.

[0053] Such as figure 1 As shown, the wireless network resource allocation method based on deep enhanced learning provided by the embodiment of the present invention includes:

[0054] S101, establish a convolutional neural network q consisting of two identical parameters eval ,q target Constitute a deep reinforcement learning model (Deep Q Network, DQN);

[0055] S102, modeling the time-varying channel environment between the base station and the user terminal as a finite-state time-varying Markov cha...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a wireless network resource allocation method based on deep reinforcement learning. The energy efficiency in time-varying channel environment can be maximally improved with relatively low complexity. The method comprises the following steps: establishing a deep reinforcement learning model; modeling the time-varying channel environment between a base station and a user terminal as a time-varying Markov channel in a finite state, determining a normalization channel coefficient, and inputting a convolution neural network qeval, selecting an action with the maximum output return value as a decision action, and allocating the sub-carrier for the user; allocating downlink power for the user reusing on each subcarrier based on the inverse ratio of the channel coefficient according to a subcarrier allocation result, and determining a return function based on the allocated downlink power, and feeding back the return function to the deep reinforcement learning model; andtraining the convolution neural network qeval and qtarget in the deep reinforcement learning model according to the determined return function, and determining the power local optimal allocation underthe time-varying channel environment. The wireless network resource allocation method provided by the invention relates to the field of the wireless communication and artificial intelligence decision.

Description

technical field [0001] The present invention relates to the fields of wireless communication and artificial intelligence decision-making, in particular to a method for allocating wireless network resources based on deep reinforcement learning. Background technique [0002] Since the Long Term Evolution (LTE) era, the network construction architecture has changed from a macro network to a macro-micro synergy. The sustainable development of a macro cell (Macro Cell) is facing many challenges, such as unpredictable service growth requirements, ubiquitous access Incoming demand, random hotspot deployment, and the great cost pressure of the macro cell itself. Therefore, small base stations (Small Cells) such as microcells and femtocells can provide precise coverage and supplement the advantages of blind areas, and gradually become an important link in network deployment to work with macro base stations and share the service pressure of macro base stations. The fifth generation o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04W52/14H04W52/24H04W52/26H04W52/34H04W72/04H04W72/08G06N3/08G06N3/04
CPCH04W52/143H04W52/241H04W52/265H04W52/346G06N3/08H04W72/044G06N3/045H04W72/543H04W72/53H04W72/542
Inventor 张海君刘启瑞皇甫伟董江波隆克平
Owner UNIV OF SCI & TECH BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products