A Heterogeneous Network Resource Allocation Method Based on Reinforcement Learning

A heterogeneous network and resource allocation technology, applied in the field of heterogeneous network resource allocation based on reinforcement learning, can solve problems such as unavailability, and achieve the effect of ensuring spectrum efficiency and system throughput

Active Publication Date: 2021-05-25
NANJING UNIV OF POSTS & TELECOMM
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these methods require nearly complete information, which may not often be available
Therefore, for the above methods, it is challenging to achieve an optimal solution without such complete information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Heterogeneous Network Resource Allocation Method Based on Reinforcement Learning
  • A Heterogeneous Network Resource Allocation Method Based on Reinforcement Learning
  • A Heterogeneous Network Resource Allocation Method Based on Reinforcement Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0070] The present invention will be further described below in conjunction with the accompanying drawings.

[0071] Such as figure 1 The two-layer heterogeneous cellular network shown includes M base stations and N mobile users, in which the macro base station MBS has , micro base station PBS has and satisfy . Each cell base station is located in the center of each cell, and its authorized mobile users are randomly distributed in the cell. It is assumed that there is an overlapping area between every two adjacent small cells. It is assumed that each communication terminal is equipped with an antenna for signal transmission. In order to maximize the use of radio resources and avoid trivial cases, the frequency reuse factor is set to 1. To avoid intra-cell interference, it is assumed that each user in each cell is allocated only one subcarrier, so all signals are on the same subcarrier The cells in the carrier are orthogonal. The N orthogonal subcarriers used in a cel...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a heterogeneous network resource allocation method based on reinforcement learning. Firstly, a DNN framework is deployed in each base station. The framework is based on the ADMM algorithm, and the channel information is regarded as the weight of the network; according to the data obtained by the base station, that is The current user association information and average interference power give the best resource allocation strategy in the current state; each base station is regarded as an independent subject, and the state of the base station is used as a modeling environment; several agents observe the same heterogeneous network environment and Take actions, and at the same time, the agents communicate with each other through the rewards of the environment; the agents adjust the policy according to the rewards; the resource allocation method provided by the present invention is based on the deep learning network, and the resource allocation plan can be given without all CSI information, while considering the spectrum efficiency , setting the spectral efficiency function as the reward of the agent can guarantee the spectral efficiency while ensuring the system throughput.

Description

technical field [0001] The invention relates to the technical field of wireless communication, and mainly relates to a method for allocating heterogeneous network resources based on reinforcement learning. Background technique [0002] With the rapid growth of mobile devices and the emergence of the Internet of Things, next-generation wireless networks face the great challenge of coping with the proliferation of wireless applications. The most promising solution is to augment existing cellular networks with picocells and femtocells with various transmission powers and coverages. These heterogeneous networks (HetNets) can transfer user equipment (UE) from macro base stations (MBS) to pico base stations (PBS), which differ in transmission power and coverage. Furthermore, in order to achieve high spectral efficiency in heterogeneous networks, PBS can reuse MBS and share the same channel with MBS. Therefore, heterogeneous networks are considered to be a good strategy to increa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04W16/10H04W52/24H04W52/34H04W72/04
CPCH04W16/10H04W52/244H04W52/346H04W72/0453H04W72/0473
Inventor 孙君吴锡
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap