Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-base-station cooperative wireless network resource allocation method based on spatial-temporal feature extraction reinforcement learning

A technology of wireless network resources and reinforcement learning, which is applied in the field of multi-base station cooperative wireless network resource allocation, can solve problems such as lack of flexibility and scalability, and failure to respond well, so as to improve user experience, increase service satisfaction rate, reduce The effect of negative influence

Active Publication Date: 2021-12-17
ZHEJIANG LAB +1
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Traditional dedicated resource allocation schemes and resource allocation strategies based on optimization algorithms and heuristic algorithms often have strict restrictions and complex derivations to form specific optimization problems. Such methods lack flexibility and scalability. When user characteristics and The proportion of users with various performances changes, and these algorithms cannot cope well

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-base-station cooperative wireless network resource allocation method based on spatial-temporal feature extraction reinforcement learning
  • Multi-base-station cooperative wireless network resource allocation method based on spatial-temporal feature extraction reinforcement learning
  • Multi-base-station cooperative wireless network resource allocation method based on spatial-temporal feature extraction reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to describe in detail the technical content, structural features, achieved goals and effects of the technical solution, the following will be described in detail in conjunction with the accompanying drawings.

[0048] refer to figure 1 , is a flow chart of the multi-base station cooperative network resource allocation method based on time feature extraction and reinforcement learning of the present invention, specifically including the following steps:

[0049] S1. Algorithm network structure G and target network Build and initialize, including the following sub-steps:

[0050] S11. Algorithmic network structure of the method It includes three parts: state vector encoding network (Embed), graph attention mechanism network (GAT) and deep Q network (DQN).

[0051] S12. The state vector encoding network is composed of two layers of fully connected networks, denoted as

[0052] ,

[0053] in , is the weight matrix of the layer, is the "ReLu" activati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-base-station cooperative wireless network resource allocation method based on spatial-temporal feature extraction reinforcement learning, which comprises the following steps of: extracting position information and spatial features of each 5G base station through a graph attention mechanism, learning behavior habits of network users by using a long-short-term memory mechanism, extracting time features, and analyzing the fluctuation condition of each slice data packet in time and space.Compared with a resource allocation policy based on an optimization algorithm and a genetic algorithm and a resource allocation policy based on traditional reinforcement learning, the method has the advantages that higher system return, namely higher spectrum efficiency and better user experience, can be obtained, and meanwhile, the method can adapt to a dynamically changing environment, and is more flexible and robust.

Description

technical field [0001] The present invention relates to the technical field of wireless communication, in particular to a multi-base station collaborative wireless network resource allocation method based on spatio-temporal feature extraction reinforcement learning. Background technique [0002] At present, 5G network has become an indispensable key link in the development of digital society. Compared with 4G network, the massive services it provides can meet our wider needs, and most of them cannot be realized by 4G. [0003] The ITU defines three main application scenarios for 5G: enhanced mobile broadband (eMBB), massive machine-type communication (mMTC), ultra-reliable low-latency communication (ultra-reliable low- latency communication, URLLC). Among them, eMBB is mainly applied to services such as AR / VR due to its high bandwidth, mMTC is applied to services such as the Internet of Things and smart home due to its high connection density, and URLLC with low latency and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04W72/04H04L12/24G06N3/04
CPCH04L41/145G06N3/044G06N3/045H04W72/53
Inventor 李荣鹏肖柏狄郭荣斌赵志峰张宏纲
Owner ZHEJIANG LAB
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products