Beam-hopping resource allocation method, system, storage medium and device based on deep reinforcement learning

A technology of resource allocation and reinforcement learning, which is applied in the field of allocation of beam-hopping resources, can solve problems such as poor delay performance and lack of continuity of different traffic volumes, and achieve dynamic resource management problems, moderate computational complexity, and reduced number of operations Effect

Active Publication Date: 2022-06-24
HARBIN INST OF TECH +1
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the problem that the existing beam-hopping satellite communication system has poor time-delay performance due to the lack of continuity when the service scene is constantly changing during resource allocation, the present invention implements a beam-hopping resource allocation method based on reinforcement learning. Research

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Beam-hopping resource allocation method, system, storage medium and device based on deep reinforcement learning
  • Beam-hopping resource allocation method, system, storage medium and device based on deep reinforcement learning
  • Beam-hopping resource allocation method, system, storage medium and device based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach 1

[0039] This embodiment is a beam-hopping resource allocation method based on deep reinforcement learning, including the following steps:

[0040] 1. Build a beam-hopping satellite communication system model as the basis for analysis of the beam-hopping resource allocation algorithm:

[0041] The schematic diagram of beam hopping satellite communication scenario is as follows figure 1 As shown, the satellite provides K beams covering N cells in total C={c n |n=1,2,...,N}, c n which is figure 1 In the cell, the satellite has the function of beam hopping. It is assumed that the traffic request of each cell is expressed in the form of data packets, and the size of each data packet is Mbit, subject to the arrival rate. The Poisson distribution of , where is t j time cell c n The arrival rate of ; there is a buffer on the star, and the packets in the buffer are in means t j time cell c n The number of buffered packets; the maximum effective delay of a packet is T th ...

specific Embodiment approach 2

[0086] This embodiment is a beam hopping resource allocation system based on deep reinforcement learning, and the system is used for the beam hopping resource allocation method based on deep reinforcement learning.

specific Embodiment approach 3

[0087] This embodiment is a storage medium, and the storage medium stores at least one instruction, and the at least one instruction is loaded and executed by a processor to implement the deep reinforcement learning-based beam hopping resource allocation method.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A beam-hopping resource allocation method, system, storage medium and device based on deep reinforcement learning belongs to the field of communication technology. In order to solve the problem that the existing beam-hopping satellite communication system has poor delay performance due to the lack of continuity when the service scene is constantly changing during resource allocation, the present invention divides ground service requests into real-time data services and non-real-time data services. There are two types of real-time data services, and the optimization functions are established respectively; the maximum effective time length of the data in the satellite buffer is T th It is divided into M segments of equal length, corresponding to M beam-hopping time slots; the ground cell traffic request composed of data packet delay, number of real-time data packets, and non-real-time data packets is regarded as the environmental state S, and the satellite beam is regarded as the agent , taking the illumination of the cell as an action, considering the optimization problem of resource allocation in the satellite beam-hopping technology as a Markov decision process, and performing beam-hopping resource allocation based on a deep Q-network. It is mainly used for allocation of beam hopping resources.

Description

technical field [0001] The invention relates to a method for allocating beam hopping resources, and belongs to the technical field of communication. Background technique [0002] Satellite communication has the characteristics of wide coverage area, large communication capacity, good transmission quality, rapid networking and not affected by geographical climate environment. Despite the rapid development of land mobile communication systems and networks, in vast and sparsely populated areas and areas with harsh natural environment, it is still necessary to rely on the unique technical characteristics of satellite communication to provide communication services and cooperate with land mobile communication networks to form the world. The Internet achieves seamless global coverage. The satellite communication system is a typical resource-constrained system, and the limited on-board payload and spectrum resources are the key factors restricting development. Therefore, how to re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04B7/185G06N3/04G06N3/08
CPCH04B7/18513H04B7/18519G06N3/08G06N3/045
Inventor 杨明川窦映喆焦利彬薛冠昌谢冰玉
Owner HARBIN INST OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap