LEO satellite channel allocation method based on reinforcement learning

A satellite channel and allocation method technology, applied in the field of LEO satellite applications, can solve problems such as time correlation, and achieve the effect of accelerating algorithm convergence

Active Publication Date: 2020-11-20
GUILIN UNIV OF ELECTRONIC TECH
View PDF10 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a LEO satellite channel allocation method based on reinforcement learning, which can realize cross-beam scheduling of LEO satellite channel resources, thereby adapting to business diff...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • LEO satellite channel allocation method based on reinforcement learning
  • LEO satellite channel allocation method based on reinforcement learning
  • LEO satellite channel allocation method based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0039] The present invention proposes a method for allocating LEO satellite channels based on reinforcement learning, the process of which is as follows Figure 4 As shown, the specific steps are as follows:

[0040] (1) Initialize the relevant parameters of the LEO satellite system, reset the number of pre-allocated channels to 0, and reset the beam set X, system channel set Y, and user set U according to the specific parameters of the system;

[0041] (2) The system pre-allocates a fixed number of channel resources to each beam, which is set to 10 in this embodiment;

[0042] (3) Within the time interval T of each service request, the system allocates resources to the user once. If the pre-allocated channel resources can meet the user's needs, the system will reclaim the surplus channel resources to the resource pool; if the pre-allocated channel cannot meet the user's needs Demand, the resource pool schedules channel resources, and trains the optimal allocation strategy th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an LEO satellite channel resource allocation method based on reinforcement learning. The LEO satellite channel resource allocation method comprises the following steps: (1) a satellite centralized resource pool pre-allocates channel resources to each beam cell; (2) if the pre-allocated resources are surplus, the pre-allocated resources are collected to a resource pool, andif the pre-allocated resources cannot meet user requirements, channel resources are scheduled in a dynamic allocation mode; (3) the system performs training by using a Q-Learning algorithm to search for an optimal allocation strategy, and performs dynamic channel scheduling according to the allocation strategy after the training is finished; and (4) the system enters the next service request timeinterval, and allocates the channels in a mode of combining fixed channel pre-allocation and dynamic channel scheduling. According to the method, the channel resources are managed through the centralized resource pool to adapt to the inter-beam service difference, and the problem of time correlation in channel allocation is solved by adopting reinforcement learning, so that efficient channel resource allocation of the LEO satellite system is realized.

Description

technical field [0001] The invention relates to the technical field of LEO satellite application, in particular to a reinforcement learning-based LEO satellite channel allocation method. Background technique [0002] Among various types of satellites, low-orbit satellites have the characteristics of small path loss, short communication delay, and flexible orbital positions. Through low-orbit satellite constellations, seamless coverage of global regions can be achieved. However, resources such as spectrum, power, and time slots available for satellite systems are extremely scarce and valuable, and it is an urgent problem to allocate satellite network resources reasonably and efficiently. [0003] Due to the dynamic changes in the coverage area caused by satellite movement and the non-uniform distribution of ground users, the traffic load is changing all the time, and the on-board resources of low-orbit satellites have been solidified when they leave the factory. The tradition...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04B7/185
CPCH04B7/18539H04B7/18543
Inventor 郑飞皮昭周陬仇洪冰
Owner GUILIN UNIV OF ELECTRONIC TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products