Non-terrestrial network communication method and device based on hybrid automatic repeat request

By using the Markov decision-making process model in non-terrestrial networks to optimize the bit rate allocation and disable feedback retransmission strategy, the problem of low transmission efficiency and timeliness in the prior art is solved, and the information transmission efficiency and timeliness are significantly improved.

CN118282588BActive Publication Date: 2024-12-03HARBIN INSTITUTE OF TECHNOLOGY (SHENZHEN) (INSTITUTE OF SCIENCE AND TECHNOLOGY INNOVATION HARBIN INSTITUTE OF TECHNOLOGY SHENZHEN)
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410515115.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-04-26
Publication Date
2024-12-03
Estimated Expiration
2044-04-26

AI Technical Summary

Technical Problem

The existing hybrid automatic retransmission request method has low transmission efficiency and timeliness in non-terrestrial network scenarios, making it difficult to meet the requirements of reliability and information timeliness.

Method used

Using the Markov decision-making process model method, we optimize the bit rate allocation strategy and disable feedback retransmission strategy by pre-constructing timing decisions for bit rate allocation and disabling feedback retransmission strategy to improve information transmission efficiency and timeliness.

Benefits of technology

It significantly improves information transmission efficiency, improves the information timeliness performance of non-terrestrial network encoding HARQ systems, and reduces the age of encoding information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118282588B_ABST
    Figure CN118282588B_ABST
Patent Text Reader

Abstract

The non-terrestrial network communication method and device based on hybrid automatic repeat request provided by the present invention specifically relates to the field of digital communication technology, and the scheme includes: obtaining several codeword sequences in non-terrestrial network communication; using a pre-constructed Markov decision process model to make decisions on the code rate allocation and the timing of disabling feedback retransmission of each codeword sequence in each hybrid automatic repeat request process, and obtaining the optimal code rate allocation strategy and the optimal disabling feedback retransmission strategy; executing each hybrid automatic repeat request process according to the optimal code rate allocation strategy and the optimal disabling feedback retransmission strategy to transmit each codeword sequence. The scheme can effectively increase the amount of information transmitted in each hybrid automatic repeat request process, thereby significantly improving the transmission efficiency of information, and can effectively improve the information timeliness performance of the non-terrestrial network coding HARQ communication system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of digital communication technology, and in particular to a non-terrestrial network communication method and device based on hybrid automatic repeat request. Background Art

[0002] Non-Terrestrial Network (NTN) is an important scenario for next-generation communications, with the characteristics of long distance and wide coverage, aiming to achieve seamless communication coverage. In the communication scenario between non-geosynchronous orbit satellites and the ground, the channel is time-varying due to the change in satellite elevation angle, and due to the complex atmospheric environment and the long round-trip delay in satellite-ground communications, it is difficult to obtain accurate and real-time channel status information, making it impossible to meet the requirements of reliability and information timeliness in some communication scenarios.

[0003] The Hybrid Automatic Repeat Request (HARQ) technology combines the channel coding technology of the physical layer and the Automatic Repeat Request (ARQ) protocol of the link layer, and is a key technology to ensure reliable transmission of non-terrestrial network communications. HARQ improves the continuous adaptability of coding to time-varying channels through feedback and retransmission. When the receiving end decodes correctly, it transmits positive feedback to the sending end, and the sending end continues to transmit the next codeword; when the receiving end decodes incorrectly, it transmits negative feedback to the sending end, and the sending end retransmits the current codeword, resulting in a large delay in information transmission, thereby reducing information timeliness and transmission efficiency.

[0004] In the existing hybrid automatic repeat request methods for non-terrestrial network scenarios that lack channel state information, mutual information is usually used to estimate channel distribution information to decode the required information bits, or a lookup table-assisted technology based on offline training is used to adjust the bit rate of each transmission. Although the implementation principles of these two methods are simple and easy to implement, they will both bring about a long round-trip delay problem in non-terrestrial network scenarios, resulting in low information timeliness and information transmission efficiency of the HARQ system. Summary of the invention

[0005] In view of the above-mentioned deficiencies in the prior art, an object of the present invention is to provide a non-terrestrial network communication method and apparatus based on hybrid automatic repeat request, aiming to solve the problems of low transmission efficiency and timeliness existing in the hybrid automatic repeat request method in the prior art.

[0006] In order to achieve the above object, the first aspect of the present invention provides a non-terrestrial network communication method based on hybrid automatic repeat request, comprising:

[0007] Acquire several codeword sequences in non-terrestrial network communications;

[0008] Using a pre-built Markov decision process model to make decisions on the code rate allocation and the timing of disabling feedback retransmission of each codeword sequence in each hybrid automatic repeat request process, to obtain an optimal code rate allocation strategy and an optimal disabling feedback retransmission strategy;

[0009] According to the optimal code rate allocation strategy and the optimal feedback-disabled retransmission strategy, the hybrid automatic repeat request process is performed each time to transmit each codeword sequence.

[0010] Optionally, the process of constructing the Markov decision process model includes:

[0011] Sending a codeword sequence in each hybrid automatic repeat request process according to a preset codeword structure construction method to obtain a channel state and action of each hybrid automatic repeat request process;

[0012] Obtaining a critical state based on a block error rate threshold of a communication system in which the non-terrestrial network communication is located;

[0013] Calculating the decoding error probability of each hybrid automatic repeat request process, and determining the state transition probability based on each decoding error probability;

[0014] Obtaining the transmission delay, feedback delay and queuing delay of each information bit in the codeword sequence of each hybrid automatic repeat request process, and obtaining a reward for each hybrid automatic repeat request process;

[0015] A Markov decision process model is constructed based on the channel state, action, transition probability and reward of each hybrid automatic repeat request process and the critical state.

[0016] Optionally, sending the codeword sequence in each hybrid automatic repeat request process according to the construction method of the preset codeword structure to obtain the channel state and action of each hybrid automatic repeat request process includes:

[0017] Sending a codeword sequence in each hybrid automatic repeat request process according to a preset codeword structure construction method to obtain a transmission code rate of each hybrid automatic repeat request process;

[0018] Based on each of the transmission code rates, respectively obtaining execution of feedback retransmission request or prohibition of feedback retransmission request;

[0019] Based on the feedback retransmission request and the feedback retransmission prohibition request, a channel state for feedback retransmission and a channel state for feedback retransmission prohibition are obtained respectively.

[0020] Optionally, the using of a pre-built Markov decision process model to make decisions on the code rate allocation of each code word sequence in each hybrid automatic repeat request process and the timing of disabling feedback retransmission to obtain an optimal code rate allocation strategy and an optimal disabling feedback retransmission strategy includes:

[0021] Taking the preset coding information age as the optimization target, a preset reinforcement learning algorithm is used to solve the Markov decision process model, and a decision is made on the code rate allocation of each code word in each code word sequence of each hybrid automatic repeat request process and the timing of disabling feedback retransmission, so as to obtain a decision strategy corresponding to the minimum coding information age;

[0022] Based on the decision strategy corresponding to the minimum coding information age, an optimal code rate allocation strategy and an optimal feedback-disabling retransmission strategy are obtained.

[0023] Optionally, the process of constructing the codeword structure includes:

[0024] Obtaining a previous code rate based on a code rate when the codeword sequence in a previous hybrid automatic repeat request process is decoded correctly;

[0025] Obtaining a subsequent code rate based on an actual code rate of a subsequent hybrid automatic repeat request when the codeword sequence in the prior hybrid automatic repeat request process is correctly decoded, and the subsequent code rate is not higher than the prior code rate;

[0026] Based on the previous code rate, the subsequent code rate and a preset allocation ratio, obtaining the inherited information bits and the new information bits in the subsequent hybrid automatic repeat request process;

[0027] Based on the inherited information bits and the new information bits, the codeword structure in the post-hybrid automatic repeat request process is constructed.

[0028] Optionally, the process of prohibiting feedback of the retransmission request includes:

[0029] The codeword sequence is sent according to the construction method of the codeword structure, and the code rate of sending the codeword sequence is gradually reduced according to the preset code rate interval until the code rate drops to a preset code rate threshold.

[0030] Optionally, the step of calculating the age of the coded information includes:

[0031] Obtaining the information age of each information bit in each codeword of all the codeword sequences in the non-terrestrial network communication in each hybrid automatic repeat request process;

[0032] Based on the average of the information ages of all the information bits, the coded information age is obtained.

[0033] A second aspect of the present invention provides a non-terrestrial network communication device based on hybrid automatic repeat request, the device comprising:

[0034] An information acquisition module, used to acquire a number of codeword sequences in non-terrestrial network communications;

[0035] A decision module, used to make decisions on the code rate allocation and the timing of disabling feedback retransmission of each code word sequence in each hybrid automatic repeat request process by using a pre-built Markov decision process model, so as to obtain an optimal code rate allocation strategy and an optimal disabling feedback retransmission strategy;

[0036] The transmission execution module is used to execute each of the hybrid automatic repeat request processes according to the optimal code rate allocation strategy and the optimal feedback-disabled retransmission strategy to transmit each of the codeword sequences.

[0037] A third aspect of the present invention provides an intelligent terminal, which includes a memory, a processor, and a non-terrestrial network communication program based on a hybrid automatic repeat request stored in the memory and executable on the processor, wherein the non-terrestrial network communication program based on a hybrid automatic repeat request, when executed by the processor, implements any one of the steps of the above-mentioned non-terrestrial network communication method based on a hybrid automatic repeat request.

[0038] A fourth aspect of the present invention provides a computer-readable storage medium, on which a non-terrestrial network communication program based on a hybrid automatic repeat request is stored. When the non-terrestrial network communication program based on a hybrid automatic repeat request is executed by a processor, any step of the above-mentioned non-terrestrial network communication method based on a hybrid automatic repeat request is implemented.

[0039] Compared with the prior art, the beneficial effects of this solution are as follows:

[0040] The present invention constructs a Markov decision process model based on a code rate-decreasing, inherited HARQ transmission codeword structure, and uses the Markov decision process model to allocate the code rate of each codeword sequence in each hybrid automatic repeat request process and make decisions on the timing of disabling feedback retransmission, so as to obtain the optimal code rate allocation strategy and the optimal feedback retransmission disabling strategy, thereby realizing efficient and rapid transmission of the codeword sequence, thereby effectively increasing the amount of information transmitted in each hybrid automatic repeat request process, thereby significantly improving the information transmission efficiency, and being able to effectively improve the information timeliness performance of a non-terrestrial network coding HARQ communication system. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0042] Figure 1 A flow chart of a non-terrestrial network communication method based on hybrid automatic repeat request of the present invention;

[0043] Figure 2 A schematic diagram of the evolution of the instantaneous coded information age in the non-terrestrial network coded HARQ communication system of the present invention;

[0044] Figure 3 A schematic diagram of the HARQ transmission codeword structure proposed by the present invention;

[0045] Figure 4 A schematic diagram of a feedback disabling strategy for each HARQ transmission codeword proposed by the present invention;

[0046] Figure 5 A schematic diagram of a HARQ-based Markov decision process model of the present invention;

[0047] Figure 6 It is a simulation diagram comparing the ages of coded information of different HARQ transmission methods of the present invention;

[0048] Figure 7 It is a throughput comparison simulation diagram of different HARQ transmission methods of the present invention;

[0049] Figure 8 A schematic diagram of the module composition of a non-terrestrial network communication device based on hybrid automatic repeat request of the present invention;

[0050] Fig. 9 It is a schematic diagram of the structure of the intelligent terminal of the present invention. DETAILED DESCRIPTION

[0051] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present invention. However, it should be clear to those skilled in the art that the present invention may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present invention.

[0052] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0053] It should also be understood that the terms used in the present specification are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the present specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0054] It should be further understood that the term "and / or" used in the present description and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0055] As used in this specification and the appended claims, the term "if" may be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0056] The following is a clear and complete description of the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0057] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0058] In view of the problems of low transmission efficiency and timeliness of the existing hybrid automatic repeat request method, the present invention proposes a non-terrestrial network coding HARQ method with high information timeliness, which mainly includes: constructing a Markov decision process model according to the non-terrestrial network coding HARQ process and a customized code rate step-by-step decreasing, inherited codeword structure, and taking the customized information timeliness evaluation index as the optimization target, using a reinforcement learning algorithm to solve the Markov decision process model to guide the HARQ code rate design and the selection of the timing of disabling feedback retransmission. The method can increase the amount of information transmitted in each hybrid automatic repeat request process, thereby significantly improving the information transmission efficiency, and can effectively improve the information timeliness performance of the non-terrestrial network coding HARQ system.

[0059] The embodiment of the present invention provides a non-terrestrial network communication method based on hybrid automatic repeat request, which is deployed on a non-terrestrial network communication device based on hybrid automatic repeat request and applied to a communication scenario of a non-terrestrial network, and is aimed at transmitting a target information sequence based on a hybrid automatic repeat request process. Specifically, Figure 1 As shown, the steps of the method in this embodiment include:

[0060] Step S100: obtaining a plurality of codeword sequences in non-terrestrial network communications;

[0061] Specifically, a preset channel coding strategy is used to encode the target information sequence to be transmitted in the non-terrestrial network communication in parallel or serially to obtain several codeword sequences, one codeword sequence includes one or more codewords, that is, one or more codewords can be transmitted in a hybrid automatic repeat request process. The target information sequence refers to a network or network segment that uses airborne or space vehicles to carry transmission equipment relay nodes or base stations according to the 3GPP standard to provide consumers with 5G New Radio (NR) and narrowband Internet of Things (NB-IoT) and LTE for machine type communication (LTE-M) and other types of communication services that need to be transmitted.

[0062] Step S200: using a pre-built Markov decision process model to make decisions on the code rate allocation and the timing of disabling feedback retransmission for each codeword sequence in each hybrid automatic repeat request process, to obtain an optimal code rate allocation strategy and an optimal disabling feedback retransmission strategy;

[0063] Specifically, a Markov decision process model is constructed in advance according to the non-terrestrial network coding HARQ process and the customized codeword structure, and the customized information timeliness evaluation index is used as the optimization target. The reinforcement learning algorithm is used to solve the Markov decision process model to guide the code rate allocation of each codeword sequence in each hybrid automatic repeat request process and the selection of the timing of disabling feedback retransmission, so as to obtain the optimal code rate allocation strategy and the optimal disabling feedback retransmission strategy. Among them, the customized codeword structure is a code rate-decreasing, inherited HARQ transmission codeword structure, which can ensure that the code rate of each HARQ retransmission codeword is lower than the code rate of the last transmission codeword, and the information bits of the retransmission codeword include inherited information bits and new information bits, wherein the inherited information bits come from the transmitted and decoded codewords, and the new information bits are additionally introduced new information. Transmitting codewords in accordance with the construction method of the codeword structure can ensure that when the current codeword is decoded correctly, the code rate of the previously transmitted codeword will not be higher than the code rate of the currently transmitted codeword, so that the code rate of the transmitted codeword matches the code rate of the currently transmitted codeword. The customized non-terrestrial network coded HARQ information timeliness evaluation index, namely the coded information age, is used to characterize the information timeliness of non-terrestrial network coded HARQ and guide the subsequent HARQ transmission process. This evaluation index focuses on the average age of each information bit in each HARQ transmission codeword.

[0064] Step S300: executing each of the hybrid automatic repeat request processes according to the optimal code rate allocation strategy and the optimal feedback-disabled retransmission strategy to transmit each of the codeword sequences.

[0065] In this embodiment, the Markov decision process model constructed based on the inherited HARQ transmission codeword structure with a gradually decreasing code rate can make the optimal code rate allocation strategy and select the optimal timing selection strategy for prohibiting feedback retransmission, thereby effectively increasing the amount of information transmitted in each hybrid automatic repeat request process, thereby significantly improving the information transmission efficiency and effectively improving the information timeliness performance of the non-terrestrial network coding HARQ system.

[0066] In a preferred embodiment, the process of constructing the Markov decision process model in step S200 includes:

[0067] Step S210: sending the codeword sequence in each hybrid automatic repeat request process according to the construction method of the preset codeword structure, and obtaining the channel state and action of each hybrid automatic repeat request process;

[0068] Step S220: obtaining a critical state based on a block error rate threshold of a communication system where the non-terrestrial network communication is located;

[0069] Step S230: Calculate the decoding error probability of each hybrid automatic repeat request process, and determine the state transition probability based on each decoding error probability;

[0070] Step S240: Obtain the transmission delay, feedback delay and queuing delay of each information bit in the codeword sequence of each hybrid automatic repeat request process, and obtain the reward of each hybrid automatic repeat request process;

[0071] Step S250: constructing a Markov decision process model based on the channel state, action, transition probability and reward of each hybrid automatic repeat request process, and the critical state.

[0072] Specifically, since the construction of the Markov decision process model requires the use of the self-defined codeword structure of the present invention and the self-defined information timeliness evaluation index, namely, the coded information age, the construction process of the codeword structure and the calculation steps of the coded information age are first introduced here.

[0073] In a preferred embodiment, the step of calculating the age of the encoded information includes:

[0074] Step M101: obtaining the information age of each information bit in each codeword in each hybrid automatic repeat request process for all codeword sequences in non-terrestrial network communication;

[0075] Step M102: Obtain the coded information age based on the mean value of the information age of all the information bits.

[0076] Specifically, this embodiment proposes a new non-terrestrial network coded HARQ information timeliness evaluation index, called the coded information age, and uses it as an optimization target for the subsequent method design. The coded information age represents the average of the information age of each information bit in each codeword of the codeword sequence to be transmitted during each hybrid automatic repeat request process, that is, the average age of each information bit in each HARQ transmission codeword. In this embodiment, the information age of each information bit in each codeword is called the instantaneous coded information age, which represents the time interval between the generation time of the new information bit in each retransmitted codeword and the current timestamp during the transmission of a codeword sequence. Instantaneous coded information age Δ c (t) is a linear function of time t, which increases linearly from the time when the information bit is generated, and jumps down when the information bit is correctly decoded. If a decoding error occurs in a HARQ transmission, then Δ c (t) will continue to grow linearly, Δ c The expression of (t) is as follows:

[0077]

[0078] Then the encoded information age Indicates Δ c (t) is the average value over time, i.e.

[0079] In formula (1), represents the time point at which the new information bit in the i-1th retransmitted codeword is generated in the jth experiment (representing the process of transmitting a codeword sequence), and the jth experiment is The moment begins, The expression is as follows:

[0080]

[0081] RTT represents the round-trip delay, and the HARQ one-way transmission delay and feedback delay are both 0.5RTT; D(r i ) represents the average queuing delay per information bit, which is related to the i-th HARQ transmission code rate r i A decreasing function, r i ∈(0,1], according to queuing theory, we can conclude that D(r i ), that is:

[0082]

[0083] Where μ is the bit processing rate and λ is the codeword arrival rate. We assume that there are at most I max -1 retransmission, then in one experiment, the HARQ transmission round i∈{1,2,...I max}. In formula (1) represents the time when the information bit is decoded correctly in the jth experiment. If it is assumed that the decoding is correct in the Ith transmission, then Figure 2 FIG. 1 is an evolution diagram of the instantaneous coding information age in a non-terrestrial network coding HARQ system. The horizontal axis represents time, and the vertical axis represents the instantaneous coding information age of the adopted codeword structure. The solid line in the figure represents the process of transmitting information bits using the inherited codeword structure. The intersection of the solid line and the horizontal axis represents the generation time point of the new information bit, i.e. The dotted line in the figure represents the process of transmitting information bits using the traditional non-inherited codeword structure. As can be seen from the figure, in each experiment using the inherited codeword structure provided by this embodiment, the generation time points of each information bit in the new information bit are respectively In each experiment using the traditional non-inherited codeword structure, the intersection of the dotted line and the horizontal axis represents the time point when the new information bit is generated, that is, and The times when the new information bits are decoded correctly are and The number of transmissions required for the new information bits to be generated and correctly decoded is 3 times (including and HARQ transmission initiated at the moment), 2 times (including and HARQ transmission initiated at time) and 1 time (i.e. at HARQ transmission initiated at the moment).

[0084] In this embodiment, by custom encoding the information age as the average age of each information bit in each HARQ transmission codeword, the research object of the information age is accurately changed from the traditional information packet to each information bit, which significantly improves the calculation accuracy of the information age.

[0085] In a preferred embodiment, the process of constructing the codeword structure includes:

[0086] Step M103: obtaining a previous code rate based on the code rate when the code word sequence is correctly decoded in the previous hybrid automatic repeat request process;

[0087] Step M104: obtaining a subsequent code rate based on an actual code rate of a subsequent hybrid automatic repeat request when the code word sequence in the previous hybrid automatic repeat request process is decoded correctly, and the subsequent code rate is not higher than the previous code rate;

[0088] Step M105: obtaining inherited information bits and new information bits in the subsequent hybrid automatic repeat request process based on the previous code rate, the subsequent code rate and a preset allocation ratio;

[0089] Step M106: constructing the codeword structure in the post-hybrid automatic repeat request process based on the inherited information bits and the new information bits.

[0090] The check information bits in the current hybrid automatic repeat request process are obtained, and a hybrid automatic repeat request codeword structure is constructed based on the inherited information bits, the new information bits and the check information bits.

[0091] The code rate is gradually reduced and the inherited HARQ transmission codeword structure

[0092] Specifically, this embodiment proposes a code rate gradually decreasing, inheritance-type HARQ transmission codeword structure to improve the transmission efficiency and timeliness of the HARQ system. For the codeword of the current HARQ transmission, if a decoding error occurs, in order to adapt to the channel to ensure reliability, the code rate of the subsequent retransmission codeword is gradually reduced, and the reduction in code rate can improve the decoding performance. In this inheritance-type HARQ transmission codeword structure, the information bits in the HARQ transmission codewords are allocated new information bits and inheritance information bits according to a certain ratio. Due to the introduction of new information bits, the retransmitted codewords can also carry additional new information, thereby improving the transmission efficiency, that is, transmitting more information per unit time. The inherited information bits all come from the previously transmitted and decoded codewords. The allocation of inherited information bits in a certain ratio can make the code rate of the previously transmitted codewords match the code rate of the currently transmitted codewords, that is, when the currently transmitted codewords are decoded correctly, these inherited information bits can make the code rate of the previously decoded codewords not higher than the code rate of the currently decoded codewords.

[0093] For example, Figure 3 The figure shows an example of a HARQ codeword structure with a progressively decreasing code rate and inheritance. Respectively represent the codeword of HARQ transmission for the i-th time, N(1-r 1 )-N(1-r 5 ) represents the check information bit in each hybrid automatic repeat request process, which is used to check whether the currently transmitted codeword is correctly transmitted. 1 -r 5 Indicates the transmission bit rate during each hybrid automatic repeat request process, middle The information bits are inherited and re-encoded in middle, in represents the codeword of the HARQ i-th transmission, Indicates that when C i When the decoding is correct, The actual bit rate, N is the length of the codeword, that is, the number of bits in a codeword. When the decoding is correct, The actual bit rate is No higher than r 2 Similarly, middle The information bits are inherited and re-encoded in middle, Therefore, when When the decoding is correct, The actual bit rate No higher than r3 .also, Need to inherit C 1 middle information bits, and these information bits are not re-encoded into Among them Therefore, when When the decoding is correct, The actual bit rate is No higher than r 3 . By analogy, the codewords transmitted subsequently are constructed according to the construction method of the codeword structure to ensure that when the codewords in the post-hybrid automatic repeat request process are decoded correctly, the code rate of the codewords that were decoded incorrectly in the pre-hybrid automatic repeat request process will not be higher than the code rate of the codewords transmitted in the post-hybrid automatic repeat request process. Therefore, in the channel environment corresponding to the post-hybrid automatic repeat request process, when the codewords in the post-hybrid automatic repeat request process are decoded correctly, the actual code rates of the codewords transmitted in each of the hybrid automatic repeat request processes that have been experienced will meet the performance requirements for correct decoding and complete the decoding.

[0094] k i express The number of new information bits in is expressed as:

[0095]

[0096] Where N represents the length of the codeword. It can be assumed ρ i is the inheritance coefficient, ρ i ∈(0,1].

[0097] Due to the introduction of new information bits, the generation time of new information bits in different HARQ transmission codewords in the jth experiment is are different, so the generation time of each information bit in the jth experiment is is a weighted average, namely:

[0098]

[0099] When the decoding is correct in the jth experiment, that is, The expression of instant coding information age is:

[0100]

[0101] Among them, k in formula (5), formula (6) and formula (10) is ε Both represent k i The temporary value at the time when each new information bit is generated, ε∈[1,I], where I represents the number of codeword transmissions in the jth experiment.

[0102] Therefore, according to formulas (5)-(6) and the characteristics of the coded information age, the instantaneous coded information age function based on the inherited HARQ transmission codeword structure can be obtained, which is expressed as Its curve diagram is as follows Figure 2 As shown by the solid line in .

[0103] This codeword structure of HARQ transmissions with a progressively decreasing code rate can be used for HARQ feedback retransmission as well as feedback disabling strategy. When the feedback disabling strategy is used to implement transmission without feedback, the feedback and retransmission operations are disabled in a certain HARQ transmission. The transmitter will continuously send codewords according to this codeword construction method, and the code rate of the codewords is gradually reduced from the current code rate according to the minimum code rate interval Δ until the code rate is reduced to the lowest. After receiving these codewords, the receiver decodes them, first decoding the codeword with the lowest code rate, and then decoding them one by one according to the construction method of this codeword structure until all codewords are decoded successfully.

[0104] For example, Figure 4 The figure shows an example of feedback disabling strategy. and The hybrid automatic repeat request is used in this transmission. The second transmission adopts the disabled feedback retransmission request, that is, no feedback transmission request. During the transmission, each codeword is continuously sent at a gradually decreasing code rate according to the preset code rate reduction interval, without feedback retransmission. In this process, the probability of successfully receiving and correctly decoding each codeword is increased by reducing the code rate. represents the ε-th codeword sent with the feedback disabling strategy, where HARQ is disabled at the i-th transmission. The code rate is r 3 , The code rate is r 3 -Δ, The code rate is r 3 -2Δ, and so on, the code rate decreases step by step according to the minimum code rate interval. F is the number of code words sent with no feedback transmission, including the last code word sent with HARQ transmission, Δ is the minimum code rate reduction interval, k' i,ε For state s i , the number of new information bits in the εth codeword sent after no feedback transmission, k' i,1 =k i If we assume that ρ ε =1, then k' i,ε =N[r i -2(ε-1)Δ],ε=2,...,F.

[0105] In this embodiment, the age of coded information is taken as the optimization target, and based on the non-terrestrial network coded HARQ process and the above-mentioned customized codeword structure, the state space, action space, state transition probability and reward are constructed to establish a Markov decision process model, and the Markov decision process model is used to provide a code rate allocation strategy for each HARQ transmission and a selection strategy for disabling feedback retransmission timing, so as to minimize the age of coded information, thereby optimizing the information timeliness performance of the non-terrestrial network coded HARQ.

[0106] The process of constructing the channel state and action of each hybrid automatic repeat request process in the state space and the action space includes:

[0107] Step M107: sending the codeword sequence in each hybrid automatic repeat request process according to the construction method of the preset codeword structure, and obtaining the transmission code rate of each hybrid automatic repeat request process;

[0108] Step M108: Based on each of the transmission code rates, respectively obtaining execution feedback retransmission request or prohibition feedback retransmission request;

[0109] Step M109: Based on the feedback retransmission request and the feedback retransmission prohibition request, respectively obtain a feedback retransmission channel state and a feedback retransmission prohibition channel state.

[0110] Specifically, Figure 5 The figure shows the decision process of the Markov decision process model, where s i Represents the state of the Markov decision process, with a total of I max The state corresponds to the i-th transmission in the HARQ process. The state out indicates that the current codeword is decoded successfully, and the virtual state The introduction is to meet the block error rate requirements of the communication system where the non-terrestrial network coding HARQ is located, that is, the non-terrestrial network coding HARQ process needs to at least meet the block error rate threshold, that is, the critical state that the system can operate normally. When the maximum number of retransmissions is reached and the decoding is still not correct, a huge penalty (reward) is imposed, so that the subsequent optimization algorithm can choose a lower code rate to meet the block error rate requirements. The no-feedback transmission state nf (nofeedback) means that feedback and retransmission are disabled in a certain HARQ transmission, and codewords are continuously sent according to the above-mentioned codeword structure construction method. The code rate of the sent codewords starts from the current code rate and gradually decreases according to the minimum code rate interval until the code rate drops to the lowest. After receiving the codewords with continuously decreasing code rates, the receiving end decodes the codewords one by one from the lowest code rate according to the construction method of the above-mentioned codeword structure until all codewords are decoded successfully. Therefore, when entering the state nf, the code rate is gradually reduced to ensure that each codeword can be accurately decoded, so that after entering the state nf, it will enter the state out. In summary, the state set in Indicates the first max status, Indicates a virtual state.

[0111] r i Represents the action in the Markov decision process, corresponding to the code rate selected for the i-th transmission in the HARQ process, and also corresponding to whether to select no feedback transmission in the i-th transmission. i ∈A, A is an action set, which is two sets of action sets A 1 and A 2 The combination of A={A 1 ,A 2}, A 1 =A 2 ∈(0,1]. When r i ∈A 1 When , it means that the code rate selected for the i-th transmission of HARQ is r i , and continue to use HARQ to transmit, and may subsequently enter state s i+1 , it may also enter the state out. i ∈A 2 When , it means that the code rate selected for the i-th transmission of HARQ is r i , and after the i-th transmission, it chooses to disable feedback and retransmission, performs transmission without feedback, and directly enters state nf.

[0112] For example, assuming the minimum bitrate interval is 1 / 32, the action set All action sets Assume that p represents the pointer of action set A. It can be seen from action set A that when p=2, the code rate selected in the current state is 2 / 32 and the HARQ mode is continued to be used for transmission (r i =2 / 32), when p=34, the code rate selected in the current state is 2 / 32 and no feedback transmission is adopted afterwards (r i =2 / 32).

[0113] When i ∈A 1 hour, Indicates that when action r is selected i When, from s i Transfer to i+1 The state transition probability, Indicates that when action r is selected i When, from state s i The probability of transitioning to out. The state transition probability corresponds to the probability of decoding error, which can be defined as:

[0114]

[0115] Among them, P e (C i ) is the expected decoding error probability, and the code rate r i Due to the lack of accurate and real-time channel state information, the present invention adopts the bit error rate based on channel distribution information, then P e (C i ) can be expressed as:

[0116]

[0117] in, represents the minimum code weight distribution, that is, the Hamming weight in the codeword is d min The number of min represents the minimum Hamming distance, h represents the channel coefficient, represents the ratio of each binary bit energy to the noise power spectrum density, Q(α) represents the right tail function, and p(h) represents the probability density function of the channel coefficient. In non-terrestrial network scenarios, it can be calculated based on the distribution of the Loo model, that is:

[0118]

[0119] in, I 0 (α) represents the zero-order Bessel function. In the Loo model, the received signal contains direct signals and multipath signals. The direct signal conforms to the log-normal distribution with a mean of α (dB) and a standard deviation of ψ (dB), while the multipath signal follows the Rayleigh distribution with a mean power of MP (dB).

[0120] When i ∈A 1 hour, Indicates the selection action r i , from state s i Transfer to i+1 The rewards obtained, Indicates taking action i When, from state s i The reward obtained by transferring to state out. In the HARQ process, and Both indicate that due to the selection of bit rate r i The increasing instant encoding information age. Figure 2 and Figure 4 It can be inferred that According to the above analysis of the age of the coded information of each transmission codeword structure based on inheritance and the additivity of returns in the Markov decision process model, we can get The expression of (I=i at this time), that is:

[0121]

[0122] When i ∈A 2 hour, This means that the action r is selected i , from state s i The reward obtained by transferring to state nf is the reward obtained by selecting the code rate r i And the increasing instant encoding information age. The construction idea is the same as First, the total instant coding information age is calculated, and then the state s is subtracted. i The sum of the rewards on the previous path can be deduced from this The expression is:

[0123]

[0124]

[0125] Where M is the number of HARQ parallel processes, F is the number of codewords sent using no-feedback transmission, including the last codeword sent using HARQ transmission, Δ is the minimum rate reduction interval, and k′ is i,ε Indicates that in state s i Under this condition, the number of new information bits in the εth codeword sent after no feedback transmission is taken, that is, k′ i,1 =k i If we assume that ρ ε =1, then k′i,ε =N[r i -2(ε-1)Δ],ε=2,...F.

[0126] In a preferred embodiment, the method of using a pre-built Markov decision process model to make decisions on the code rate allocation and the timing of disabling feedback retransmission for each code word sequence in each hybrid automatic repeat request process to obtain an optimal code rate allocation strategy and an optimal disabling feedback retransmission strategy includes:

[0127] Step M110: taking the preset coding information age as the optimization target, using the preset reinforcement learning algorithm to solve the Markov decision process model, making decisions on the code rate allocation of each code word in each code word sequence of each hybrid automatic repeat request process and the timing of disabling feedback retransmission, and obtaining a decision strategy corresponding to the minimum coding information age;

[0128] Step M111: based on the decision strategy corresponding to the minimum coding information age, obtain the optimal code rate allocation strategy and the optimal feedback-disabling retransmission strategy.

[0129] Specifically, the Q-learning algorithm in the reinforcement learning algorithm is used to solve the above Markov decision process model to obtain the optimal action, that is, the optimal code rate allocation strategy and the optimal time to disable feedback retransmission, so that the age of the coded information is minimized, thereby optimizing the information timeliness of non-terrestrial network coded HARQ.

[0130] When using the Q learning algorithm to solve the Markov decision process model, the strategy π(r i |s i ) means in state s i The distribution of actions when executing the hybrid automatic repeat request process to transmit the codeword sequence; the reward φ represents the process of transmitting a codeword sequence from the current state s i The cumulative return to state out, assuming that the decoding is successful in the Ith HARQ transmission during the transmission of the codeword sequence and enters state out, then Action-value function Ψ π (s i ,r i ) is the expected φ, which means the change from the current state s i Start, select action r i Then the expected return of taking strategy π is π (s i ,r i ) corresponds to the age of the encoded information. In the continuous updating and iteration of the Q learning algorithm, the Bellman optimal equation is used to solve the optimal action value function Ψ * (s i,r i ), that is, the current state s i , select action r i The minimum action value function that can be obtained (the age of the encoded information). * (s i ,r i ) is as follows:

[0131]

[0132] The detailed process of the Q-learning algorithm based on the Markov decision process model of the non-terrestrial network coding HARQ process is shown in Algorithm 1.

[0133] Algorithm 1:

[0134]

[0135] In Algorithm 1, n max Indicates the maximum number of iterations of the algorithm, I max is the maximum number of HARQ transmissions, |A 1 | represents the action set A 1 The number of elements in the action set A, |A| represents the number of elements in the action set A (|A| = 2|A 1 |), BLER req is the block error rate requirement to be achieved. The elements in the matrix Ψ represent * (s i ,r i ), the rows of Ψ correspond to different states, and the columns correspond to different actions. p is a pointer to the action set A, and A(p) represents the pth element in the set A. max +1 corresponds to virtual status The state out and state nf do not need to be represented in the matrix Ψ. The algorithm consists of three layers of nested loops. The first layer of loops continuously iterates to find and update the best action selection plan. The second layer loops through the state set S, and the third layer loops through the current state s i In the third loop, the value of Ψ under different actions in the current state is calculated using formula (12), and then the current state s is selected. i The best action in i * , corresponding to the smallest value of Ψ in the i-th row. The virtual state introduced This is to ensure that the block error rate of the last retransmission is less than or equal to BLER req If the block error rate of the last retransmission is greater than BLER req , then I in Ψ max +1 row all values ​​are set to infinity as penalty On the contrary, if the block error rate requirement is met, I max +1 row has all values ​​set to 0. According to (15), the bit rate that does not meet the block error rate requirement is is infinite, so in the subsequent Q learning algorithm, line 12, only the bit rate (action) that meets the block error rate requirement will be selected to meet the required block error rate requirement. max Or when the matrix Ψ converges, the optimal action selection scheme can be obtained, that is, the optimal code rate allocation scheme and the optimal time to disable feedback retransmission, so that the proposed information timeliness evaluation index, that is, the coded information age, is minimized, and the optimization of the information timeliness of the non-terrestrial network coded HARQ system is completed.

[0136] In non-terrestrial network environments, the reliability of data transmission is often low due to long signal transmission distances, large transmission delays, and possible multipath effects and atmospheric interference. The present invention combines forward error correction (FEC) and automatic repeat request (ARQ) technologies through the HARQ adopted, which can optimize data transmission in environments with large noise and interference, thereby effectively improving the timeliness and reliability of data transmission.

[0137] In order to verify the effectiveness of the non-terrestrial network communication method based on hybrid automatic repeat request proposed in the present invention, a simulation analysis is performed through an example experiment. The experimental scenario selects the suburbs, the coding adopts polarization adjustment convolution code, and the minimum drop interval of the code rate is 1 / 32. All simulated communication system parameters are shown in Table 1, and the parameter settings of the Loo model are shown in Table 2.

[0138] Table 1:

[0139] Satellite orbit Low Earth Orbit Round Trip Delay 50ms Number of HARQ processes 11 Satellite frequency band S-Band Scenario Suburban, medium shade Encoding Polarization-adjusted convolutional codes Codeword length N 128 Minimum bit rate drop interval 1 / 32 Modulation Quadrature Phase Shift Keying <![CDATA[Maximum retransmission count I max > 6 Symbol processing rate μ 50.33Kbps Symbol arrival rate λ 50Kbps <![CDATA[Block Error Rate (BLER req )]]> <![CDATA[10 -5 ]]>

[0140] Table 2:

[0141] Loo model parameters α(dB) ψ(dB) MP(dB) 40 degrees -3.7 0.98 -12.2 60 degrees -2 0.5 -13 80 degrees -2.5 0.2 -16

[0142] The Monte Carlo method is used to simulate the hybrid automatic repeat request method with feedback retransmission disabled (hereinafter referred to as the method proposed by the present invention), the hybrid automatic repeat request method without feedback retransmission disabled (hereinafter referred to as control group 1), the existing lookup table method based on inherited codeword structure (hereinafter referred to as control group 2) and the traditional lookup table method (hereinafter referred to as control group 3), and the coding information age of each method is compared. Among them, the difference between control group 1 and the method proposed by the present invention is that control group 1 only optimizes the code rate without considering the disabled feedback retransmission after a certain transmission, that is, all transmissions adopt the HARQ mode, which is called the proposed method (without disabled feedback retransmission) in the legend of the simulation results; control group 2 adopts the idea of ​​lookup table and uses the inherited HARQ codeword structure for each transmission, but does not adopt the Markov decision process model and Q learning algorithm based on the HARQ process; control group 3 is based on the idea of ​​offline training and uses the lookup table auxiliary technology to adjust the code rate of each transmission.

[0143] Figure 6 Shown is a simulation diagram comparing the coded information age of different HARQ transmission methods. The horizontal axis represents the signal-to-noise ratio Eb / N0, the unit is dB, and the vertical axis represents the coded information age (Age of Coded Information, C-AoI), the unit is ms. It can be seen from the figure that the coded information age of the four methods decreases with the increase of the signal-to-noise ratio. Compared with the methods of control group 2 and control group 3, the coded information age of the method proposed in the present invention and the method of control group 1 is significantly smaller. In addition, compared with the method of control group 1, the method proposed in the present invention further reduces the coded information age due to the introduction of the disabled feedback retransmission opportunity. Therefore, the method proposed in the present invention successfully optimizes the coded information age, thereby improving the timeliness performance of the non-terrestrial network coded HARQ system. At the same time, Figure 7The figure shows the throughput comparison simulation diagram of different HARQ transmission methods. The horizontal axis represents the signal-to-noise ratio Eb / N0 in dB, and the vertical axis represents the throughput in Kbps. It can be seen from the figure that when the signal-to-noise ratio Eb / N0 is fixed, the age of the coded information at a 60-degree elevation angle is smaller than that at a 40-degree elevation angle. This difference is due to the worse channel environment conditions at a 40-degree elevation angle, which leads to an increase in the age of the coded information and reduces the information timeliness performance. At a satellite elevation angle of 40 degrees and a signal-to-noise ratio of 6dB, compared with the control group 3, the proposed method reduces the proposed information timeliness evaluation index by 30.7 milliseconds, thereby improving the information timeliness performance of the non-terrestrial network coding HARQ system. At the same time, compared with the control group 3, the throughput of the control group 2 at a satellite elevation angle of 60 degrees and a signal-to-noise ratio of 9dB is increased by 2.21Kbps, thereby effectively improving the information transmission efficiency, that is, transmitting more information per unit time. In summary, this comparative experiment effectively verifies that the method proposed in the present invention can significantly improve the efficiency and timeliness of information transmission.

[0144] like Figure 8 As shown, corresponding to the non-terrestrial network communication method based on hybrid automatic repeat request, an embodiment of the present invention further provides a non-terrestrial network communication device based on hybrid automatic repeat request, and the non-terrestrial network communication device based on hybrid automatic repeat request includes:

[0145] The information acquisition module 810 is used to acquire a plurality of codeword sequences in non-terrestrial network communications;

[0146] A decision module 820 is used to make decisions on the code rate allocation and the timing of disabling feedback retransmission of each code word sequence in each hybrid automatic repeat request process using a pre-built Markov decision process model, so as to obtain an optimal code rate allocation strategy and an optimal disabling feedback retransmission strategy;

[0147] The transmission execution module 830 is used to execute each of the hybrid automatic repeat request processes according to the optimal code rate allocation strategy and the optimal feedback-disabled retransmission strategy to transmit each of the codeword sequences.

[0148] Specifically, in this embodiment, the specific functions of the non-terrestrial network communication device based on hybrid automatic repeat request can also refer to the corresponding description in the non-terrestrial network communication method based on hybrid automatic repeat request, which will not be repeated here.

[0149] Based on the above embodiments, the present invention further provides an intelligent terminal, whose principle block diagram can be shown as follows: Fig. 9As shown. The above-mentioned intelligent terminal includes a processor, a memory, a network interface and a display screen connected through a system bus. Among them, the processor of the intelligent terminal is used to provide computing and control capabilities. The memory of the intelligent terminal includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a non-terrestrial network communication program based on a hybrid automatic repeat request. The internal memory provides an environment for the operation of the operating system and the non-terrestrial network communication program based on a hybrid automatic repeat request in the non-volatile storage medium. The network interface of the intelligent terminal is used to communicate with an external terminal through a network connection. When the non-terrestrial network communication program based on a hybrid automatic repeat request is executed by the processor, the steps of any one of the above-mentioned non-terrestrial network communication methods based on a hybrid automatic repeat request are implemented. The display screen of the intelligent terminal can be a liquid crystal display screen or an electronic ink display screen.

[0150] Those skilled in the art will understand that Fig. 9 The principle block diagram shown in the figure is only a block diagram of a partial structure related to the scheme of the present invention, and does not constitute a limitation on the smart terminal to which the scheme of the present invention is applied. The specific smart terminal may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0151] In one embodiment, a smart terminal is provided, which includes a memory, a processor, and a non-terrestrial network communication program based on a hybrid automatic repeat request stored in the memory and executable on the processor. When the non-terrestrial network communication program based on a hybrid automatic repeat request is executed by the processor, the steps of any one of the non-terrestrial network communication methods based on a hybrid automatic repeat request provided in an embodiment of the present invention are implemented.

[0152] An embodiment of the present invention also provides a computer-readable storage medium, on which a non-terrestrial network communication program based on a hybrid automatic repeat request is stored. When the non-terrestrial network communication program based on a hybrid automatic repeat request is executed by a processor, the steps of any one of the non-terrestrial network communication methods based on a hybrid automatic repeat request provided by an embodiment of the present invention are implemented.

[0153] It should be understood that the serial numbers of the steps in the above embodiments do not imply a sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0154] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the above-mentioned device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0155] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0156] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0157] In the embodiments provided by the present invention, it should be understood that the disclosed apparatus / terminal equipment and method can be implemented in other ways. For example, the apparatus / terminal equipment embodiments described above are only illustrative, for example, the division of the above modules or units is only a logical function division, and in actual implementation, other division methods can be used, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.

[0158] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features therein may be replaced by equivalents. However, these modifications or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention.

Claims

1. A non-terrestrial network communication method based on hybrid automatic repeat request, characterized in that: The following steps are involved: Acquire a number of codeword sequences in non-terrestrial network communications; A pre-built Markov decision process model is used to make decisions on the code rate allocation and the timing of disabling feedback retransmission of each code word sequence in each hybrid automatic repeat request process, so as to obtain an optimal code rate allocation strategy and an optimal strategy of disabling feedback retransmission; the Markov decision process model is constructed by adopting a custom code rate step-by-step decreasing, inherited code word structure; According to the optimal code rate allocation strategy and the optimal feedback-disabled retransmission strategy, executing each of the hybrid automatic repeat request processes to transmit each of the codeword sequences; The method uses a pre-built Markov decision process model to make decisions on the code rate allocation and the timing of disabling feedback retransmission of each code word sequence in each hybrid automatic repeat request process to obtain an optimal code rate allocation strategy and an optimal disabling feedback retransmission strategy, including: Taking the preset coding information age as the optimization target, using the preset reinforcement learning algorithm to solve the Markov decision process model, making decisions on the code rate allocation of each code word in each code word sequence of each hybrid automatic repeat request process and the timing of disabling feedback retransmission, and obtaining the decision strategy corresponding to the minimum coding information age; based on the decision strategy corresponding to the minimum coding information age, obtaining the optimal code rate allocation strategy and the optimal disabling feedback retransmission strategy; The process of constructing the codeword structure includes: Based on the code rate when the codeword sequence in the previous hybrid automatic repeat request process is decoded correctly, a previous code rate is obtained; based on the actual code rate of the subsequent hybrid automatic repeat request when the codeword sequence in the previous hybrid automatic repeat request process is decoded correctly, a subsequent code rate is obtained, and the subsequent code rate is not higher than the previous code rate; based on the previous code rate, the subsequent code rate and a preset allocation ratio, inherited information bits and new information bits in the subsequent hybrid automatic repeat request process are obtained, wherein the inherited information bits come from the transmitted and decoded codewords, and the new information bits are brand new information that is additionally introduced; based on the inherited information bits and the new information bits, a codeword structure in the subsequent hybrid automatic repeat request process is constructed.

2. The non-terrestrial network communication method based on hybrid automatic repeat request according to claim 1, characterized in that: The process of constructing the Markov decision process model includes: Sending a codeword sequence in each hybrid automatic repeat request process according to a preset codeword structure construction method to obtain a channel state and action of each hybrid automatic repeat request process; Obtaining a critical state based on a block error rate threshold of a communication system in which the non-terrestrial network communication is located; Calculating the decoding error probability of each hybrid automatic repeat request process, and determining the state transition probability based on each decoding error probability; Obtaining the transmission delay, feedback delay and queuing delay of each information bit in the codeword sequence of each hybrid automatic repeat request process, and obtaining a reward for each hybrid automatic repeat request process; A Markov decision process model is constructed based on the channel state, action, transition probability and reward of each hybrid automatic repeat request process and the critical state.

3. The non-terrestrial network communication method based on hybrid automatic repeat request according to claim 2, characterized in that: The sending of the codeword sequence in each hybrid automatic repeat request process according to the construction mode of the preset codeword structure to obtain the channel state and action of each hybrid automatic repeat request process includes: Sending a codeword sequence in each hybrid automatic repeat request process according to a preset codeword structure construction method to obtain a transmission code rate of each hybrid automatic repeat request process; Based on each of the transmission code rates, respectively obtaining execution of feedback retransmission request or prohibition of feedback retransmission request; Based on the feedback retransmission request and the feedback retransmission prohibition request, a channel state for feedback retransmission and a channel state for feedback retransmission prohibition are obtained respectively.

4. The non-terrestrial network communication method based on hybrid automatic repeat request according to claim 3, characterized in that: The process of prohibiting feedback of the retransmission request includes: The codeword sequence is sent according to the construction method of the codeword structure, and the code rate of sending the codeword sequence is gradually reduced according to the preset code rate interval until the code rate drops to a preset code rate threshold.

5. The non-terrestrial network communication method based on hybrid automatic repeat request according to claim 1, characterized in that: The step of calculating the age of the coded information comprises: Obtaining the information age of each information bit in each codeword of all the codeword sequences in the non-terrestrial network communication in each hybrid automatic repeat request process; Based on the average of the information ages of all the information bits, the coded information age is obtained.

6. A non-terrestrial network communication device based on hybrid automatic repeat request, characterized in that: Applied to implement the non-terrestrial network communication method based on hybrid automatic repeat request according to any one of claims 1 to 5, the device comprises: An information acquisition module, used to acquire a number of codeword sequences in non-terrestrial network communications; A decision module, used to make decisions on the code rate allocation and the timing of disabling feedback retransmission of each code word sequence in each hybrid automatic repeat request process by using a pre-built Markov decision process model, so as to obtain an optimal code rate allocation strategy and an optimal disabling feedback retransmission strategy; The transmission execution module is used to execute each of the hybrid automatic repeat request processes according to the optimal code rate allocation strategy and the optimal feedback-disabled retransmission strategy to transmit each of the codeword sequences.

7. Intelligent terminal, characterized in that: The intelligent terminal includes a memory, a processor, and a non-terrestrial network communication program based on a hybrid automatic repeat request stored in the memory and executable on the processor. When the non-terrestrial network communication program based on a hybrid automatic repeat request is executed by the processor, the steps of the non-terrestrial network communication method based on a hybrid automatic repeat request as described in any one of claims 1-5 are implemented.

8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a non-terrestrial network communication program based on a hybrid automatic repeat request, and when the non-terrestrial network communication program based on a hybrid automatic repeat request is executed by a processor, the steps of the non-terrestrial network communication method based on a hybrid automatic repeat request as described in any one of claims 1-5 are implemented.

Citation Information

Patent Citations

  • Power distribution method and device based on Internet of Things

    CN116828510A

  • Method for determining HARQ (Hybrid Automatic Repeat reQuest) transmission power and maximum retransmission times in satellite Internet of Things scene

    CN117353798A