Hybrid automatic repeat request method and device, storage medium and electronic device

Abstract

The present disclosure provides a hybrid automatic repeat request method and device, a storage medium and an electronic device, and relates to the field of communication technology. The method includes a transmitting end obtaining a value of the number of consecutive transmissions of a data packet through a hybrid automatic repeat request strategy model according to channel parameters; the transmitting end sending a data packet according to the value of the number of consecutive transmissions; the transmitting end judging whether the data packet needs to be resent; and the transmitting end resending the data packet according to the judgment result. The problem that the related technology cannot meet the demand for low latency of time-sensitive services is solved. Thus, the demand for low latency of time-sensitive services is met.

Description

Background Art

[0002] With the gradual development of the fifth generation mobile communication network, the application of hybrid automatic repeat request technology (HARQ) in 5G communication systems has gradually attracted attention. As a link adaptation technology, HARQ combines the repeated transmission technology (ARQ) and forward error correction coding (FEC), plays a role in improving the reliability of communication links, and can improve the communication quality of the system and effectively ensure reliable data transmission.

[0003] The main implementation method of HARQ technology is: if the first transmission is not successfully decoded, the code rate of the channel coding is reduced by retransmitting more redundant bits; as the number of retransmissions increases, the redundant bits continue to accumulate, thereby improving the decoding success rate. However, the above existing technologies will also significantly increase the transmission delay of data packets, and thus cannot meet the low latency requirements of time-sensitive services.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] The purpose of the present disclosure is to provide a hybrid automatic repeat request method and device, a storage medium and an electronic device, which at least to a certain extent overcome the problem that related technologies cannot meet the low latency requirements of time-sensitive services.

[0006] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.

[0007] According to one aspect of the present disclosure, a hybrid automatic repeat request method is provided, including: a transmitting end obtains a value of the number of consecutive transmissions of a data packet through a hybrid automatic repeat request strategy model according to channel parameters; the transmitting end sends the data packet according to the value of the number of consecutive transmissions; the transmitting end determines whether the data packet needs to be resent; and according to the determination result, the transmitting end resends the data packet.

[0008] In one embodiment of the present disclosure, before the sending end determines whether it is necessary to resend a data packet, the process also includes: the receiving end receives a continuous transmission count value; the receiving end determines whether the number of data packets currently received reaches the continuous transmission count value; if the continuous transmission count value is reached, the receiving end decodes all received data packets; and the receiving end sends feedback information to the sending end based on the decoding result.

[0009] In one embodiment of the present disclosure, before the transmitting end obtains the value of the number of consecutive transmissions of a data packet through a hybrid automatic repeat request strategy model based on channel parameters, it also includes: the transmitting end determines whether the current data packet is transmitted for the first time; if it is not transmitted for the first time, the data packet is sent once to the receiving end.

[0010] In one embodiment of the present disclosure, the transmitting end obtains the value of the number of consecutive transmissions of a data packet through a hybrid automatic repeat request strategy model according to channel parameters, including: obtaining the hybrid automatic repeat request strategy model based on Q reinforcement learning model training.

[0011] In one embodiment of the present disclosure, a hybrid automatic repeat request strategy model is obtained based on Q reinforcement learning model training, including: taking the previous number of consecutive transmissions and channel parameters as the state space; taking the current number of consecutive transmissions as the action space; and taking the inverse proportional function of the delay as the reward function.

[0012] In one embodiment of the present disclosure, according to the judgment result, after the sending end resends the data packet, it also includes: if the judgment result is that the data packet needs to be resent, the sending end resends the data packet to the receiving end once more; and the sending end determines whether it needs to resend the data packet once more.

[0013] In one embodiment of the present disclosure, the sending end determines whether it is necessary to resend the data packet, further comprising: the sending end receiving feedback information from the receiving end; and determining whether it is necessary to resend the data packet according to the feedback information.

[0014] According to another aspect of the present disclosure, a hybrid automatic repeat request device is provided, including: a strategy module, which is used by the sending end to obtain the number of consecutive transmissions of a data packet through a hybrid automatic repeat request strategy model according to channel parameters; a first sending module, which is used by the sending end to send the data packet according to the number value; a judgment module, which is used by the sending end to judge whether the data packet needs to be resent; and a second sending module, which is used by the sending end to resend the data packet according to the judgment result.

[0015] According to another aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the above-mentioned hybrid automatic repeat request method by executing the executable instructions.

[0016] According to another aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the hybrid automatic repeat request method described above is implemented.

[0017] The hybrid automatic repeat request method provided in the embodiment of the present disclosure can effectively improve the success rate of data being received in one go through the relatively optimal number of consecutive transmissions output by the hybrid automatic repeat request strategy model, and minimize the resource consumption of the communication system while ensuring the efficiency of data packet retransmission.

[0018] Furthermore, the delay of the retransmission mechanism is improved through the above-mentioned strategy model, and the rate perception capability of the hybrid automatic repeat request in a time-varying environment is improved. Thus, in complex and changeable actual communication scenarios, especially in high-speed mobile channel scenarios, the performance of the HARQ mechanism is optimized, and the requirements of time-sensitive services for low delay are met.

[0019] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0021] Figure 1 A schematic diagram showing the delay of each part of a standard hybrid automatic repeat request process in the prior art;

[0022] Figure 2 A flow chart of a hybrid automatic repeat request method according to an embodiment of the present disclosure is shown;

[0023] Figure 3 A flow chart showing a method before a transmitting end determines whether a data packet needs to be resent in a hybrid automatic repeat request method according to an embodiment of the present disclosure;

[0024] Figure 4 A schematic diagram showing the delay of each part of a process for executing a hybrid automatic repeat request in an embodiment of the present disclosure is shown;

[0025] Figure 5a and 5b A schematic diagram showing a training method of a hybrid automatic repeat request strategy model in a hybrid automatic repeat request method in an embodiment of the present disclosure is shown;

[0026] Figure 6 A method flow chart of a hybrid automatic repeat request method in an embodiment of the present disclosure is shown;

[0027] Figure 7aA curve showing the relationship between the average transmission delay and the SNR when the number of consecutive transmissions of a hybrid automatic repeat request method according to an embodiment of the present disclosure is different;

[0028] Figure 7b and 7c The comparison relationship curves of using a hybrid automatic repeat request method in the embodiment of the present disclosure and using a standard hybrid automatic repeat request method and a fast hybrid automatic repeat request method are respectively shown;

[0029] Figure 8 A schematic diagram of a hybrid automatic repeat request device in an embodiment of the present disclosure is shown; and

[0030] Fig. 9 A structural block diagram of a computer device for hybrid automatic repeat request in an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0031] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the disclosure will be more comprehensive and complete and to fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0032] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0033] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the present disclosure, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0034] In view of the technical problems existing in the above-mentioned related technologies, the embodiments of the present disclosure provide a website information processing method to solve at least one or all of the above-mentioned technical problems.

[0035] Figure 1The present invention is a schematic diagram of the delay of each part of a standard hybrid automatic repeat request process in the prior art. The hybrid automatic repeat request process includes: a base station 110 and a terminal 120. Among them, data is transmitted between the base station 110 and the terminal 120 through a hybrid automatic repeat request mechanism (Hybrid Automatic Repeat reQuest, HARQ), and the method can be applied to both uplink and downlink.

[0036] like Figure 1 As shown, the terminal 120 can be a mobile terminal such as a mobile phone, a game console, a tablet computer, an e-book reader, smart glasses, an MP4 (Moving Picture Experts Group Audio Layer IV) player, a smart home device, an AR (Augmented Reality) device, a VR (Virtual Reality) device, or the terminal 120 can also be a personal computer (PC), such as a laptop computer and a desktop computer.

[0037] The terminal 120 is connected to the base station 110 via a communication network. Optionally, the communication network is a wireless network.

[0038] Those skilled in the art will appreciate that the number of the terminals 120 may be more or less. For example, there may be only one terminal, or there may be dozens or hundreds of terminals, or a greater number. The embodiment of the present application does not limit the number and device type of the terminals.

[0039] Optionally, the method of an embodiment of the present disclosure may provide communication under a standard for mobile communication, such as the third generation partnership project (3GPP), 4G, 5G, long term evolution (LTE), NR, EPC, etc. The communication may be based on the universal mobile telecommunications system (UMTS) terrestrial radio access network (UTRAN) or evolved UTRAN (eUTRAN). The communication may include time division duplex (TDD) transmission (UL and / or DL ​​transmission). The communication may include frequency division duplex (FDD) transmission (UL and / or DL ​​transmission). The base station (BS) may be an evolved node (eNB), a gNB (using the terminology of 5G), or collectively referred to as gNB / eNB. In some examples, the UE will use the BS as an interface to the core network (e.g., evolved packet core (EPC)) to establish a radio bearer with specific QoS requirements. In NR, the UE may establish a service flow via a gNB attached to the core network (e.g., EPC) to implement a packet-by-packet service flow.

[0040] In the embodiments of the present disclosure, soft combining HARQ (HARQ-CC) or incremental redundancy combining HARQ (HARQ-IR) may be used to implement HARQ technology according to different diversity gain modes.

[0041] Due to the influence of various aspects of the communication line quality, errors may occur in the process of transmitting the data packet 130 from the base station 110 to the terminal 120. In order to ensure the correctness and integrity of the data, the terminal 120 will use a certain method to perform error checking on the received data after receiving the data, so the terminal 120 can easily detect whether the received data packet 130 has an error. After completing the detection, the terminal 120 will send a feedback message 131 to the base station 110, indicating whether the data sent by the other party is correct or wrong. The base station 110 will perform corresponding operations according to the information sent by the receiving party. In some embodiments, if the base station 110 receives feedback information that the data is correct, it will proceed to the sending process of the next new data packet 132.

[0042] Specifically, taking downlink transmission as an example, the transmission delay of a HARQ process can be composed of two parts, namely, the first transmission and the retransmission. Figure 1 As shown, suppose the transmission delay of the data packet 130 is T slot , the propagation delay of data packet 130 is T p , the processing delay is T proc , first transmission delay: T first =2(T slot +T p +T proc ), then one HARQ process takes: T HARQ =T first +RTT*N, where round trip delay: RTT=2(T slot +T p +T proc ), N represents the average number of times a data packet is retransmitted after the first transmission. It can be seen that in the design of the HARQ mechanism, if the number of data packet retransmissions can be reduced as much as possible, the average transmission delay T can be effectively improved. HARQ .

[0043] In the following, each step of the hybrid automatic repeat request method in this exemplary implementation will be described in more detail with reference to the accompanying drawings and embodiments.

[0044] Figure 2 A flow chart of a hybrid automatic repeat request method in an embodiment of the present disclosure is shown. The method provided in the embodiment of the present disclosure can be executed by any electronic device with computing and processing capabilities, such as Figure 1 The base station 110 and / or the terminal 120 in the embodiment. In the following examples, the base station 110 is used as the execution subject for example description.

[0045] like Figure 2 As shown, a hybrid automatic repeat request method 200 provided in an embodiment of the present disclosure includes the following steps:

[0046] Step S210: The transmitting end obtains the value of the number of consecutive transmissions of the current data packet through a hybrid automatic repeat request strategy model according to the channel parameters.

[0047] In some embodiments of the present disclosure, a hybrid automatic repeat request (HARQ) strategy model is a reinforcement learning model that can output the number of consecutive transmissions of a hybrid automatic repeat request by inputting channel parameters. In some embodiments, the channel parameters may include the signal-to-noise ratio of the current channel. Further, the signal-to-noise ratio is input into the trained hybrid automatic repeat request model, and the number of consecutive transmissions of the HARQ during the first transmission is adaptively adjusted and kept as close to the optimal state as possible by timely detecting the characteristics of the wireless channel and tracking its changing trend, so as to minimize the average delay of data packet transmission. Thereby meeting the service quality requirements of more low-latency services.

[0048] Step S220: The sending end sends a data packet according to the number of consecutive sending times.

[0049] In some embodiments of the present disclosure, the transmitting end sends the data packet repeatedly according to the optimal number of times when sending the data packet for the first time, and can adopt the incremental redundancy merging method. The transmitting end sends different redundant versions of the data packet, and the receiving end decodes them at a lower coding rate after merging. This can increase the decoding accuracy of the receiving end, save the number of transmissions of the transmitting end, and reduce the transmission power consumption. Furthermore, it reduces the Figure 1 The first transmission delay of the sender: T first =2(T slot +T p +T proc ).

[0050] Step S230: The sending end determines whether it needs to resend the data packet.

[0051] In some embodiments of the present disclosure, the receiving end generates feedback information based on the decoding result, which can be represented by an Acknowledge character / Negative Acknowledge character (ACK / NACK), and sends the Acknowledge / Negative feedback information to the sending end. In some embodiments, the sending end can determine whether it is necessary to resend the data packet based on the received feedback information. Specifically, the Acknowledge information represents that the received information is accurate and does not need to be resent; the NACK information represents that the received information is erroneous and needs to be resent.

[0052] In some embodiments of the present disclosure, the receiving end may send feedback information to the transmitting end on a physical uplink control channel (PUCCH) or a physical downlink control channel (PDCCH) to determine whether to resend a data packet based on the feedback information.

[0053] Step S240: According to the determination result, the transmitting end resends the data packet.

[0054] In some embodiments of the present disclosure, the transmitting end transmits a fixed amount of data packets each time during the transmission process other than the first transmission. In some embodiments of the present disclosure, during the transmission process other than the first transmission, the receiving end decodes the data packets sent each time and feeds back the decoding results. At the same time, the receiving end enters a stop and wait state, and the transmitting end decides whether to resend the data packet again according to the feedback information until receiving the confirmation feedback information.

[0055] By using the hybrid automatic repeat request method disclosed in the present invention, the relatively optimal number of consecutive transmissions output by the hybrid automatic repeat request strategy model can effectively improve the success rate of data being received in one go, and on the basis of ensuring the efficiency of data packet retransmission, minimize the resource consumption of the communication system.

[0056] Furthermore, the delay of the retransmission mechanism is improved through the above-mentioned strategy model, and the rate perception capability of the hybrid automatic repeat request in a time-varying environment is improved. Thus, in complex and changeable actual communication scenarios, especially in high-speed mobile channel scenarios, the performance of the HARQ mechanism is optimized, and the requirements of time-sensitive services for low delay are met.

[0057] Figure 3 A flowchart showing a method before the transmitting end determines whether to resend a data packet in a hybrid automatic repeat request method according to an embodiment of the present disclosure is shown. Figure 3 As shown, including:

[0058] Step S310: The receiving end receives a value of the number of consecutive transmissions.

[0059] In some embodiments of the present disclosure, the data packet sent for the first time also includes the number of consecutive transmissions determined by the transmitting end. In other embodiments, the number of consecutive transmissions can be used as an independent message during the first transmission process.

[0060] Step S320, the receiving end determines whether the number of data packets currently received reaches the number of consecutive transmission times.

[0061] In some embodiments of the present disclosure, if the number of data packets currently received does not reach the number of consecutive transmissions by the transmitter, the receiver does not perform decoding.

[0062] Step S330: If the number of consecutive transmissions is reached, the receiving end decodes all received data packets.

[0063] In some embodiments of the present disclosure, the receiving end accumulates the received data packets, and when all the data packets sent this time are received, that is, when the number of received data packets reaches the number of consecutive transmissions, the receiving end combines and decodes all the data packets, thereby improving the accuracy of decoding and further increasing the success rate of information reception.

[0064] Step S340: The receiving end sends feedback information to the sending end according to the decoding result.

[0065] In some embodiments of the present disclosure, when the decoding result is wrong, the receiving end will enter a stop-wait state and send feedback information of data error to the transmitting end. In some embodiments, the feedback information can be a NACK character message, waiting for the transmitting end to retransmit the data packet. When the decoding result is correct, the receiving end will feed back a message that the data is correct to the transmitting end. In some embodiments, the correct feedback information includes an ACK character message.

[0066] Through the method of the embodiment of the present disclosure, it is ensured that the receiving end performs merge decoding after receiving the optimal number of data packets, thereby minimizing the power loss of the sending end and the receiving end while ensuring the accuracy of data reception, and reducing the number of times the sending end and the receiving end send feedback information, thereby saving occupied channel resources.

[0067] Figure 4 FIG. 2 is a schematic diagram showing the time delay of each part of the process of executing a hybrid automatic repeat request in an embodiment of the present disclosure. Figure 4 As shown, it includes: a base station 410 and a terminal 420.

[0068] Taking the downlink as an example, during the first transmission, the transmitter (base station 410) continuously sends a data packet m times. During this process, the receiver (terminal 420) does not decode the data packets individually, but puts them into a buffer, and then performs unified decoding after completing m receptions. It can be seen that the delay corresponding to the first transmission will be: T first ′=2*(T p +T proc )+(m+1)T slot Starting from the m+1th transmission, the receiving end performs combined decoding and feeds back the decoding result to the data transmitting end (base station 410), and enters the general stop-and-wait HARQ process. The total delay is: T HARQ ′=T first′+RTT*N. RTT (Round-Trip Time) represents the round-trip delay, and N represents the average number of times a data packet is retransmitted after the first transmission.

[0069] It can be seen from the above process that when the receiving end (such as terminal 420) cannot correctly decode the data packet when it is transmitted only once, the continuous transmission HARQ mechanism can save the round-trip interaction delay RTT of some retransmitted data packets, and effectively reduce the average transmission delay of the data packet by reasonably reducing the N value.

[0070] Figure 5a and 5b A schematic diagram of a training method for a hybrid automatic repeat request strategy model in a hybrid automatic repeat request method in an embodiment of the present disclosure is shown. Figure 5a As shown, in the embodiment of the present disclosure, a standard reinforcement learning model is used, and the agent 510 is used as a learning system to obtain the current state information s of the external environment. t , taking exploratory actions on the environment 520 t , and obtain the reward r for this action fed back by the environment 520 t+1 and the new environment state s t+1 If an action of the agent 510 leads to a positive reward from the environment, the tendency of the agent 510 to perform this action in the future will be strengthened; otherwise, the tendency of the agent 510 to perform this action will be weakened. In the repeated interaction between the control behavior of the learning system and the state and evaluation of the environmental feedback, the mapping strategy from state to action is continuously modified in a learning manner to achieve the purpose of optimizing system performance.

[0071] Specifically, agent 510 Figure 5b As shown, in some embodiments of the present disclosure, the action space is set to the threshold m of the number of consecutive transmissions, that is, the action action can be expressed as action = {m|1,2,3,…,M}, where M is the maximum number of transmissions of a data packet in a HARQ process. Considering the dynamic changes and timing relationship of the channel state, the kth data packet CB k The state space during transmission should consist of two parts, namely CB k-1 The number of transmissions m required for successful decoding k and channel state SNR k , that is, state=(m k ,SNR k ).

[0072] Then, the kth data packet CB is transmitted with delay as the optimization target. k The corresponding delay τ k for:

[0073]

[0074] Where i represents CB k After the i-th transmission, the decoding is successful, and M represents the maximum number of HARQ retransmissions. In the embodiment of the present disclosure, the inverse proportional function of the delay in a data packet transmission is used, reward = 100 / τ k As the reward value for this transfer in the reinforcement learning model.

[0075] In the disclosed embodiment, the agent 510 selects the relatively best action in a certain state based on the Q table (which stores the SNR of each channel state and the corresponding relatively best number of continuous transmissions), randomly generates an initial action value as the action space 514 at the beginning of training, runs the simulation network environment, uses the current channel parameter SNR of the simulation model and the required number of transmissions as the state space 512, calculates the current reward value based on the delay, transmits the state and reward value to the reinforcement learning model, and updates the Q table. During the next training, the reinforcement learning model selects the action value based on the Q table and transmits the action value to the simulation model, realizing an interaction between the reinforcement learning model and the simulation network. After several trainings and repeated interactions, the reinforcement learning model converges to the ideal state as a hybrid automatic repeat request strategy model.

[0076] By using the Q_Learning reinforcement learning model to train the hybrid automatic repeat request strategy model, it is possible to quickly learn the current wireless channel characteristics and adaptively determine the corresponding number of continuous transmissions. While reducing the average transmission delay, it also optimizes the current communication system performance and improves the adaptability of the current communication system.

[0077] Figure 6 A method flow chart of a hybrid automatic repeat request method in an embodiment of the present disclosure is shown. Figure 6 As shown, including:

[0078] Step S602: The sending end determines whether the current data packet is sent for the first time.

[0079] In some embodiments of the present disclosure, a HARQ process may consist of two parts, namely, initial transmission and retransmission. By timely detecting the characteristics of the wireless channel and tracking its changing trend, the number of consecutive transmissions during the initial HARQ transmission is adaptively adjusted and kept close to a relatively optimal state as much as possible to minimize the average transmission delay.

[0080] Step S604: If the current data packet is sent for the first time, the transmitting end obtains the value of the number of consecutive transmissions of the current data packet through the hybrid automatic repeat request strategy model according to the channel parameters.

[0081] In some embodiments of the present disclosure, a hybrid automatic repeat request strategy model is used to accurately find the number of consecutive transmissions that is relatively best matched with the scenario in complex and changeable actual communication scenarios, thereby maximizing the performance advantage of continuously sending hybrid automatic repeat requests by improving the accuracy of the strategy model.

[0082] In some embodiments of the present disclosure, the hybrid automatic repeat request strategy model is trained based on the Q_Learning model. In the embodiments of the present disclosure, the training method may also include: taking the last number of consecutive transmissions and channel parameters as the state space; taking the current number of consecutive transmissions as the action space; and training with the inverse proportional function of the delay as the reward function.

[0083] In some embodiments of the present disclosure, the channel parameters may include but are not limited to the signal-to-noise ratio of the current channel. Specifically, the transmitter inputs the signal-to-noise ratio of the current channel into the trained hybrid automatic repeat request strategy model and obtains the output of the relatively optimal number of consecutive transmissions.

[0084] Step S606: The sending end sends a data packet according to the number of consecutive transmission times.

[0085] In some embodiments of the present disclosure, during the first transmission, the transmitting end repeatedly transmits a data packet according to the number of consecutive transmissions. In the embodiments of the present disclosure, including the use of incremental redundancy merging, the transmitting end sends different redundant versions of the data packet, and the receiving end merges and decodes at a lower coding rate. Through this method, the success rate of the first decoding can be increased, thereby improving the transmission efficiency and accuracy of the communication system.

[0086] Step S608: The receiving end receives the value of the number of consecutive transmissions.

[0087] In some embodiments of the present disclosure, the data packet sent for the first time may include a value of the number of consecutive transmissions. In some other embodiments of the present disclosure, the value of the number of consecutive transmissions may also be sent separately from the data packet.

[0088] Step S610: The receiving end determines whether the number of data packets currently received reaches the number of consecutive transmission times.

[0089] In some embodiments of the present disclosure, during the first transmission, the transmitter sends a data packet for a continuous number of times. During this process, the receiver does not decode the data packet separately, but puts it into a buffer and counts the received data packets.

[0090] Step S612: the receiving end decodes all received data packets.

[0091] In some embodiments of the present disclosure, when the number of pending receptions reaches the number of consecutive transmissions, the receiving end combines and decodes all data packets, thereby improving the success rate of decoding.

[0092] Step S614: The receiving end sends feedback information to the sending end according to the decoding result.

[0093] In some embodiments of the present disclosure, the receiving end generates feedback information based on the decoding result, which can be represented by an Acknowledge character / Negative Acknowledge character (ACK / NACK), and sends the Acknowledge / Negative feedback information to the sending end. In some embodiments, the sending end can determine whether it is necessary to resend the data packet based on the received feedback information. Specifically, the Acknowledge information represents that the received information is accurate and does not need to be resent; the NACK information represents that the received information is erroneous and needs to be resent.

[0094] In some embodiments of the present disclosure, the receiving end may send feedback information to the transmitting end on a physical uplink control channel (PUCCH) or a physical downlink control channel (PDCCH) to determine whether to resend a data packet based on the feedback information.

[0095] Through the above-mentioned HARQ method of combining and decoding data packets with adaptive consecutive times, on the one hand, the number of transmissions at the transmitter and the feedback messages generated by the receiver within the consecutive times can be avoided, thereby reducing the transmission power loss of the transmitter and the receiver and saving the channel resources occupied by unnecessary feedback messages. On the other hand, the round-trip delay of redundant feedback messages is also avoided. When the number of actual data packet retransmission processes is not less than the consecutive number, the transmission delay of the HARQ process can be effectively reduced, while improving the transmission efficiency of the HARQ.

[0096] Step S616: the sending end receives feedback information from the receiving end.

[0097] In some embodiments of the present disclosure, the transmitting end may receive feedback information ACK / NACK from the receiving end on a physical uplink control channel (PUCCH) or a physical downlink control channel (PDCCH).

[0098] Step S618: The sending end determines whether it needs to resend the data packet based on the feedback information.

[0099] In some embodiments of the present disclosure, if an ACK message is received from the receiving end, the sending end no longer needs to resend the data packet. If a NACK message is received from the receiving end, the sending end still needs to resend the data packet.

[0100] Step S620: if the data packet needs to be resent, it is determined that the current data packet is not sent for the first time, and the data packet is sent to the receiving end once. The above steps S612-S620 are repeated until the sending end determines that the data packet does not need to be resent according to the feedback information, and then the current process ends.

[0101] In some embodiments of the present disclosure, after the transmitting end resends a data packet to the receiving end, the transmitting end also determines whether it is necessary to resend the data packet again. Specifically, the transmitting end can determine whether it is necessary to resend the data packet again based on the feedback information sent by the receiving end, such as "ACK / NACK" information. After each time the receiving end receives a repeatedly sent data packet, it will decode it and feed back the decoding result. Once the decoding result of the receiving end is correct, confirmation information will be fed back to the transmitting end, and the transmitting end ends the hybrid automatic retransmission process based on the confirmation information. Through the above method, the accuracy of the HARQ mechanism of the present disclosure is further improved, the success rate of data packet transmission is guaranteed, and the effect of reducing the average delay is truly achieved.

[0102] The above method can effectively improve the success rate of data being received at one time, and minimize the resource consumption of the system on the basis of ensuring the efficiency of data packet retransmission.

[0103] Furthermore, by improving the latency of the retransmission mechanism, the rate perception capability of the hybrid automatic repeat request in a time-varying environment is improved. Thus, in complex and changing actual communication scenarios, especially in high-speed mobile channel scenarios, the HARQ performance is optimized, meeting the low latency requirements of time-sensitive services.

[0104] In some embodiments of the present disclosure, the embodiments of the present invention can also be applied to narrowband Internet of Things (NB-IOT) scenarios. Specifically, by reducing the transmission delay between networked devices, increasing the data transmission rate, and reducing the power loss of electrical appliances, the power saving effect of the NB-IOT scenario is further improved.

[0105] The simulation results of the HARQ method described in some embodiments of the present disclosure are as follows: Figure 7a-7c The simulation parameters are shown in the following table:

[0106] parameter Value Transfer rate 2Gbps Code length 256bit Maximum number of retransmissions 6 <![CDATA[Decoding delay T proc > 0.005ms Terminal moving speed 32km / h SNR -5:10dB Channel Model Rayleigh channel Encoding LDPC Coding Modulation QPSK modulation HARQ combining method Incremental redundancy merging

[0107] In the embodiments of the present disclosure, two groups of comparison algorithms are also set up - the standard HARQ scheme and the fast HARQ scheme. The Fast HARQ scheme is a theoretical derivation of the optimal value of m under an ideal channel model, but is not suitable for non-ideal channels and fast time-varying scenarios.

[0108] Figure 7a The relationship curve between the average transmission delay and the SNR when the number of consecutive transmissions is different is shown. The number of consecutive transmissions is 1 to 6. Figure 7a It can be seen that the relative optimal number of continuous transmissions under different SNRs is different. As the SNR increases, the value of the relative optimal number of continuous transmissions gradually decreases.

[0109] From the above results, it can be seen that for different communication scenarios, different continuous transmission times are required to improve the transmission delay effect. Therefore, it can be further explained that timely sensing the channel status and selecting the optimal continuous transmission times have the effect of optimizing the transmission delay.

[0110] Figure 7b and 7c The comparative relationship curves of using the hybrid automatic repeat request method according to some embodiments of the present disclosure and using the standard hybrid automatic repeat request method and the fast hybrid automatic repeat request method are respectively shown.

[0111] in Figure 7b The vertical axis represents the average delay of all data packets. Figure 7c It represents the average delay of successfully transmitted data packets (i.e., data packets that are successfully decoded when the number of transmissions is less than or equal to the maximum number of retransmissions M). As can be seen from the two figures, under the conditions of maximum transmission times M = 6 and SNR between -5 and 10 dB, the HARQ mechanism based on reinforcement learning in the disclosed embodiment can effectively reduce the average delay and improve system performance compared to Standard HARQ and Fast HARQ. Especially under low signal-to-noise ratio conditions, the delay optimization effect of the present invention is more obvious, and the delay is reduced by 30% compared to the traditional stop-and-wait HARQ scheme.

[0112] In summary, compared with the prior art, the method using the embodiment of the present disclosure can effectively reduce latency while maintaining a high throughput, thereby optimizing the performance of the HARQ mechanism.

[0113] It should be noted that the above figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0114] Figure 8 FIG. 2 is a schematic diagram of a hybrid automatic repeat request device according to an embodiment of the present disclosure. Figure 8 As shown, including:

[0115] A policy module 810, configured for the transmitting end to obtain a value of the number of consecutive transmissions of a data packet through a hybrid automatic repeat request policy model according to channel parameters;

[0116] A first sending module 820, configured for a sending end to send a data packet according to a number of times;

[0117] A determination module 830 is used for the sending end to determine whether it is necessary to resend the data packet; and

[0118] The second sending module 840 is used for the sending end to resend the data packet according to the judgment result.

[0119] By using the hybrid automatic repeat request device disclosed in the present invention, the relatively optimal number of consecutive transmissions output by the strategy model can effectively improve the success rate of data being received in one go, and on the basis of ensuring the efficiency of data packet retransmission, minimize the resource consumption of the communication system.

[0120] Furthermore, by improving the latency of the retransmission mechanism, the rate perception capability of the hybrid automatic repeat request in a time-varying environment is improved. Thus, in complex and changing actual communication scenarios, especially in high-speed mobile channel scenarios, the performance of the HARQ mechanism is optimized, meeting the low latency requirements of time-sensitive services.

[0121] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".

[0122] Refer to the following Fig. 9 An electronic device 900 according to this embodiment of the present invention will be described. Fig. 9 The electronic device 900 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0123] like Fig. 9 As shown, the electronic device 900 is in the form of a general computing device. The components of the electronic device 900 may include but are not limited to: at least one processing unit 910, at least one storage unit 920, and a bus 930 connecting different system components (including the storage unit 920 and the processing unit 910).

[0124] The storage unit stores program codes, which can be executed by the processing unit 910, so that the processing unit 910 performs the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification. For example, the processing unit 910 can perform the following steps: Figure 2 In S210 shown in the figure, the sending end obtains the number of consecutive transmission times of the data packet according to the channel parameters through the hybrid automatic repeat request strategy model; S220, the sending end sends the data packet according to the number of consecutive transmission times; S230, the sending end determines whether the data packet needs to be resent; and S240, according to the determination result, the sending end resends the data packet.

[0125] The storage unit 920 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 9201 and / or a cache storage unit 9202 , and may further include a read-only storage unit (ROM) 9203 .

[0126] The storage unit 920 may also include a program / utility 9204 having a set (at least one) of program modules 9205, such program modules 9205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0127] Bus 930 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0128] The electronic device 900 may also communicate with one or more external devices (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 900, and / or may communicate with any device that enables the electronic device 900 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 950. Furthermore, the electronic device 900 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 960. As shown, the network adapter 960 communicates with other modules of the electronic device 900 via a bus 930. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 900, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0129] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0130] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.

[0131] The program product for implementing the above method according to an embodiment of the present invention may adopt a portable compact disk read-only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device.

[0132] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0133] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0134] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0135] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0136] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0137] In addition, although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0138] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0139] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the appended claims.

Claims

1. A hybrid automatic repeat request method, characterized in that: include: The reinforcement learning model is trained to obtain a hybrid automatic repeat request strategy model, which includes: taking the last number of consecutive transmissions and channel parameters as the state space; transmitting the kth data packet CB k The corresponding delay τ k for: Where k is a positive integer greater than or equal to 1; i represents CB k Successful decoding after the i-th transmission, i is a positive integer greater than or equal to 1; m represents the threshold of the number of consecutive transmissions, m is a positive integer greater than or equal to 1 and less than or equal to M; M is the maximum number of transmissions of a data packet in a hybrid automatic retransmission process, M is a positive integer greater than or equal to 1; T p represents the propagation delay of the data packet; T proc Indicates the processing delay of the data packet; T slot Indicates the delay of sending data packets; the delay τ k The inverse proportional function of is used as the reward value of the transmission in the reinforcement learning model; The sending end obtains the value of the number of consecutive transmissions of the data packet through the hybrid automatic repeat request strategy model according to the channel parameters; The transmitting end sends the data packet according to the continuous sending number value; The sending end determines whether it is necessary to resend the data packet; and According to the determination result, the sending end resends the data packet.

2. The hybrid automatic repeat request method according to claim 1, characterized in that: Before the transmitting end determines whether it is necessary to resend the data packet, the method further includes: The receiving end receives the value of the number of consecutive transmissions; The receiving end determines whether the number of data packets currently received reaches the value of the number of consecutive transmissions; If the number of consecutive transmissions is reached, the receiving end decodes all received data packets; and The receiving end sends feedback information to the sending end according to the decoding result.

3. The hybrid automatic repeat request method according to claim 2, characterized in that: Before the transmitting end obtains the value of the number of consecutive transmissions of the data packet through the hybrid automatic repeat request strategy model according to the channel parameters, the following is also included: The sender determines whether the current data packet is sent for the first time; If it is not the first time to send, the data packet is sent to the receiving end once.

4. The hybrid automatic repeat request method according to claim 3, characterized in that: The sender obtains the value of the number of consecutive transmissions of the data packet through the hybrid automatic repeat request strategy model according to the channel parameters, including: The hybrid automatic repeat request strategy model is obtained based on Q reinforcement learning model training.

5. The hybrid automatic repeat request method according to claim 4, characterized in that: The hybrid automatic repeat request strategy model is obtained based on Q reinforcement learning model training, including: The previous number of consecutive transmissions and channel parameters are used as the state space; The current number of consecutive transmissions is taken as the action space; and The inverse proportional function of the delay is used as the reward function.

6. The hybrid automatic repeat request method according to claim 1, characterized in that: According to the judgment result, after the sending end resends the data packet, the further step includes: If the judgment result is that the data packet needs to be resent, the sending end resends the data packet to the receiving end once more; and The sending end determines whether it is necessary to resend the data packet.

7. The hybrid automatic repeat request method according to any one of claims 1 to 6, characterized in that: The transmitting end determines whether it is necessary to resend the data packet, further comprising: The sending end receives feedback information from the receiving end; It is determined whether the data packet needs to be resent according to the feedback information.

8. A hybrid automatic repeat request device, characterized in that: include: A strategy module, used for the transmitting end to obtain the value of the number of consecutive transmissions of the data packet through a hybrid automatic repeat request strategy model according to the channel parameters; A first sending module, used for the sending end to send a data packet according to the number of times; A judgment module, used for the sending end to judge whether the data packet needs to be resent; and A second sending module, configured to cause the sending end to resend the data packet according to the judgment result; The hybrid automatic repeat request strategy model is obtained by training a reinforcement learning model, which includes: taking the last number of consecutive transmissions and channel parameters as the state space; transmitting the kth data packet CB k The corresponding delay τ k for: Where k is a positive integer greater than or equal to 1; i represents CB k Successful decoding after the i-th transmission, i is a positive integer greater than or equal to 1; m represents the threshold of the number of consecutive transmissions, m is a positive integer greater than or equal to 1 and less than or equal to M; M is the maximum number of transmissions of a data packet in a hybrid automatic retransmission process, M is a positive integer greater than or equal to 1; T p represents the propagation delay of the data packet; T proc Indicates the processing delay of the data packet; T slot Indicates the delay of sending data packets; the delay τ k The inverse proportional function of is used as the reward value of this transmission in the reinforcement learning model.

9. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to execute the hybrid automatic repeat request method according to any one of claims 1 to 7 by executing the executable instructions.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the hybrid automatic repeat request method according to any one of claims 1 to 7 is implemented.

Images