Optimization method and system for signaling data type communication transmission

Abstract

The invention discloses an optimization method and system for signaling data type communication transmission, and belongs to the technical field of data processing, and the method comprises the following steps: a sending end adds a hash value to a signaling data packet, and dynamically generates a redundant forward error correction packet according to a network state; the sending end transmits the signaling data packet and the redundant forward error correction packet to a receiving end through a network; the receiving end verifies the received signaling data packet and the redundant forward error correction packet and stores the signaling data packet and the redundant forward error correction packet in a cache region; the receiving end detects a lost packet through the serial number of the data packet, and performs local recovery by using the redundant forward error correction packet in the cache region so as to recover the lost packet; and if the local reply fails, triggering retransmission. According to the optimization method and system for signaling data type communication transmission, the problem that stable transmission of signaling data under the weak network condition is difficult to realize in the current transmission mode is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, in particular to an optimization method and system for signaling data type communication transmission. BACKGROUND

[0002] In network communication, there are a large number of weak network environments with low bandwidth, high packet loss and high delay. Weak network environment has a great impact on the communication performance and effect of various software, including signaling transmission scenarios with high real-time characteristics.

[0003] Since the size of the transmitted signaling data is small, but the real-time performance and the ordered arrival between signaling are required to be higher than general transmission, signaling transmission requires low latency and order, and these two goals are contradictory to some extent. The current transmission method is difficult to meet the signaling transmission demand under weak network conditions, so it is difficult to realize stable transmission of signaling data under weak network conditions. SUMMARY

[0004] In order to overcome the defects existing in the prior art, one object of the present application is to provide an optimization method for signaling data type communication transmission to solve the above problems.

[0005] In order to overcome the defects existing in the prior art, another object of the present application is to provide an optimization system for signaling data type communication transmission to solve the above problems.

[0006] The technical scheme adopted by the present application to solve its technical problems is: an optimization method for signaling data type communication transmission, comprising the following steps:

[0007] S1: the sending end appends a hash value to the signaling data packet, and dynamically generates a redundant forward error correction packet according to the network state;

[0008] S2: the sending end transmits the signaling data packet and the redundant forward error correction packet to the receiving end through the network;

[0009] S3: the receiving end checks the received signaling data packet and redundant forward error correction packet and stores them to the cache area;

[0010] S4: the receiving end detects the missing packet through the sequence number of the data packet, and uses the redundant forward error correction packet in the cache area for local recovery to recover the missing packet; if the local recovery fails, retransmission is triggered.

[0011] Preferably, the step S1 comprises: the sending end calculates a hash value of a fixed length for each signaling data packet and appends it to the data packet header;

[0012] The sending end obtains the network packet loss rate through the acknowledgement message of the receiving end, and when the network packet loss rate is greater than or equal to a preset threshold, linearly combines a plurality of signaling data packets to generate a redundant packet, and appends a header of the redundant packet containing a hash combination of the redundant packet to the redundant packet, to obtain a redundant forward error correction packet.

[0013] Optionally, in the step S1, when the network packet loss rate is higher than the preset threshold, the current signaling data packet being sent and k signaling data packets before the current signaling data packet being sent are linearly combined to obtain a redundant packet Fm, where is an XOR operation, P1, P2...Pk are signaling data packets, Pk is the current signaling data packet being sent, P1 is the kth signaling data packet before the current signaling data packet being sent, and c1, c2...ck are encoding coefficients of the corresponding signaling data packets.

[0014] Specifically, in the step S1, the hash combination containing the redundant packet is a hash value combination H(Fm_info) = H(H(P1) | H(P2) |... | H(Pk)) of the k signaling data packets, where | represents connection.

[0015] Preferably, the step S2 comprises: the sending end sending the signaling data packet containing the hash value in the order of the sequence number.

[0016] When the network packet loss rate is higher than the preset threshold, the sending end sends the redundant forward error correction packet to the receiving end in sequence.

[0017] Specifically, the step S3 comprises: the receiving end performing hash check on the received signaling data packet and the redundant forward error correction packet, storing the signaling data packet and the redundant forward error correction packet passing the hash check in a cache area, and discarding the signaling data packet and the redundant forward error correction packet failing the hash check.

[0018] It is worth noting that the step S4 comprises: the receiving end detecting the lost signaling data packet through the sequence number gap.

[0019] The receiving end identifies a signaling data packet set that can be used to recover the lost packet according to the hash combination of the redundant packet contained in the redundant forward error correction packet, and recovers the lost packet by performing XOR operation on the signaling data packet set used to recover the lost packet and the existing signaling data packet in the cache area.

[0020] The receiving end submits the recovered signaling data packet to an application layer and sends an acknowledgement message after successful recovery.

[0021] Preferably, in the step S4, if the local recovery fails, the receiving end constructs a negative acknowledgement message containing the sequence number of the lost packet, and sends the negative acknowledgement message to the sending end.

[0022] The sending end extracts the signaling data packet corresponding to the sequence number from the sending buffer according to the sequence number in the negative acknowledgement message; and the sending end retransmits the signaling data packet containing the hash value to the receiving end, and the receiving end checks the hash value of the retransmitted signaling data packet and submits the signaling data packet to the application layer after the check is passed.

[0023] Specifically, in the step S3, the receiving end performs hash check on the received signaling data packet and the redundant forward error correction packet, including: the receiving end extracts the hash value of the header of the received signaling data packet and the redundant forward error correction packet, the receiving end calculates the hash value of the content of the received signaling data packet and the redundant forward error correction packet, the receiving end compares the extracted hash value with the calculated hash value to determine the data integrity, and the receiving end determines whether the signaling data packet or the redundant forward error correction packet passes the check according to the comparison result, when the comparison result is consistent, it means that the check is passed, and when the comparison result is inconsistent, it means that the check fails.

[0024] An optimization system for signaling data type communication transmission using the optimization method for signaling data type communication transmission.

[0025] The present application has the following advantages: in the optimization method for signaling data type communication transmission, a double error correction mechanism is realized, forward error correction FEC is used to resist random packet loss, retransmission is used to resist burst packet loss, and both share the same set of hash encoding and decoding logic. The mechanism of dynamically generating redundant forward error correction packets by identifying the network state has almost no redundant overhead when the network is good, and the forward error correction redundant overhead is controllable when the network is poor. Combined with the low bandwidth consumption in the retransmission stage, the entire large packet is no longer retransmitted, thereby greatly improving the bandwidth efficiency. Under normal circumstances, the data can be recovered locally through forward error correction without waiting for retransmission; even if retransmission is needed, the amount of data requested and responded is very small, the waiting time in the network queue is shorter, and the transmission time is also shorter, significantly reducing the retransmission delay; thereby achieving the purpose of low delay. In this way, high bandwidth efficiency and low delay are used to realize stable transmission of signaling data in a weak network. BRIEF DESCRIPTION OF DRAWINGS

[0026] Fig. 1 A flowchart of the optimization method for signaling data type communication transmission in an embodiment of the present application;

[0027] Fig. 2 A flowchart of the sending end in the optimization method for signaling data type communication transmission in an embodiment of the present application;

[0028] Fig. 3 A flowchart of the receiving end in the optimization method for signaling data type communication transmission in an embodiment of the present application. DETAILED DESCRIPTION

[0029] The specific embodiments of the present application will be further described in conjunction with the accompanying drawings. It is to be noted that the description of the embodiments is used to help understand the present application and does not constitute a limitation of the present application. In addition, the technical features involved in the various embodiments of the present application described below can be combined with each other as long as they do not conflict with each other.

[0030] As shown in the figure, an optimization method for signaling data type communication transmission includes the following steps: Figs. 1-3

[0031] S1: The sending end attaches a hash value to the signaling data packet and dynamically generates a redundant forward error correction packet according to the network state;

[0032] S2: The sending end transmits the signaling data packet and the redundant forward error correction packet to the receiving end through the network;

[0033] S3: The receiving end checks the received signaling data packet and the redundant forward error correction packet and stores them in the cache area;

[0034] S4: The receiving end detects the missing packet through the sequence number of the data packet and uses the redundant forward error correction packet in the cache area for local recovery to recover the missing packet; if the local recovery fails, retransmission is triggered.

[0035] In the optimization method for signaling data type communication transmission, a double error correction mechanism is realized, the forward error correction FEC is used to resist random packet loss, and the retransmission is used to resist burst packet loss, and both share the same set of hash encoding and decoding logic. Through the mechanism of identifying the network state to dynamically generate the redundant forward error correction packet, the redundant overhead is almost zero when the network is good, and the forward error correction redundant overhead is controllable when the network is poor, combined with the bandwidth consumed in the retransmission stage, which is extremely low, and no longer retransmits the entire large packet, thereby greatly improving the bandwidth efficiency. Under normal circumstances, the packet can be recovered locally through forward error correction without waiting for retransmission; even if retransmission is needed, the amount of data of the request and response is very small, the waiting time in the network queue is shorter, and the transmission time is also shorter, significantly reducing the retransmission delay; thereby achieving the purpose of low delay. In this way, the stable transmission of signaling data under weak network conditions is realized through extremely high bandwidth efficiency and low delay.

[0036] ​The scheme is used to ensure low latency and correct sequence of end-to-end signaling data type communication transmission in a weak network communication environment (such as packet loss, delay, jitter, etc.). It is mainly used for real-time interactive applications that are highly sensitive to delay and need to ensure high reliability on unreliable networks. This scheme is particularly suitable for scenarios where the cost (time and bandwidth) of retransmitting the entire data packet is too high to be acceptable. This scheme can be used as a "special" technology for critical services that have strict network conditions and zero tolerance for delay. It uses higher design complexity and computational overhead to achieve extreme delay and bandwidth performance in a weak network environment.

[0037] Preferably, the step S1 comprises: the sending end calculates a fixed-length hash value for each signaling data packet and appends it to the data packet header; for example, for the original signaling data packet P1, a fixed-length hash value H(P1) is calculated for P1 by CRC32 or truncated hash of Blake3, and the hash value H(P1) is appended to P1 as the data packet header, finally obtaining the data packet to be sent as [P1, H(P1)];

[0038] The sending end obtains the network packet loss rate through the acknowledgment message of the receiving end, and when the network packet loss rate is greater than or equal to a preset threshold, generates a redundant packet by linearly combining a plurality of signaling data packets, and appends a header of the redundant packet containing a hash combination of the redundant packet to the redundant packet, to obtain a redundant forward error correction packet.

[0039] Traditional forward error correction (FEC) adds redundancy in "blocks" and does not care about network conditions. However, this scheme will adaptively determine whether to add redundancy, how much to add, and in what form, based on real-time network evaluation (such as packet loss rate). In this embodiment, the sending end will continuously monitor the success rate of the sent packets through the ACK / NACK feedback of the receiving end, and then obtain the corresponding packet loss rate as the network packet loss rate according to the success rate. A preset threshold is set; when the network packet loss rate is less than the preset threshold, it indicates that the network is good, at this time no redundant packet is generated, thereby saving bandwidth and achieving the lowest delay; when the network packet loss rate is greater than or equal to the preset threshold, it indicates that the network fluctuates, thereby starting forward-looking encoding, which is linearly combining a plurality of signaling data packets to generate a redundant packet. By monitoring network indicators in real time, the forward error correction switch is dynamically adjusted, so that the algorithm can adapt to various environments from wired networks to extremely weak networks.

[0040] Optionally, in the step S1, when the network packet loss rate is higher than the preset threshold, the current signaling data packet and the k signaling data packets before it are linearly combined to obtain a redundant packet Fm, where is XOR operation, P1, P2...Pk are signaling data packets, wherein Pk is the currently transmitted signaling data packet, P1 is the kth signaling data packet before the currently transmitted signaling data packet, and c1, c2...ck are the encoding coefficients of the corresponding signaling data packets.

[0041] In the present scheme, when the redundant packet is generated, not all signaling data packets are encoded, but the recently transmitted k signaling data packets are linearly combined through dynamic grouping.

[0042] Specifically, in the step S1, the hash combination of the redundant packet is the hash value combination H(Fm_info) of the k signaling data packets, i.e. H(Fm_info) = H(H(P1)|H(P2)|...|H(Pk)), wherein | represents connection. Thus, the redundant forward error correction packet obtained is [Fm, H(Fm_info)], wherein Fm is the redundant packet, and H(Fm_info) is the packet header of the redundant packet.

[0043] It is worth mentioning that the step S2 comprises: the sending end transmits the signaling data packets containing hash values in the order of sequence numbers.

[0044] When the network packet loss rate is higher than a preset threshold, the sending end transmits the redundant forward error correction packet to the receiving end in sequence.

[0045] In the present embodiment, the sending end intermittently inserts the redundant forward error correction packet when detecting network fluctuation, wherein the transmission timing of the redundant forward error correction packet is that the sending end transmits the redundant forward error correction packet when detecting network fluctuation according to the acknowledgement message returned by the receiving end, and does not transmit the redundant forward error correction packet when the network is stable; in addition, the signaling data packet and the redundant forward error correction packet are distinguished through packet headers.

[0046] Preferably, the step S3 comprises: the receiving end performs hash check on the received signaling data packet and redundant forward error correction packet, stores the signaling data packet and the redundant forward error correction packet passing the hash check in a cache area, and discards the signaling data packet and the redundant forward error correction packet failing the hash check.

[0047] In the present embodiment, the receiving end maintains a receiving cache area for storing the correctly received but possibly out-of-order data packets, wherein the data packets include the signaling data packets and the redundant forward error correction packets.

[0048] Optionally, the step S4 comprises: the receiving end detects the lost signaling data packet through a sequence number gap; in the present embodiment, the sequence number gap is the sequence number of the lost signaling data packet, and the packet header of the signaling data packet has a sequence number identifier; for example, if the signaling data packets P1, P2, P4 and P5 are received, it can be inferred that the sequence number gap is 3, i.e. the signaling data packet P3 is lost.

[0049] The receiving end identifies a set of signaling data packets that can be used to recover the missing packet according to the hash combination of the redundant forward error correction packet containing the redundant packet; the missing packet is recovered by performing an exclusive OR operation on the set of signaling data packets used to recover the missing packet and the existing signaling data packets in the cache; for example, it can be determined from the hash combination H(Fm_info) that the missing packet P3 is encoded from the signaling data packets P1, P2, P3, P4 and P5, and the existing signaling data packets in the cache are P1, P2, P4 and P5, the existing signaling data packets in the cache are updated by the result of the exclusive OR operation, and the updated existing signaling data packets in the cache are P1, P2, P3, P4 and P5, thereby recovering the missing packet P3.

[0050] The receiving end submits the recovered signaling data packet to the application layer and sends an acknowledgement message after successful recovery.

[0051] After successful recovery, the recovered signaling data packet P3 is submitted to the upper layer application, and an ACK is sent to the sending end.

[0052] Specifically, in the step S4, if the local recovery fails (e.g., there is no redundant forward error correction packet in the cache that can directly recover the missing packet), the receiving end constructs a negative acknowledgement message (NACK) containing the sequence number of the missing packet and sends it to the sending end; in this embodiment, the negative acknowledgement message NACK only contains the sequence number of the missing packet, such as the sequence number 3 in the signaling data packet P3, so the capacity of the negative acknowledgement message NACK is very small.

[0053] The sending end extracts the signaling data packet corresponding to the sequence number from the sending cache according to the sequence number in the negative acknowledgement message; the sending end retransmits the signaling data packet containing the hash value to the receiving end, and the receiving end checks the hash value of the retransmitted signaling data packet and submits the signaling data packet to the application layer after the check is passed.

[0054] The receiving end receives the retransmitted signaling data packet containing the hash value, submits it to the application layer after the hash is verified, and sends an ACK to the sending end. Specifically, the hash check ensures the integrity of the data, and the mechanism of the negative acknowledgement message NACK ensures the accuracy of the retransmission request, avoiding unnecessary retransmission.

[0055] It is worth mentioning that in the step S3, the receiving end performs hash check on the received signaling data packet and the redundant forward error correction packet, including: the receiving end extracts the hash value in the header of the received signaling data packet and the redundant forward error correction packet, the receiving end calculates the hash value of the content of the received signaling data packet and the redundant forward error correction packet, the receiving end compares the extracted hash value with the calculated hash value to determine the data integrity, and the receiving end determines whether the signaling data packet or the redundant forward error correction packet passes the check according to the comparison result. When the comparison result is consistent, it means that the check passes, and when the comparison result is inconsistent, it means that the check fails.

[0056] The check of the present scheme is self-check of a single data packet, and whether a single data packet itself is reliable is checked, such as for the signaling data packets P1, P2, P3, P4 and P5. If the receiving end receives only the signaling data packets P1, P2, P4 and P5 and the signaling data packet P3 is missing, after checking P2, the missing P3 is skipped, and then P4 is checked.

[0057] An optimization system for signaling data type communication transmission uses the optimization method for signaling data type communication transmission.

[0058] The embodiments of the present application are described in detail above with reference to the drawings, but the present application is not limited to the described embodiments. For those skilled in the art, various changes, modifications, replacements and variations of the embodiments can be made without departing from the principles and spirits of the present application, and still fall within the protection scope of the present application.

Claims

1. An optimization method for signaling data type communication transmission, characterized in that, The method comprises the following steps: S1: the sending end attaches a hash value to a signaling data packet and dynamically generates a redundant forward error correction packet according to a network state; S2: the sending end transmits the signaling data packet and the redundant forward error correction packet to a receiving end through a network; S3: the receiving end checks the received signaling data packet and the redundant forward error correction packet and stores them in a cache area; S4: the receiving end detects a lost packet through a sequence number of the data packet and uses the redundant forward error correction packet in the cache area for local recovery to recover the lost packet; If the local recovery fails, retransmission is triggered.

2. The optimization method for signaling data type communication transmission according to claim 1, wherein, The step S1 comprises that the sending end calculates a hash value of a fixed length for each signaling data packet and attaches the hash value to a data packet header; The sending end obtains a network packet loss rate through an acknowledgement message of the receiving end, and when the network packet loss rate is greater than or equal to a preset threshold, generates a redundant packet through linear combination of multiple signaling data packets, attaches a hash combination of the redundant packet to the header of the redundant packet, and obtains a redundant forward error correction packet.

3. The optimization method for signaling data type communication transmission according to claim 2, wherein: In the step S1, when the network packet loss rate is higher than a preset threshold, linear combination is performed on the current transmitted signaling data packet and k signaling data packets before it is transmitted to obtain a redundant packet Fm, wherein is an XOR operation, P1, P2...Pk are signaling data packets, Pk is the current transmitted signaling data packet, P1 is the kth signaling data packet before the current transmitted signaling data packet is transmitted, and c1, c2...ck are coding coefficients of the corresponding signaling data packets.

4. The optimization method for signaling data type communication transmission according to claim 3, characterized in that: In the step S1, the hash combination of the redundant packet is a hash value combination H(Fm_info) = H(H(P1) | H(P2) |... | H(Pk)) of k signaling data packets, wherein | represents connection.

5. The optimization method for signaling data type communication transmission according to claim 2, wherein, The step S2 comprises that the sending end sends the signaling data packet with the hash value in sequence according to the sequence number; When the network packet loss rate is higher than the preset threshold, the sending end sends the redundant forward error correction packet to the receiving end in sequence.

6. The optimization method for signaling data type communication transmission according to claim 1, wherein, The step S3 comprises that the receiving end performs hash checking on the received signaling data packet and the redundant forward error correction packet, stores the signaling data packet and the redundant forward error correction packet that pass the checking in the cache area, and discards the signaling data packet and the redundant forward error correction packet that fail the checking.

7. The optimization method for signaling data type communication transmission according to claim 1, wherein, The step S4 comprises that the receiving end detects the lost signaling data packet through a sequence number gap; The receiving end identifies a signaling data packet set that can be used to recover the lost packet according to the hash combination of the redundant packet of the redundant forward error correction packet, and recovers the lost packet through exclusive or operation on the signaling data packet set and the existing signaling data packet in the cache area; The receiving end submits the recovered signaling data packet to an application layer and sends an acknowledgement message after successful recovery.

8. The optimization method for signaling data type communication transmission according to claim 1, wherein: In the step S4, if the local recovery fails, the receiving end constructs a negative acknowledgement message containing a sequence number of the lost packet and sends the negative acknowledgement message to the sending end; The sending end extracts a signaling data packet corresponding to the sequence number from a sending cache according to the sequence number in the negative acknowledgement message; The sending end retransmits the signaling data packet with the hash value to the receiving end, and the receiving end checks the hash value of the retransmitted signaling data packet and submits the signaling data packet to the application layer after the checking passes.

9. The optimization method for signaling data type communication transmission according to claim 6, wherein: In the step S3, the receiving end performs hash check on the received signaling data packet and the redundant forward error correction packet, including: the receiving end extracts the hash value in the header of the received signaling data packet and the redundant forward error correction packet; the receiving end calculates the hash value of the content of the received signaling data packet and the redundant forward error correction packet; the receiving end compares the extracted hash value with the calculated hash value to determine the data integrity; and the receiving end determines whether the signaling data packet or the redundant forward error correction packet passes the check according to the comparison result, wherein when the comparison result is consistent, it means that the check passes, and when the comparison result is inconsistent, it means that the check fails.

10. An optimized system for signaling data type communication transmission, characterized by: Use the optimization method for signaling data type communication transmission of claim 1.

Images