An optimization method and system for signaling data type communication transmission

Abstract

The application discloses an optimization method and system for signaling data type communication transmission, and belongs to the technical field of data processing, which comprises the following steps: a sending end attaches a hash value to a signaling data packet, and dynamically generates a redundant forward error correction packet according to a network state; the sending end transmits the signaling data packet and the redundant forward error correction packet to a receiving end through a network; the receiving end checks the received signaling data packet and the redundant forward error correction packet, and stores them in a cache area; the receiving end detects a lost packet through a sequence number of the data packet, and uses the redundant forward error correction packet in the cache area for local recovery to recover the lost packet; if the local recovery fails, retransmission is triggered. The optimization method and system for signaling data type communication transmission solve the problem that the current transmission mode is difficult to realize stable transmission of signaling data in a weak network.

Description

Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to an optimization method and system for communication transmission of signaling data types. Background Technology

[0002] In network communication, there are numerous weak network environments characterized by low bandwidth, high packet loss, and high latency. These weak network environments have a significant impact on the communication performance and effectiveness of various software applications, including signaling transmission scenarios with high real-time requirements.

[0003] Because the transmitted signaling data is small in size, but the requirements for real-time performance and orderly arrival of signaling are higher than those for general transmission, signaling transmission requires low latency and orderliness. These two goals are contradictory to some extent. Current transmission methods are difficult to meet the signaling transmission requirements under weak network conditions, thus making it difficult to achieve stable transmission of signaling data under weak network conditions. Summary of the Invention

[0004] In order to overcome the shortcomings of the existing technology, one object of the present invention is to provide an optimized method for communication transmission of signaling data types, so as to solve the above-mentioned problems.

[0005] In order to overcome the shortcomings of the existing technology, another object of the present invention is to provide an optimized system for communication transmission of signaling data types to solve the above-mentioned problems.

[0006] The technical solution adopted by this invention to solve its technical problem is: an optimization method for communication transmission of signaling data types, comprising the following steps:

[0007] S1: The sending end appends a hash value to the signaling data packet and dynamically generates redundant forward error correction packets based on the network status;

[0008] S2: The sending end transmits the signaling data packet and the redundant forward error correction packet to the receiving end via the network;

[0009] S3: The receiving end verifies the received signaling data packets and redundant forward error correction packets and stores them in the buffer area;

[0010] S4: The receiving end detects lost packets by using the sequence number of the data packets and uses redundant forward error correction packets in the buffer to perform local recovery in order to recover the lost packets; if the local recovery fails, a retransmission is triggered.

[0011] Preferably, step S1 includes: the sending end calculates a hash value of fixed length for each signaling data packet and appends it to the data packet header;

[0012] The sending end obtains the network packet loss rate through the acknowledgment message from the receiving end. When the network packet loss rate is greater than or equal to a preset threshold, it performs linear combination of multiple signaling data packets to generate a redundant packet, and appends a header containing the hash combination of the redundant packet to the redundant packet to obtain a redundant forward error correction packet.

[0013] Optionally, in step S1, when the network packet loss rate is higher than a preset threshold, the currently sent signaling data packet and the k signaling data packets sent before it are linearly combined to obtain a redundant packet Fm, wherein... It is an XOR operation, where P1, P2...Pk are signaling data packets, where Pk is the currently sent signaling data packet, P1 is the k-th signaling data packet before the currently sent signaling data packet was sent, and c1, c2...ck are the coding coefficients of the corresponding signaling data packets.

[0014] Specifically, in step S1, the hash combination containing redundant packets is a hash value combination H(Fm_info) = H(H(P1)|H(P2)|...|H(Pk)) of k signaling data packets, where | represents a connection.

[0015] Preferably, step S2 includes: the sending end sending signaling data packets containing hash values ​​in sequence number order;

[0016] When the network packet loss rate is higher than a preset threshold, the sending end sends redundant forward error correction packets to the receiving end in sequence.

[0017] Specifically, step S3 includes: the receiving end performs hash verification on the received signaling data packets and redundant forward error correction packets, stores the signaling data packets and redundant forward error correction packets that pass the verification into the buffer area, and discards the signaling data packets and redundant forward error correction packets that fail the verification.

[0018] It is worth noting that step S4 includes: the receiving end detecting lost signaling data packets through the sequence number gap;

[0019] The receiving end identifies a set of signaling data packets that can be used to recover lost packets based on the hash combination of the redundant forward error correction packets containing the redundant packets; and recovers lost packets by performing an XOR operation on the set of signaling data packets used to recover lost packets and the existing signaling data packets in the buffer.

[0020] After successful recovery, the receiving end submits the recovered signaling data packet to the application layer and sends an acknowledgment message.

[0021] Preferably, in step S4, if the local response fails, the receiving end constructs a negative acknowledgment message containing the sequence number of the lost packet and sends it to the sending end;

[0022] The sending end extracts the signaling data packet with the corresponding sequence number from the sending buffer according to the sequence number in the negative acknowledgment message; the sending end retransmits the signaling data packet containing the hash value to the receiving end; the receiving end verifies the hash value of the retransmitted signaling data packet and submits the signaling data packet to the application layer after the verification is successful.

[0023] Specifically, in step S3, the receiving end performs hash verification on the received signaling data packets and redundant forward error correction packets, including: the receiving end extracts the hash value of the header of the received signaling data packets and redundant forward error correction packets; the receiving end calculates the hash value of the content of the received signaling data packets and redundant forward error correction packets; the receiving end compares the extracted hash value with the calculated hash value to determine data integrity; and the receiving end determines whether the signaling data packets or redundant forward error correction packets pass the verification based on the comparison result. When the comparison results are consistent, the verification is considered successful; when the comparison results are inconsistent, the verification is considered unsuccessful.

[0024] An optimization system for signaling data type communication transmission, using the aforementioned optimization method for signaling data type communication transmission.

[0025] The beneficial effects of this invention are as follows: In the optimized method for signaling data type communication transmission, a dual error correction mechanism is implemented. Forward error correction (FEC) is used to resist random packet loss, and retransmission is used to resist sudden packet loss; both share the same hash encoding / decoding logic. By dynamically generating redundant forward error correction packets based on network conditions, there is almost no redundancy overhead when the network is good, and the redundancy overhead of forward error correction is controllable when the network is poor. Combined with the extremely low bandwidth consumption during the retransmission stage (no longer retransmitting the entire large packet), bandwidth efficiency is greatly improved. Normally, recovery can be achieved locally through forward error correction without waiting for retransmission; even if retransmission is required, the amount of data in the request and response is very small, resulting in shorter waiting time in the network queue and shorter transmission time, significantly reducing retransmission latency; thus achieving the goal of low latency. In this way, stable transmission of signaling data is achieved under weak network conditions through extremely high bandwidth efficiency and low latency. Attached Figure Description

[0026] Figure 1 This is a flowchart of an optimization method for communication transmission of signaling data types in one embodiment of the present invention;

[0027] Figure 2 This is a flowchart of the sending end in an optimization method for signaling data type communication transmission in one embodiment of the present invention;

[0028] Figure 3 This is a flowchart of the receiving end in an optimization method for signaling data type communication transmission in one embodiment of the present invention. Detailed Implementation

[0029] The specific embodiments of the present invention will be further described below with reference to the accompanying drawings. It should be noted that these descriptions are for the purpose of aiding understanding the present invention, but do not constitute a limitation thereof. Furthermore, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0030] like Figure 1-3 As shown, an optimization method for communication transmission of signaling data types includes the following steps:

[0031] S1: The sending end appends a hash value to the signaling data packet and dynamically generates redundant forward error correction packets based on the network status;

[0032] S2: The sending end transmits the signaling data packet and the redundant forward error correction packet to the receiving end via the network;

[0033] S3: The receiving end verifies the received signaling data packets and redundant forward error correction packets and stores them in the buffer area;

[0034] S4: The receiving end detects lost packets by using the sequence number of the data packets and uses redundant forward error correction packets in the buffer to perform local recovery in order to recover the lost packets; if the local recovery fails, a retransmission is triggered.

[0035] The optimized method for signaling data type communication transmission implements a dual error correction mechanism: Forward Error Correction (FEC) to resist random packet loss, and retransmission to resist sudden packet loss. Both share the same hash encoding / decoding logic. By dynamically generating redundant FEC packets based on network conditions, there is almost no redundancy overhead when the network is good. When the network is poor, the FEC redundancy overhead is controllable. Combined with the extremely low bandwidth consumption during the retransmission phase (no longer retransmitting the entire large packet), bandwidth efficiency is greatly improved. Typically, recovery can be achieved locally through FEC without waiting for retransmission. Even if retransmission is necessary, the request and response data volumes are very small, resulting in shorter waiting times in the network queue and shorter transmission times, significantly reducing retransmission latency and achieving low latency. Thus, stable transmission of signaling data is achieved under weak network conditions through extremely high bandwidth efficiency and low latency.

[0036] This solution is designed to ensure low latency and sequential correctness in end-to-end signaling data transmission under weak network conditions (e.g., packet loss, latency, jitter). It is primarily used for real-time interactive applications that are highly sensitive to latency and require high reliability over unreliable networks. This solution is particularly suitable for scenarios where the cost (time and bandwidth) of retransmitting the entire data packet is unacceptably high. This solution can be deployed as a "specialized" technology in critical services with demanding network conditions and zero tolerance for latency. It trades higher design complexity and computational overhead for optimal latency and bandwidth performance in weak network environments.

[0037] Preferably, step S1 includes: the sending end calculates a fixed-length hash value for each signaling data packet and appends it to the data packet header; for example, for the original signaling data packet P1, a fixed-length hash value H(P1) is calculated for P1 using CRC32 or Blake3 truncated hash, and the hash value H(P1) is appended to P1 as the data packet header, finally obtaining the data packet to be sent as [P1, H(P1)];

[0038] The sending end obtains the network packet loss rate through the acknowledgment message from the receiving end. When the network packet loss rate is greater than or equal to a preset threshold, it performs linear combination of multiple signaling data packets to generate a redundant packet, and appends a header containing the hash combination of the redundant packet to the redundant packet to obtain a redundant forward error correction packet.

[0039] Traditional Forward Error Correction (FEC) adds redundancy on a "block" basis, regardless of network conditions. This solution, however, adaptively determines whether to add redundancy, how much to add, and in what form, based on real-time network assessments (such as packet loss rate). In this embodiment, the sender continuously monitors the success rate of transmitted packets through ACK / NACK feedback from the receiver, and then uses the corresponding packet loss rate as the network packet loss rate. A preset threshold is set; when the network packet loss rate is less than the preset threshold, it indicates a good network, and no redundant packets are generated, thus saving bandwidth and minimizing latency. When the network packet loss rate is greater than or equal to the preset threshold, it indicates network fluctuations, and lookahead coding is initiated. This lookahead coding involves linearly combining multiple signaling data packets to generate redundant packets. By monitoring network indicators in real time and dynamically adjusting the forward error correction on / off state, the algorithm can adapt to various environments, from wired networks to extremely weak networks.

[0040] Optionally, in step S1, when the network packet loss rate is higher than a preset threshold, the currently sent signaling data packet and the k signaling data packets sent before it are linearly combined to obtain a redundant packet Fm, wherein... It is an XOR operation, where P1, P2...Pk are signaling data packets, where Pk is the currently sent signaling data packet, P1 is the k-th signaling data packet before the currently sent signaling data packet was sent, and c1, c2...ck are the coding coefficients of the corresponding signaling data packets.

[0041] In this scheme, when generating redundant packets, not all signaling data packets are encoded, but the k most recently sent signaling data packets are linearly combined through dynamic grouping.

[0042] Specifically, in step S1, the hash combination containing the redundant packet is a hash value combination H(Fm_info) = H(H(P1)|H(P2)|...|H(Pk)) of k signaling data packets, where | represents a connection. Therefore, the resulting redundant forward error correction packet is [Fm, H(Fm_info)], where Fm is the redundant packet and H(Fm_info) is the header of the redundant packet.

[0043] It is worth noting that step S2 includes: the sending end sending signaling data packets containing hash values ​​in sequence number order;

[0044] When the network packet loss rate is higher than a preset threshold, the sending end sends redundant forward error correction packets to the receiving end in sequence.

[0045] In this embodiment, the sending end intermittently inserts redundant forward error correction packets when it detects network fluctuations. The timing of sending the redundant forward error correction packets is that the sending end detects network fluctuations based on the confirmation message returned by the receiving end, and stops sending them after the network stabilizes. In addition, the packet header is used to distinguish between signaling data packets and redundant forward error correction packets.

[0046] Preferably, step S3 includes: the receiving end performs hash verification on the received signaling data packets and redundant forward error correction packets, stores the signaling data packets and redundant forward error correction packets that pass the verification into the buffer area, and discards the signaling data packets and redundant forward error correction packets that fail the verification.

[0047] In this embodiment, the receiving end maintains a receive buffer to store correctly received but possibly out-of-order data packets, including signaling data packets and redundant forward error correction packets.

[0048] Optionally, step S4 includes: the receiving end detects lost signaling data packets through the sequence number gap; in this embodiment, the sequence number gap is the sequence number of the lost signaling data packet. The header of the signaling data packet will have a sequence number identifier. If signaling data packets P1, P2, P4 and P5 are received, the sequence number gap can be calculated to be 3, that is, the signaling data packet P3 is found to be lost.

[0049] The receiving end identifies a set of signaling data packets that can be used to recover lost packets based on the hash combination containing the redundant forward error correction packet. The lost packet is recovered by performing an XOR operation on the set of signaling data packets used to recover the lost packet and the existing signaling data packets in the buffer. For example, if the hash combination H(Fm_info) containing the redundant packet can be determined to be encoded from signaling data packets P1, P2, P3, P4, and P5, and the existing signaling data packets in the buffer are P1, P2, P4, and P5, the result of the XOR operation is used to update the existing signaling data packets in the buffer. The updated existing signaling data packets in the buffer are P1, P2, P3, P4, and P5, thereby recovering the lost packet P3.

[0050] After successful recovery, the receiving end submits the recovered signaling data packet to the application layer and sends an acknowledgment message.

[0051] After successful recovery, the recovered signaling data packet P3 is submitted to the upper-layer application, and an ACK is sent to the sender.

[0052] Specifically, in step S4, if the local response fails (e.g., there is no redundant forward error correction packet in the buffer that can directly recover the lost packet), the receiving end constructs a negative acknowledgment message (NACK) containing the sequence number of the lost packet and sends it to the sending end; in this embodiment, the negative acknowledgment message NACK only contains the sequence number of the lost packet, such as sequence number 3 in the signaling data packet P3, so the capacity of the negative acknowledgment message NACK is very small;

[0053] The sending end extracts the signaling data packet with the corresponding sequence number from the sending buffer according to the sequence number in the negative acknowledgment message; the sending end retransmits the signaling data packet containing the hash value to the receiving end; the receiving end verifies the hash value of the retransmitted signaling data packet and submits the signaling data packet to the application layer after the verification is successful.

[0054] When the receiving end receives the retransmitted signaling data packet containing the hash value, it verifies that the hash is correct, submits it to the application layer, and sends an ACK to the sending end. Specifically, hash verification ensures data integrity, while the negative acknowledgment (NACK) mechanism ensures the accuracy of the retransmission request and avoids unnecessary retransmissions.

[0055] It is worth noting that in step S3, the receiving end performs hash verification on the received signaling data packets and redundant forward error correction packets, including: the receiving end extracts the hash value of the header of the received signaling data packets and redundant forward error correction packets; the receiving end calculates the hash value of the content of the received signaling data packets and redundant forward error correction packets; the receiving end compares the extracted hash value with the calculated hash value to determine data integrity; and the receiving end determines whether the signaling data packets or redundant forward error correction packets pass the verification based on the comparison result. When the comparison results are consistent, the verification is considered successful; when the comparison results are inconsistent, the verification is considered unsuccessful.

[0056] The verification in this scheme is a self-verification of a single data packet, verifying whether the single data packet itself is reliable. For example, for signaling data packets P1, P2, P3, P4 and P5, if the receiving end only receives signaling data packets P1, P2, P4 and P5 and signaling data packet P3 is missing, after verifying P2, the missing P3 will be skipped and then P4 will be verified.

[0057] An optimization system for signaling data type communication transmission, using the aforementioned optimization method for signaling data type communication transmission.

[0058] The embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to the described embodiments. For those skilled in the art, various changes, modifications, substitutions, and variations can be made to these embodiments without departing from the principles and spirit of the present invention, and these variations still fall within the protection scope of the present invention.

Claims

1. An optimization method for communication transmission of signaling data types, characterized in that, Includes the following steps: S1: The sending end appends a hash value to the signaling data packet and dynamically generates redundant forward error correction packets based on the network status; S2: The sending end transmits the signaling data packet and the redundant forward error correction packet to the receiving end via the network; S3: The receiving end verifies the received signaling data packets and redundant forward error correction packets and stores them in the buffer area; S4: The receiving end detects lost signaling data packets by using the sequence number gap; The receiving end identifies a set of signaling data packets that can be used to recover lost packets based on the hash combination of the redundant forward error correction packets containing the redundant packets. Lost packets are recovered by performing an XOR operation on the set of signaling packets used to recover the lost packets and the existing signaling packets in the buffer. After successful recovery, the receiving end submits the recovered signaling data packet to the application layer and sends an acknowledgment message. If the local response fails, a retransmission will be triggered. Step S1 includes: the sending end obtains the network packet loss rate through the acknowledgment message from the receiving end; when the network packet loss rate is higher than a preset threshold, it obtains the currently sent signaling data packet and the k signaling data packets sent before it, performs a linear combination to obtain a redundant packet Fm, and appends a header containing the hash combination of the redundant packet to the redundant packet to obtain a redundant forward error correction packet; wherein , This is an XOR operation, where P1, P2...Pk are signaling data packets, where Pk is the currently sent signaling data packet, P1 is the k-th signaling data packet before the currently sent signaling data packet was sent, and c1, c2...ck are the encoding coefficients of the corresponding signaling data packets; the hash combination containing redundant packets is the hash value combination H(Fm_info)=H(H(P1)|H(P2)|...|H(Pk)), where | represents concatenation; In step S4, if the local response fails, the receiving end constructs a negative acknowledgment message containing the sequence number of the lost packet and sends it to the sending end. The sending end extracts the signaling data packet with the corresponding sequence number from the sending buffer according to the sequence number in the negative acknowledgment message; the sending end retransmits the signaling data packet containing the hash value to the receiving end; the receiving end verifies the hash value of the retransmitted signaling data packet and submits the signaling data packet to the application layer after the verification is successful.

2. The optimization method for signaling data type communication transmission according to claim 1, characterized in that, Step S2 includes: the sending end sending signaling data packets containing hash values ​​in sequence number order; When the network packet loss rate is higher than a preset threshold, the sending end sends redundant forward error correction packets to the receiving end in sequence.

3. The optimization method for communication transmission of signaling data types according to claim 1, characterized in that, Step S3 includes: the receiving end performs hash verification on the received signaling data packets and redundant forward error correction packets, stores the signaling data packets and redundant forward error correction packets that pass the verification into the buffer area, and discards the signaling data packets and redundant forward error correction packets that fail the verification.

4. The optimization method for communication transmission of signaling data types according to claim 3, characterized in that: In step S3, the receiving end performs hash verification on the received signaling data packets and redundant forward error correction packets, including: the receiving end extracts the hash value of the header of the received signaling data packets and redundant forward error correction packets; the receiving end calculates the hash value of the content of the received signaling data packets and redundant forward error correction packets; the receiving end compares the extracted hash value with the calculated hash value to determine data integrity; and the receiving end determines whether the signaling data packet or redundant forward error correction packet passes the verification based on the comparison result. When the comparison results are consistent, the verification is successful; when the comparison results are inconsistent, the verification fails.

5. An optimized system for communication transmission of signaling data types, characterized in that: The method for optimizing signaling data type communication transmission as described in claim 1.

Images