Data analysis management method

Abstract

The invention discloses a data analysis and management method, which belongs to the technical field of data processing, and comprises the following steps: S1, obtaining communication protocol content when a current data packet is transmitted, the communication protocol content comprising a source port number and a destination port number; s2, determining a network session random number and a congestion random number according to the communication protocol content, and generating a protocol content set; and S3, when the current data packet is transmitted, completing data transmission by using the protocol content set. According to the congestion avoiding algorithm, the size of the sending window can be dynamically adjusted according to the network condition, so that network congestion is avoided, the stability and reliability of data transmission are greatly improved, network resources can be more reasonably distributed through the congestion avoiding algorithm, and unnecessary bandwidth waste and delay are reduced.

Description

Technical Field

[0001] The present invention belongs to the technical field of data processing, and in particular relates to a data analysis management method. Background Art

[0002] In the era of big data, the value of data is becoming increasingly prominent, and with it comes the increasing problem of data security. As the core of data processing and storage, the allocation of network resources of the network platform is directly related to the stability of the entire data ecosystem and the availability of data. The TCP protocol is a reliable, connection-oriented transport layer communication protocol based on byte streams. Its connection-based data transmission properties require mutual confirmation between the two parties in each step of the communication process to proceed smoothly. It is widely used in the field of data analysis and management. However, traditional data analysis and management methods often cannot obtain and process the network protection information of the big data service channel port in real time, resulting in a lag in data transmission, and cannot complete data transmission management in combination with the characteristics of the TCP protocol. Summary of the invention

[0003] In order to solve the above problems, the present invention proposes a data analysis management method.

[0004] The technical solution of the present invention is: a data analysis management method comprises the following steps:

[0005] S1. Obtain the communication protocol content during the current data packet transmission, wherein the communication protocol content includes a source port number and a destination port number;

[0006] S2. Determine the network session random number and congestion random number according to the communication protocol content, and generate a protocol content set;

[0007] S3. When the current data packet is transmitted, the protocol content set is used to complete the data transmission.

[0008] Furthermore, S2 includes the following sub-steps:

[0009] S21, obtaining the source port number and destination port number corresponding to the TCP communication protocol;

[0010] S22, generating a network session random number according to the source port number and the destination port number;

[0011] S23, calculating a congestion random number according to a TCP timeout setting time and a retransmission timeout time of a TCP communication protocol;

[0012] S24. Generate a protocol content set according to the network session random number and the congestion random number.

[0013] The beneficial effect of the above further scheme is: in the present invention, the source port number is the port number on the computer of the data packet sender. The destination port number is the port number on the computer of the data packet receiver. The source port number and the destination port number jointly identify a network session, ensuring that data can be transmitted between the correct sender and receiver. By generating a network session random number, a unique identifier is provided, which increases the confidentiality and security of the session. The congestion random number is calculated based on the TCP timeout setting time and the retransmission timeout time, which can reflect the congestion status of the network and provide a basis for subsequent congestion control. By calculating the congestion random number, the data transmission rate can be controlled more accurately, network congestion can be avoided, and the performance and stability of data transmission can be improved.

[0014] Furthermore, in S22, the network session random number S session The calculation formula is:

[0015] Where D cause Indicates the source port number, D aim Represents the destination port number, and c represents a constant.

[0016] Furthermore, in S23, the congestion random number S jam The calculation formula is:

[0017] ;W represents the window size of the TCP communication protocol, v * Indicates the rate corresponding to the TCP rate smoothing mechanism, RTO indicates the retransmission timeout, T over Indicates the TCP timeout setting time.

[0018] Retransmission timeout, also known as initial RTO, during TCP connection establishment or data transmission, if the sender does not receive confirmation from the receiver within the specified time, it will be considered that the data packet is lost and retransmitted. The initial RTO is the waiting time before the first retransmission. TCP timeout setting time: including connection establishment timeout and data transmission timeout, etc. These timeouts are crucial to controlling the stability and reliability of TCP connections. The TCP window size determines the maximum amount of data that the sender can send before receiving confirmation from the receiver. TCP pacing (TCP rate smoothing) is a technology used to optimize the transmission performance of the TCP protocol. TCP pacing uses rate rather than confirmation to determine the sending time. It calculates the appropriate sending rate based on the network bandwidth and TCP window size, and sends data packets smoothly at this rate.

[0019] Further, S24 includes the following sub-steps:

[0020] S241, determining the parameters of the bilinear mapping according to the network session random number, the congestion random number, and the maximum SYN retransmission times of the TCP communication protocol;

[0021] S242: Generate a protocol content set using the parameters of the bilinear mapping.

[0022] The beneficial effect of the above further scheme is that in the present invention, not only the network session random number and the congestion random number are considered, but also the maximum SYN retransmission number of the TCP communication protocol is combined. This comprehensive consideration can more comprehensively reflect the network status and the characteristics of the communication protocol, thereby more accurately determining the parameters of the bilinear mapping. By accurately calculating the parameters of the bilinear mapping, the mapping process can be ensured to be more accurate, reducing errors and uncertainties. This helps the generation of the protocol content set and the accuracy of data processing in the subsequent steps.

[0023] Maximum number of SYN retransmissions: During the TCP connection establishment process, the sender will send a SYN message to request to establish a connection. If no response is received, the SYN message will be resent. This parameter sets the maximum number of attempts to send a SYN message.

[0024] Furthermore, in S241, the calculation formula of the parameter γ of the bilinear mapping is:

[0025] Where S session Indicates the random number of the network session, S jam represents the congestion random number, t represents the maximum number of SYN retransmissions of the TCP communication protocol, max(·) represents the maximum value operation, Indicates rounding up.

[0026] Furthermore, in S242, the calculation formula of the protocol content set Z is:

[0027] ; Wherein, γ represents the parameter of the bilinear mapping, e(·) represents the bilinear mapping, g represents the generator, rand(0,1) represents the generation of a random number between 0 and 1, and P represents the TCP timestamp of the TCP communication protocol.

[0028] Furthermore, S3 includes the following sub-steps:

[0029] S31, taking the average of all elements in the protocol content set as the slow start threshold;

[0030] S32. Based on the slow start threshold, the current data packet is transmitted using a congestion avoidance algorithm.

[0031] The beneficial effect of the above further scheme is that in the present invention, by taking the mean of all elements in the protocol content set as the slow start threshold, the threshold value can dynamically reflect the current network status and the characteristics of the communication protocol, which helps the TCP connection to quickly adapt when the network environment changes and adjust its transmission strategy. The setting of the slow start threshold can improve the data transmission efficiency as much as possible while avoiding network congestion. The congestion avoidance algorithm can dynamically adjust the data transmission volume according to the network status, thereby optimizing the utilization of network resources, improving the network throughput and transmission efficiency, and reducing the waste of network resources.

[0032] The congestion avoidance algorithm is an important mechanism in the TCP protocol for controlling network congestion. The slow start threshold is a threshold parameter in the TCP connection, which is used to control the growth rate of the congestion window.

[0033] The beneficial effects of the present invention are as follows: the present invention can ensure the accuracy and real-time nature of information by directly acquiring the communication protocol content during the current data packet transmission, and organize the communication protocol content into a collection form to facilitate subsequent data packet analysis, filtering and matching; at the same time, the congestion avoidance algorithm can dynamically adjust the size of the sending window according to the network status, thereby avoiding the occurrence of network congestion, greatly improving the stability and reliability of data transmission, and through the congestion avoidance algorithm, network resources can be allocated more reasonably, reducing unnecessary bandwidth waste and delays. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 Flowchart of the management approach for data analysis. DETAILED DESCRIPTION

[0035] The embodiments of the present invention will be further described below in conjunction with the accompanying drawings.

[0036] like Figure 1 As shown, the present invention provides a data analysis management method, comprising the following steps:

[0037] S1. Obtain the communication protocol content during the current data packet transmission, wherein the communication protocol content includes a source port number and a destination port number;

[0038] S2. Determine the network session random number and congestion random number according to the communication protocol content, and generate a protocol content set;

[0039] S3. When the current data packet is transmitted, the protocol content set is used to complete the data transmission.

[0040] In this embodiment of the present invention, S2 includes the following sub-steps:

[0041] S21, obtaining the source port number and destination port number corresponding to the TCP communication protocol;

[0042] S22, generating a network session random number according to the source port number and the destination port number;

[0043] S23, calculating a congestion random number according to a TCP timeout setting time and a retransmission timeout time of a TCP communication protocol;

[0044] S24. Generate a protocol content set according to the network session random number and the congestion random number.

[0045] In the present invention, the source port number is the port number on the computer of the data packet sender. The destination port number is the port number on the computer of the data packet receiver. The source port number and the destination port number jointly identify a network session, ensuring that data can be transmitted between the correct sender and receiver. By generating a network session random number, a unique identifier is provided, which increases the confidentiality and security of the session. The congestion random number is calculated based on the TCP timeout setting time and the retransmission timeout time, which can reflect the congestion status of the network and provide a basis for subsequent congestion control. By calculating the congestion random number, the data transmission rate can be controlled more accurately, network congestion can be avoided, and the performance and stability of data transmission can be improved.

[0046] In the embodiment of the present invention, in S22, the network session random number S session The calculation formula is:

[0047] Where D cause Indicates the source port number, D aim Represents the destination port number, and c represents a constant.

[0048] In the embodiment of the present invention, in S23, the congestion random number S jam The calculation formula is:

[0049] ;W represents the window size of the TCP communication protocol, v * Indicates the rate corresponding to the TCP rate smoothing mechanism, RTO indicates the retransmission timeout, T over Indicates the TCP timeout setting time.

[0050] Retransmission timeout, also known as initial RTO, during TCP connection establishment or data transmission, if the sender does not receive confirmation from the receiver within the specified time, it will be considered that the data packet is lost and retransmitted. The initial RTO is the waiting time before the first retransmission. TCP timeout setting time: including connection establishment timeout and data transmission timeout, etc. These timeouts are crucial to controlling the stability and reliability of TCP connections. The TCP window size determines the maximum amount of data that the sender can send before receiving confirmation from the receiver. TCP pacing (TCP rate smoothing) is a technology used to optimize the transmission performance of the TCP protocol. TCP pacing uses rate rather than confirmation to determine the sending time. It calculates the appropriate sending rate based on the network bandwidth and TCP window size, and sends data packets smoothly at this rate.

[0051] In this embodiment of the present invention, S24 includes the following sub-steps:

[0052] S241, determining the parameters of the bilinear mapping according to the network session random number, the congestion random number, and the maximum SYN retransmission times of the TCP communication protocol;

[0053] S242: Generate a protocol content set using the parameters of the bilinear mapping.

[0054] In the present invention, not only the network session random number and the congestion random number are considered, but also the maximum SYN retransmission times of the TCP communication protocol are combined. This comprehensive consideration can more comprehensively reflect the network status and the characteristics of the communication protocol, thereby more accurately determining the parameters of the bilinear mapping. By accurately calculating the parameters of the bilinear mapping, the mapping process can be ensured to be more accurate, reducing errors and uncertainties. This helps the generation of the protocol content set and the accuracy of data processing in the subsequent steps.

[0055] Maximum number of SYN retransmissions: During the TCP connection establishment process, the sender will send a SYN message to request to establish a connection. If no response is received, the SYN message will be resent. This parameter sets the maximum number of attempts to send a SYN message.

[0056] In the embodiment of the present invention, in S241, the calculation formula of the parameter γ of the bilinear mapping is:

[0057] Where S session Indicates the random number of the network session, S jam represents the congestion random number, t represents the maximum number of SYN retransmissions of the TCP communication protocol, max(·) represents the maximum value operation, Indicates rounding up.

[0058] In the embodiment of the present invention, in S242, the calculation formula of the protocol content set Z is:

[0059] ; Wherein, γ represents the parameter of the bilinear mapping, e(·) represents the bilinear mapping, g represents the generator, rand(0,1) represents the generation of a random number between 0 and 1, and P represents the TCP timestamp of the TCP communication protocol.

[0060] In this embodiment of the present invention, S3 includes the following sub-steps:

[0061] S31, taking the average of all elements in the protocol content set as the slow start threshold;

[0062] S32. Based on the slow start threshold, the current data packet is transmitted using a congestion avoidance algorithm.

[0063] In the present invention, by taking the mean of all elements in the protocol content set as the slow start threshold, the threshold value can dynamically reflect the current network status and the characteristics of the communication protocol, which helps the TCP connection to quickly adapt when the network environment changes and adjust its transmission strategy. The setting of the slow start threshold can improve the data transmission efficiency as much as possible while avoiding network congestion. The congestion avoidance algorithm can dynamically adjust the data transmission volume according to the network status, thereby optimizing the utilization of network resources, improving the network throughput and transmission efficiency, and reducing the waste of network resources.

[0064] The congestion avoidance algorithm is an important mechanism in the TCP protocol for controlling network congestion. The slow start threshold is a threshold parameter in the TCP connection, which is used to control the growth rate of the congestion window.

[0065] Those skilled in the art will appreciate that the embodiments described herein are intended to help readers understand the principles of the present invention, and should be understood that the protection scope of the present invention is not limited to such specific statements and embodiments. Those skilled in the art can make various other specific variations and combinations that do not deviate from the essence of the present invention based on the technical revelations disclosed by the present invention, and these variations and combinations are still within the protection scope of the present invention.

Claims

1. A data analysis management method, characterized in that: The following steps are involved: S1. Obtain the communication protocol content during the current data packet transmission, wherein the communication protocol content includes a source port number and a destination port number; S2. Determine the network session random number and congestion random number according to the communication protocol content, and generate a protocol content set; S3. When the current data packet is transmitted, the protocol content set is used to complete the data transmission.

2. The data analysis management method according to claim 1, characterized in that: The S2 comprises the following sub-steps: S21, obtaining the source port number and destination port number corresponding to the TCP communication protocol; S22, generating a network session random number according to the source port number and the destination port number; S23, calculating a congestion random number according to a TCP timeout setting time and a retransmission timeout time of a TCP communication protocol; S24. Generate a protocol content set according to the network session random number and the congestion random number.

3. The data analysis management method according to claim 2, characterized in that: In S22, the network session random number S session The calculation formula is: Where D cause Indicates the source port number, D aim Represents the destination port number, and c represents a constant.

4. The data analysis management method according to claim 2, characterized in that: In S23, the congestion random number S jam The calculation formula is: ;W represents the window size of the TCP communication protocol, v * Indicates the rate corresponding to the TCP rate smoothing mechanism, RTO indicates the retransmission timeout, T over Indicates the TCP timeout setting time.

5. The data analysis management method according to claim 2, characterized in that: The S24 comprises the following sub-steps: S241, determining the parameters of the bilinear mapping according to the network session random number, the congestion random number, and the maximum SYN retransmission times of the TCP communication protocol; S242: Generate a protocol content set using the parameters of the bilinear mapping.

6. The data analysis management method according to claim 5, characterized in that: In S241, the calculation formula of the parameter γ of the bilinear mapping is: Where S session Indicates the random number of the network session, S jam represents the congestion random number, t represents the maximum number of SYN retransmissions of the TCP communication protocol, max(·) represents the maximum value operation, Indicates rounding up.

7. The data analysis management method according to claim 5, characterized in that: In S242, the calculation formula of the protocol content set Z is: ; Wherein, γ represents the parameter of the bilinear mapping, e(·) represents the bilinear mapping, g represents the generator, rand(0,1) represents the generation of a random number between 0 and 1, and P represents the TCP timestamp of the TCP communication protocol.

8. The data analysis management method according to claim 1, characterized in that: The S3 comprises the following sub-steps: S31, taking the average of all elements in the protocol content set as the slow start threshold; S32. Based on the slow start threshold, the current data packet is transmitted using a congestion avoidance algorithm.

Images