Method, device, electronic device and storage medium for determining initial congestion window value

By dynamically adjusting the initial congestion window value of the network connection, the problem of unreasonable setting of the initial congestion window value in the prior art is solved, and the quality of content distribution and transmission efficiency are improved.

CN112367264BActive Publication Date: 2024-11-12BIGO TECH PTE LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011165991.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-10-27
Publication Date
2024-11-12
Estimated Expiration
2040-10-27

AI Technical Summary

Technical Problem

In the prior art, the initial congestion window value setting does not distinguish the application scenario type of network connection and fails to dynamically adjust, resulting in poor content distribution quality.

Method used

By obtaining the connection information of the newly created network connection, determining its application scenario type, finding the optimal initial congestion window value in the preset initial congestion window value table, and updating the value in the table based on the income after the data is transmitted, so as to realize the application scenario type Dynamically adjust the initial congestion window value and network status.

Benefits of technology

Improve the quality of content distribution, set appropriate initial congestion window values ​​according to different application scenario types and network status, and improve transmission efficiency and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112367264B_ABST
    Figure CN112367264B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention discloses a method, device, electronic device and storage medium for determining an initial congestion window value, comprising: obtaining connection information of a newly created network connection; determining a network connection group to which the newly created network connection belongs according to the connection information, wherein the network connection group includes network connections of the same application scenario type; searching for an optimal initial congestion window value of the network connection group in a preset initial congestion window value table; setting the initial congestion window value of the newly created network connection as the optimal initial congestion window value; calculating the revenue of the newly created network connection after the newly created network connection completes data transmission; updating the optimal initial congestion window value of the network connection group in the preset initial congestion window value table according to the revenue of the newly created network connection, and being able to set the initial congestion window value in combination with the application scenario type and network status of the network connection, and being able to set the initial congestion window value of the network connection according to different application scenario types and network status, thereby improving the quality of content distribution.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of network transmission technology, and in particular to a method, device, electronic device and storage medium for determining an initial congestion window value. Background Art

[0002] TCP is a connection-oriented, reliable, byte-stream-based transport layer communication protocol. TCP-based network connections are widely used in mainstream Internet applications, such as the World Wide Web, email, file transfer, and streaming media transmission. There are many configurable parameters in a TCP connection, and different configuration parameters will affect the performance of a TCP connection under actual network conditions. Among them, the initial congestion window value has a greater impact. For example, for web page services, increasing the initial congestion window value from 3 to 10 will significantly reduce web page transmission delays.

[0003] The application scenario types of the network are roughly divided into instant consumption transmission and non-instant consumption transmission. Instant consumption transmission refers to network transmission that consumes the transmitted data while transmitting, such as streaming media (music, video, etc.) transmission, which is usually played while transmitting; non-instant consumption transmission refers to network transmission that consumes the transmitted data after the transmission is completed, such as file (email, picture download, etc.) transmission. For non-instant consumption transmission, users are more concerned about the transmission speed and transmission completion time of the entire transmission, while instant consumption transmission users are more concerned about the transmission speed in the transmission startup phase, transmission speed stability and other performance during the transmission process.

[0004] In the prior art, content distribution service providers usually set a fixed initial congestion window value for network connections based on experience to transmit content. They neither distinguish the application scenario type of the network connection to set the initial congestion window value, nor dynamically adjust the initial congestion window value according to the network status, resulting in poor content distribution quality. Summary of the invention

[0005] The embodiments of the present invention provide a method, device, electronic device and storage medium for determining an initial congestion window value, so as to solve the problem that the prior art neither distinguishes the application scenario type of the network connection to set the initial congestion window value nor dynamically adjusts the initial congestion window value according to the network status, resulting in poor content distribution quality.

[0006] In a first aspect, an embodiment of the present invention provides a method for determining an initial congestion window value, comprising:

[0007] Acquire connection information of the newly created network connection, wherein the connection information includes an application scenario type of the newly created network connection;

[0008] Determine, according to the connection information, a network connection group to which the newly created network connection belongs, wherein the network connection group includes network connections of the same application scenario type;

[0009] Searching for the optimal initial congestion window value of the network connection packet in a preset initial congestion window value table;

[0010] Setting the initial congestion window value of the newly created network connection to the optimal initial congestion window value;

[0011] Calculating the revenue of the newly created network connection after the newly created network connection finishes transmitting data;

[0012] The optimal initial congestion window value of the network connection group in the preset initial congestion window value table is updated according to the revenue of the newly created network connection.

[0013] In a second aspect, an embodiment of the present invention provides a device for determining an initial congestion window value, comprising:

[0014] A connection information acquisition module, used to acquire connection information of a newly created network connection, wherein the connection information includes an application scenario type of the newly created network connection;

[0015] A network connection group determination module, configured to determine, according to the connection information, a network connection group to which the newly created network connection belongs, wherein the network connection group includes network connections of the same application scenario type;

[0016] An optimal initial congestion window value search module, used to search for the optimal initial congestion window value of the network connection packet in a preset initial congestion window value table;

[0017] An initial congestion window value setting module, used to set the initial congestion window value of the newly created network connection to the optimal initial congestion window value;

[0018] A profit calculation module, used for calculating the profit of the newly created network connection after the newly created network connection completes data transmission;

[0019] The preset initial congestion window value table updating module is used to update the optimal initial congestion window value of the network connection group in the preset initial congestion window value table according to the revenue of the newly created network connection.

[0020] In a third aspect, an embodiment of the present invention provides an electronic device, the electronic device comprising:

[0021] one or more processors;

[0022] a storage device for storing one or more programs,

[0023] When the one or more programs are executed by the one or more processors, the one or more processors implement the method for determining the initial congestion window value described in any embodiment of the present invention.

[0024] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method for determining an initial congestion window value described in any embodiment of the present invention.

[0025] An embodiment of the present invention obtains connection information of a newly created network connection, where the connection information includes an application scenario type of the newly created network connection, determines a network connection group to which the newly created network connection belongs based on the connection information, where the network connection group includes network connections with the same application scenario type; searches for an optimal initial congestion window value of the network connection group in a preset initial congestion window value table, sets the initial congestion window value of the newly created network connection as the optimal initial congestion window value, calculates a profit of the newly created network connection after the newly created network connection completes data transmission, and updates the optimal initial congestion window value of the network connection group in the preset initial congestion window value table based on the profit of the newly created network connection. On the one hand, the network connections in the same network connection group have the same application scenario type. The optimal initial congestion window value of the network connection group is obtained by looking up the preset initial congestion window value table as the initial congestion window value of the newly created network connection, thereby setting the initial congestion window value according to the application scenario type of the newly created network connection. On the other hand, the optimal initial congestion window value of the network connection group is updated according to the revenue of the newly created network connection, and the optimal initial congestion window value of the network connection group can be adjusted according to the network status, that is, setting the initial congestion window value according to the application scenario type and network status of the network connection, so that the initial congestion window value of the network connection can be set according to different application scenario types and network status, thereby improving the quality of content distribution. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 is a flowchart of a method for determining an initial congestion window value provided by Embodiment 1 of the present invention;

[0027] Figure 2 is a flowchart of a method for determining an initial congestion window value provided by Embodiment 2 of the present invention;

[0028] Figure 3 is a flowchart of a method for determining an initial congestion window value provided by Embodiment 3 of the present invention;

[0029] Figure 4 It is a structural block diagram of a device for determining an initial congestion window value provided by Embodiment 4 of the present invention;

[0030] Figure 5 It is a structural schematic diagram of an electronic device provided in Embodiment 5 of the present invention. DETAILED DESCRIPTION

[0031] The present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only the parts related to the present invention, rather than all structures, are shown in the accompanying drawings. In the absence of conflict, the embodiments in this application and the features in the embodiments may be combined with each other.

[0032] Embodiment 1

[0033] Figure 1 The present invention provides a flowchart of the steps of a method for determining an initial congestion window value. The present invention can be applied to the case of setting an initial congestion window value for a network connection. The method can be performed by an initial congestion window value determining device according to the present invention. The initial congestion window value determining device can be implemented by hardware or software and integrated in the electronic device provided by the present invention. Specifically, Figure 1 As shown, the method for determining the initial congestion window value in the embodiment of the present invention may include the following steps:

[0034] S101. Acquire connection information of a newly created network connection, where the connection information includes an application scenario type of the newly created network connection.

[0035] The embodiment of the present invention can determine that a new network connection has been created when a network connection request is received. In one example, when a client requests data from a server, it can be considered that a new network connection has been created. When a new network connection is detected, the connection information of the new network connection can be obtained. The connection information may include an IP address, a geographical location, a network type, an application scenario type, and an initial delay in the connection phase, etc., wherein the geographical location may be the geographical location of the country or region where the user of the new network connection is located, the network type may be the type of network used by the new network connection, the network type may be a wired network connection or a wireless network connection, and the wireless network connection may also be divided into 2G, 3G, 4G, 5G, WiFi and other wireless network connections, the application scenario type may be the network transmission consumption type of the new network connection, and the network transmission consumption type may include instant consumption transmission and non-instant consumption transmission, and instant consumption transmission refers to network transmission that consumes the transmitted data while transmitting data, such as voice calls, live video, short video and other streaming media transmission types, and non-instant consumption transmission may refer to network transmission that consumes the transmitted data after the transmission is completed, such as transmission that consumes the transmitted data after the transmission is completed, such as emails, picture downloads, etc. Of course, in addition to the above connection information, those skilled in the art may also obtain other information about the new network connection.

[0036] S102: Determine, according to the connection information, a network connection group to which the newly created network connection belongs, where the network connection group includes network connections of the same application scenario type.

[0037] In an optional embodiment of the present invention, the connection information can be encoded to obtain a group number, and network connections with the same group number can be determined as the same network connection group. The application scenario types of multiple network connections in the network connection group are the same, that is, the application scenario types of the network connections in a network connection group are all instant consumption transmission types, or all are non-instant consumption transmission types.

[0038] In one example, the connection information may include an IP address, a geographic location, a network type, an application scenario type, and an initial delay during the connection phase. The first N bits of the IP address, the geographic location, the network type, the application scenario type, and the initial delay may be encoded respectively. It can be seen that if the first N bits of the IP addresses of two network connections are the same, they belong to the same geographic location (such as a region in the same country), the network types are the same (such as both are 5G networks), the application scenario types are the same (such as both are instant consumption transmission types), and the initial delays are close (the initial delays are both between 10-20ms), then the connection information of the two network connections has the same encoded group number, and the two network connections belong to the same network connection group, that is, after calculating the group number based on the connection information of the newly created network connection, the network connection group to which the newly created network connection belongs can be determined by the group number.

[0039] S103: Searching for an optimal initial congestion window value of the network connection packet in a preset initial congestion window value table.

[0040] In an embodiment of the present invention, an initial congestion window value table can be set in advance, and the initial congestion window value table includes the group number of each network connection group and the initial congestion window value associated with the group number. The initial congestion window value is the current optimal initial congestion window value of the network connection group, wherein the optimal initial congestion window value can be updated according to the change of the network status. After determining the network connection group to which the newly created network connection belongs, the optimal initial congestion window value of the network connection group can be found from the preset initial congestion window value table.

[0041] S104: Set the initial congestion window value of the newly created network connection to the optimal initial congestion window value.

[0042] Specifically, after finding the optimal initial congestion window value of the network connection group, the initial congestion window value of the newly created network connection is set to the optimal initial congestion window value.

[0043] S105: Calculate the revenue of the newly created network connection after the newly created network connection completes data transmission.

[0044] After setting the initial congestion window value for a new network connection, data is transmitted. After the data transmission is completed, the network performance indicators of the new network connection during the data transmission process can be obtained. The benefit of the new network connection is calculated based on the network performance indicators. The benefit of the network connection reflects the transmission effect when the network connection transmits data with the optimal initial congestion window value as the initial congestion window value. The higher the benefit, the better the transmission effect and the more reasonable the initial congestion window value.

[0045] S106: Update the optimal initial congestion window value of the network connection group in the preset initial congestion window value table according to the revenue of the newly created network connection.

[0046] In an optional embodiment of the present invention, a network connection group can be set with multiple candidate initial congestion window values. Whenever one of the candidate initial congestion window values ​​is determined as the optimal initial congestion window value, when the initial congestion window value of the newly created network connection is set to the optimal initial congestion window value to transmit data and calculate the profit, the average profit of the network connection group can be updated according to the profit of the newly created network connection, that is, the average profit of the network connection group under each candidate initial congestion window value is obtained, and the candidate initial congestion window value with the highest expected value is calculated through the multi-armed bandit problem optimization algorithm. The candidate initial congestion window value with the highest expected value is the optimal initial congestion window value of the network connection group, so as to update the optimal initial congestion window value of the network connection group in the preset initial congestion window value table.

[0047] An embodiment of the present invention determines a network connection group to which a newly created network connection belongs based on connection information of the newly created network connection, where the network connection group includes network connections of the same application scenario type; searches for an optimal initial congestion window value of the network connection group in a preset initial congestion window value table, sets the initial congestion window value of the newly created network connection as the optimal initial congestion window value, calculates a profit of the newly created network connection after the newly created network connection completes data transmission, and updates the optimal initial congestion window value of the network connection group in the preset initial congestion window value table based on the profit of the newly created network connection. On the one hand, the network connections in the same network connection group have the same application scenario type. The optimal initial congestion window value of the network connection group is obtained by looking up the preset initial congestion window value table as the initial congestion window value of the newly created network connection, thereby setting the initial congestion window value according to the application scenario type of the newly created network connection. On the other hand, the optimal initial congestion window value of the network connection group is updated according to the revenue of the newly created network connection, and the optimal initial congestion window value of the network connection group can be adjusted according to the network status, that is, setting the initial congestion window value according to the application scenario type and network status of the network connection, so that the initial congestion window value of the network connection can be set according to different application scenario types and network status, thereby improving the quality of content distribution.

[0048] Embodiment 2

[0049] Figure 2 The flowchart of a method for determining an initial congestion window value provided in the second embodiment of the present invention is optimized on the basis of the first embodiment. Specifically, Figure 2 As shown, the method for determining the initial congestion window value in the embodiment of the present invention may include the following steps:

[0050] S201. Obtain an IP address, geographic location, network type, application scenario type, and initial delay of a newly created network connection.

[0051] Specifically, when a connection request for a new network connection is detected, the IP address, geographic location, network type, application scenario type, and initial delay of the new network connection are obtained, wherein the geographic location may be the geographic location of the country or region where the user of the new network connection is located, the network type may be the type of network used by the network connection, the network type may be a wired network connection or a wireless network connection, and the wireless network connection may also be divided into 2G, 3G, 4G, 5G, WiFi and other wireless network connections, the application scenario type may be the network transmission consumption type of the new network connection, and the network transmission consumption type may include instant consumption transmission and non-instant consumption transmission, and instant consumption transmission refers to network transmission that consumes the transmitted data while transmitting data, such as voice calls, live video, short video and other streaming media transmission types, and non-instant consumption transmission may refer to network transmission that consumes the transmitted data after the transmission is completed, such as transmission that consumes the transmitted data after the transmission is completed, such as emails, picture downloads, etc. Of course, in addition to the above-mentioned connection information, those skilled in the art may also obtain other information about the new network connection.

[0052] In the embodiment of the present invention, the application scenario type of the newly created network connection may be an instant consumption transmission type, that is, the newly created network connection is used to transmit streaming media data such as voice and video.

[0053] S202: Determine the first N digits of the IP address and the delay range to which the initial delay belongs.

[0054] In one example of the present invention, the first 16 bits of the IP address can be determined, and the delay range can be pre-set for the delay. After obtaining the initial delay of the newly created network connection in the connection phase, the delay range to which the initial delay belongs can be determined.

[0055] S203: Calculate the group number of the newly created network connection according to the first N digits of the IP address, the geographical location, the network type, the application scenario type, and the delay range.

[0056] In an optional embodiment of the present invention, the first N digits of the IP address, the geographical location, the network type, the application scenario type and the delay range may be encoded according to preset rules to obtain a group number.

[0057] In an example, the group number composition is shown in the following table:

[0058]

[0059] As can be seen from the above table, the group number is calculated by the first N digits of the IP address, geographical location, network type, application scenario type, and delay range. When the first N digits of the IP addresses of two network connections are the same, the geographical location is the same, the network type is the same, the application scenario type is the same, and the initial delay belongs to the same delay range, it means that the network conditions of the two network connections are similar. In theory, the same initial congestion window value can be set for the two network connections.

[0060] Of course, in actual applications, technicians in this field can also group newly created network connections based on other information to ensure that the application scenario types within the network connection groups are the same and the network conditions are similar. The present invention does not limit the way network connections are grouped.

[0061] S204: Determine the network connection group corresponding to the group number as the network connection group to which the newly created network connection belongs.

[0062] In actual applications, each network connection group is provided with a group number. After the group number of the newly created network connection is determined, the network connection group corresponding to the group number can be determined as the network connection group to which the newly created network connection belongs.

[0063] S205: Searching for an initial congestion window value that matches the packet number in a preset initial congestion window value table to serve as an optimal initial congestion window value for the network connection packet.

[0064] The preset initial congestion window value table can be expressed in key-value form. Specifically in the embodiment of the present invention, the key can be the group number of the network connection, and the value can be the optimal initial congestion window value of the network connection group. For any network connection group, the group number of the network connection group can be used as the key to find the corresponding value, and the value of the value is the optimal initial congestion window value of the network connection group.

[0065] S206: Set the initial congestion window value of the newly created network connection to the optimal initial congestion window value.

[0066] Specifically, after finding the optimal initial congestion window value of the network connection group, the initial congestion window value of the newly created network connection is set to the optimal initial congestion window value.

[0067] S207. After the new network connection completes data transmission, obtain the header transmission time and the maximum fragment transmission time of the header in the data transmitted by the new network connection, wherein the maximum fragment transmission time is the maximum time among the transmission times of multiple fragments of the header.

[0068] In an embodiment of the present invention, the application scenario type of the newly created network connection is an instant consumption transmission type, that is, the newly created network connection is used to transmit streaming media data such as video and voice that is consumed while being transmitted. For video and voice that need to be transmitted and played at the same time, attention needs to be paid to the initial transmission time and the stability of the download process. Since the initial congestion window value has an obvious effect on the initial stage of the transmission process, attention can be paid to the header transmission status of the data transmitted by the newly created network connection. In an example, header data of a specified size in the data transmitted by the newly created network connection can be obtained, and the header data can be divided into multiple fixed-size fragments, and the transmission time of the header data and the transmission time of each fragment can be counted, and the maximum fragment transmission time can be determined from the transmission time of each fragment, such as the header data size is 160KB, and the header data is divided into multiple fragments according to a fixed size of 8K.

[0069] S208. Calculate the revenue of the newly created network connection using the header transmission time and the maximum fragment transmission time.

[0070] In an optional embodiment of the present invention, the network connection group includes multiple historical network connections before the new network connection is established. The header transmission time and the fragment transmission time of the multiple historical network connections can be counted. The header transmission time threshold and the fragment transmission time threshold are determined according to the header transmission time and the fragment transmission time of the multiple historical network connections. The ratio of the fragment transmission time threshold to the maximum fragment transmission time is calculated to obtain a first ratio. The ratio of the pre-header transmission time threshold to the header transmission time is calculated to obtain a second ratio. The weighted sum of the first ratio and the second ratio is calculated using a preset benefit balance factor as the benefit of the new network connection, specifically as follows:

[0071]

[0072] Among them, Reward is the income of the newly created network connection, ChunkTime threshold It is the fragment transmission time threshold calculated based on the fragment transmission time of multiple historical network connections, such as 20ms; HeaderTime thresholdIt is the header transmission time threshold calculated based on the header transmission time of multiple historical network connections, such as 80ms; ChunkTime max and HeaderTime are the maximum fragment transmission time and header transmission time of a new network connection, respectively, and α is the benefit balance factor.

[0073] In one example, for the slice transmission time threshold and the header transmission time threshold, the average values ​​of the slice transmission time and the header transmission time of multiple historical network connections can be first counted, and the threshold value can be obtained by taking a certain proportion of the average values, such as 20% of the average value of the slice transmission time as the slice transmission time threshold, and 20% of the average value of the header transmission time as the header transmission time threshold. Of course, in actual applications, it is not limited to statistical average values, but it is also possible to generate the slice transmission time and header transmission time distribution, and determine the threshold value through the distribution. The embodiment of the present invention does not limit how to set the slice transmission time threshold and the header transmission time threshold.

[0074] S209: Using the revenue of the newly created network connection and a preset attenuation factor to update the average revenue of the network connection group to obtain an updated average revenue.

[0075] In an embodiment of the present invention, each network connection group is associated with an average revenue, which is a weighted average revenue. When a newly created network connection is determined to be a network connection of a certain network connection group, the revenue of the newly created network connection is calculated, and the average revenue of the network connection group is updated in a weighted average manner using the revenue of the newly created network connection.

[0076] Specifically in an embodiment of the present invention, the average revenue before the network connection group is updated can be obtained, where the average revenue before the update is the average revenue when the network connection group does not include a newly created network connection. The product of a preset attenuation factor and the average revenue before the update is calculated to obtain a first product, the difference between 1 and the attenuation factor is calculated, the product of the revenue of the newly created network connection and the difference is calculated to obtain a second product, and the sum of the first product and the second product is calculated as the average revenue after update.

[0077] In an example, the network connection group contains 10 network connections. At this time, the average revenue before the network connection group is updated is Q 1-10 , when the network connection group adds a new network connection R 11 After that, calculate the new network connection R 11 The profit is Q 11 , then the average benefit after the network connection is updated is:

[0078] Q=A×Q 1-10 +(1-A)×Q 11

[0079] In the above formula, A is the attenuation coefficient, and 0<A<1.

[0080] S210: Update the optimal initial congestion window value of the network connection group in the preset initial congestion window value table according to the updated average revenue.

[0081] In an embodiment of the present invention, each network connection group is provided with a plurality of candidate initial congestion window values, and the optimal initial congestion window value is one of the plurality of candidate initial congestion window values. For each candidate initial congestion window value of the network connection group, when the optimal initial congestion window value of the network connection group is any one of the candidate initial congestion window values, the expected value of the candidate initial congestion window value is calculated according to the average revenue of the network connection group, and the optimal initial congestion window value of the network connection group in the preset initial congestion window value table is set to the candidate initial congestion window value with the largest expected value, wherein the maximum expected value can be calculated by the multi-armed bandit problem optimization algorithm:

[0082]

[0083] In the above formula, IW t is the maximum value of the expected value of each candidate initial congestion window value after t trials, Window t is the candidate set of candidate initial congestion window values, Q t (w) is the average benefit when the optimal initial congestion window value is the candidate initial congestion window value w, c is a hyperparameter (settable), N t (w) is the number of times the candidate initial congestion window value w is tried in t trials, is the expected value of the candidate initial congestion window value w after t trials.

[0084] According to an embodiment of the present invention, for a newly created network connection of an instant consumption transmission type, an IP address, a geographic location, a network type, an application scenario type, and an initial delay of the newly created network connection are obtained, and a group number is calculated according to the IP address, the geographic location, the network type, the application scenario type, and the initial delay, and a network connection group corresponding to the group number is determined as the network connection group to which the newly created network connection belongs, and an initial congestion window value matching the group number is searched in a preset initial congestion window value table as an optimal initial congestion window value of the network connection group; after the newly created network connection completes data transmission, a header transmission time and a maximum fragment transmission time of a header in data transmitted by the newly created network connection are obtained to calculate a revenue of the newly created network connection, and the revenue of the newly created network connection and a preset attenuation factor are used to update an average revenue of the network connection group to obtain an updated average revenue, and the optimal initial congestion window value of the network connection group in the preset initial congestion window value table is updated according to the updated average revenue. On the one hand, the network connections in the same network connection group are network connections of the instant consumption transmission type. By looking up the preset initial congestion window value table, the optimal initial congestion window value of the network connection group is obtained as the initial congestion window value of the newly created network connection, thereby setting the initial congestion window value of the newly created network connection for the instant consumption transmission type. On the other hand, the profit is calculated according to the header transmission time and the maximum fragment transmission time of the newly created network connection, and the profit of the network connection group is updated according to the profit. Finally, the optimal initial congestion window value of the network connection group is updated according to the average profit of the network connection group, thereby adjusting the optimal initial congestion window value of the network connection group according to the characteristics of the instant consumption transmission type, reducing the start delay of the streaming media, and improving the transmission efficiency of the instant consumption transmission type network connection. It can effectively improve the playback clarity of streaming media such as video and voice, thereby improving user experience satisfaction.

[0085] Embodiment 3

[0086] Figure 3 The flowchart of a method for determining an initial congestion window value provided in the third embodiment of the present invention is optimized on the basis of the first embodiment. Specifically, Figure 3 As shown, the method for determining the initial congestion window value in the embodiment of the present invention may include the following steps:

[0087] S301. Obtain an IP address, geographic location, network type, application scenario type, and initial delay of a newly created network connection.

[0088] S302, determining the first N digits of the IP address and the delay range to which the initial delay belongs;

[0089] S303, calculating the group number of the newly created network connection according to the first N digits of the IP address, the geographical location, the network type, the application scenario type, and the delay range;

[0090] S304: Determine the network connection group corresponding to the group number as the network connection group to which the newly created network connection belongs.

[0091] S305: Searching for an initial congestion window value that matches the packet number in a preset initial congestion window value table to serve as an optimal initial congestion window value for the network connection packet.

[0092] S306: Set the initial congestion window value of the newly created network connection to the optimal initial congestion window value.

[0093] S301 - S306 may refer to S201 - S206 in the second embodiment, and will not be described in detail here to avoid repetition.

[0094] S307: After the new network connection completes data transmission, obtain the throughput and latency of the new network connection.

[0095] In the embodiment of the present invention, the application scenario type of the newly created network connection is a non-instant consumption transmission type, that is, the data transmitted by the newly created network connection is consumed after the transmission is completed, such as opening an email after the transmission is completed, and browsing a picture after the transmission is completed. For the non-instant consumption transmission type, the user is more concerned about the transmission speed, so the throughput and latency of the newly created network connection can be obtained.

[0096] S308: Calculate the revenue of the newly created network connection using the throughput and the delay.

[0097] In an optional embodiment of the present invention, the network connection group includes multiple historical network connections before the new network connection is established. The throughput and delay of the multiple historical network connections can be counted. The throughput threshold and the delay threshold are determined according to the throughput and delay of the multiple historical network connections. The ratio of the throughput to the throughput threshold is calculated to obtain a third ratio. The ratio of the delay threshold to the delay is calculated to obtain a fourth ratio. The weighted sum of the third ratio and the fourth ratio calculated using a preset benefit balance factor is used as the benefit of the new network connection. Specifically, the formula is as follows:

[0098]

[0099] Among them, Reward is the income of the newly built network connection, Goodput threshold It is a throughput threshold calculated based on the throughput statistics of multiple historical network connections, such as 20Mbps, RTT thresholdThe latency threshold is calculated based on the latency statistics of multiple historical network connections, such as 10ms. Goodput and RTT are the throughput and latency of a new network connection, and α is the benefit balance factor.

[0100] In one example, for the throughput threshold and the delay threshold, the average values ​​of the throughput and the average values ​​of the delay of multiple historical network connections can be first counted, and the threshold can be obtained by taking a certain proportion of the average values, such as 20% of the average value of the throughput as the throughput threshold, and 20% of the average value of the delay as the delay threshold. Of course, in practical applications, it is not limited to statistical average values, and the distribution of throughput and delay can also be generated, and the threshold is determined by the distribution. The embodiment of the present invention does not limit the method of setting the throughput threshold and the delay threshold.

[0101] S309: Using the revenue of the newly created network connection and the preset attenuation factor, the average revenue of the network connection group is updated to obtain an updated average revenue.

[0102] S310: Update the optimal initial congestion window value of the network connection group in the preset initial congestion window value table according to the updated average revenue.

[0103] S309 - S310 may refer to S209 - S210 in Embodiment 2, and will not be described in detail here to avoid repetition.

[0104] According to an embodiment of the present invention, for a newly created network connection of a non-instant consumption transmission type, an IP address, a geographic location, a network type, an application scenario type, and an initial delay of the newly created network connection are obtained, and a group number is calculated according to the IP address, the geographic location, the network type, the application scenario type, and the initial delay, and a network connection group corresponding to the group number is determined as a network connection group to which the newly created network connection belongs, and an initial congestion window value matching the group number is searched in a preset initial congestion window value table as an optimal initial congestion window value of the network connection group; after the newly created network connection completes data transmission, the throughput and delay of the newly created network connection transmission are obtained to calculate the revenue of the newly created network connection, and the revenue of the newly created network connection and a preset attenuation factor are used to update the average revenue of the network connection group to obtain an updated average revenue, and the optimal initial congestion window value of the network connection group in the preset initial congestion window value table is updated according to the updated average revenue. On the one hand, the network connections in the same network connection group are network connections of non-immediate consumption transmission type. By looking up the preset initial congestion window value table, the optimal initial congestion window value of the network connection group is obtained as the initial congestion window value of the newly created network connection, thereby setting the initial congestion window of the network connection for the non-immediate consumption transmission type. On the other hand, the profit is calculated according to the throughput and delay of the newly created network connection, and the profit of the network connection group is updated according to the profit. Finally, the optimal initial congestion window value of the network connection group is updated according to the profit of the network connection group, thereby adjusting the optimal initial congestion window value of the network connection group according to the characteristics of the non-immediate consumption transmission type, improving the transmission speed of the network connection of the non-immediate consumption transmission type, shortening the time required for users to wait for the transmission to complete, and thus improving user experience satisfaction.

[0105] Embodiment 4

[0106] Figure 4 is a structural block diagram of a device for determining an initial congestion window value provided by Embodiment 4 of the present invention, such as Figure 4 As shown, the initial congestion window value determination device of the embodiment of the present invention may specifically include the following modules:

[0107] A connection information acquisition module 401 is used to acquire connection information of a newly created network connection, wherein the connection information includes an application scenario type of the newly created network connection;

[0108] A network connection group determination module 402, configured to determine, according to the connection information, a network connection group to which the newly created network connection belongs, wherein the network connection group includes network connections of the same application scenario type;

[0109] An optimal initial congestion window value search module 403, used to search a preset initial congestion window value table to obtain an optimal initial congestion window value of the network connection packet;

[0110] An initial congestion window value setting module 404, configured to set the initial congestion window value of the newly created network connection to the optimal initial congestion window value;

[0111] The profit calculation module 405 is used to calculate the profit of the newly created network connection after the data transmission of the newly created network connection is completed;

[0112] The preset initial congestion window value table updating module 406 is used to update the optimal initial congestion window value of the network connection group in the preset initial congestion window value table according to the revenue of the newly created network connection.

[0113] The initial congestion window value determination device provided in the embodiment of the present invention can execute the initial congestion window value determination method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0114] Embodiment 5

[0115] Reference Figure 5 , shows a schematic diagram of the structure of an electronic device in an example of the present invention. Figure 5 As shown, the electronic device may specifically include: a processor 501, a storage device 502, a display screen 503 with a touch function, an input device 504, an output device 505, and a communication device 506. The number of processors 501 in the electronic device may be one or more. Figure 5 A processor 501 is taken as an example. The processor 501, storage device 502, display screen 503, input device 504, output device 505 and communication device 506 of the electronic device can be connected through a bus or other means. Figure 5 The electronic device is used to execute the method for determining the initial congestion window value provided by any embodiment of the present invention.

[0116] An embodiment of the present invention further provides a computer-readable storage medium. When instructions in the storage medium are executed by a processor of an electronic device, the device can execute the method for determining an initial congestion window value as described in the above method embodiment.

[0117] It should be noted that, for the device, electronic device, and storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0118] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0119] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method for determining an initial congestion window value, characterized in that: include: Acquire connection information of the newly created network connection, wherein the connection information includes an application scenario type of the newly created network connection; Determine, according to the connection information, a network connection group to which the newly created network connection belongs, wherein the network connection group includes network connections of the same application scenario type; Searching for the optimal initial congestion window value of the network connection group in a preset initial congestion window value table; wherein each network connection group is provided with a plurality of candidate initial congestion window values, and the optimal initial congestion window value is one of the plurality of candidate initial congestion window values; setting the initial congestion window value of the newly created network connection to the optimal initial congestion window value; Calculating the revenue of the newly created network connection after the newly created network connection finishes transmitting data; Using the revenue of the newly created network connection and a preset attenuation factor to update the average revenue of the network connection group to obtain an updated average revenue; updating the optimal initial congestion window value of the network connection group in the preset initial congestion window value table according to the updated average revenue; The updating of the optimal initial congestion window value of the network connection group in the preset initial congestion window value table according to the updated average revenue comprises: For each candidate initial congestion window value of the network connection group, when the optimal initial congestion window value of the network connection group is the candidate initial congestion window value, calculating an expected value of the candidate initial congestion window value according to an average revenue of the network connection group; Setting the optimal initial congestion window value of the network connection packet in the preset initial congestion window value table to the candidate initial congestion window value with the maximum expected value; Among them, the maximum expected value is calculated by the multi-armed bandit problem optimization algorithm: In the above formula, IW t is the maximum value of the expected value of each candidate initial congestion window value after t trials, Window t is the candidate set of candidate initial congestion window values, Q t (w) is the average benefit of network connection packets when the optimal initial congestion window value is the candidate initial congestion window value w, c is a configurable hyperparameter, N t (w) is the number of times the candidate initial congestion window value w is tried in t trials, is the expected value of the candidate initial congestion window value w after t trials; The calculating of the revenue of the newly created network connection after the newly created network connection finishes transmitting data includes: After the data transmission is completed, a network performance indicator of the newly established network connection during the data transmission process is obtained, and the benefit of the newly established network connection is calculated according to the network performance indicator.

2. The method according to claim 1, characterized in that The obtaining of connection information of the newly created network connection includes: Get the IP address, geographic location, network type, application scenario type, and initial latency of the newly created network connection.

3. The method according to claim 2, characterized in that The determining, according to the connection information, the network connection group to which the newly established network connection belongs includes: Determine the first N digits of the IP address and the delay range to which the initial delay belongs; Calculate the group number of the newly created network connection according to the first N digits of the IP address, the geographical location, the network type, the application scenario type, and the latency range; The network connection group corresponding to the group number is determined as the network connection group to which the newly created network connection belongs.

4. The method according to any one of claims 1 to 3, characterized in that: The network connection group is provided with a group number, and searching for the optimal initial congestion window value of the network connection group in a preset initial congestion window value table includes: An initial congestion window value matching the packet number is searched in a preset initial congestion window value table to serve as an optimal initial congestion window value for the network connection packet.

5. The method according to any one of claims 1 to 3, characterized in that: The application scenario type of the newly created network connection is an instant consumption transmission type, and the calculation of the revenue of the newly created network connection after the data transmission of the newly created network connection is completed includes: After the new network connection completes data transmission, obtaining a header transmission time and a maximum fragment transmission time of header data in the data transmitted by the new network connection, wherein the maximum fragment transmission time is the maximum time among the transmission times of multiple fragments of the header data; The header transmission time and the maximum fragment transmission time are used to calculate the revenue of the newly created network connection.

6. The method according to claim 5, characterized in that The calculating the benefit of the newly created network connection by using the header transmission time and the maximum fragment transmission time includes: Calculating a ratio of a preset fragment transmission time threshold to the maximum fragment transmission time to obtain a first ratio; Calculating a ratio of a preset header transmission time threshold to the header transmission time to obtain a second ratio; A preset benefit balance factor is used to calculate a weighted sum of the first ratio and the second ratio as the benefit of the newly created network connection.

7. The method according to any one of claims 1 to 3, characterized in that: The application scenario type of the newly created network connection is a non-immediate consumption transmission type, and the calculation of the revenue of the newly created network connection after the data transmission of the newly created network connection is completed includes: After the new network connection completes data transmission, obtaining the throughput and latency of the new network connection; The throughput and the delay are used to calculate the revenue of the newly created network connection.

8. The method according to claim 7, characterized in that The calculating the benefit of the newly established network connection by using the throughput and the delay includes: Calculating a ratio of the throughput to a preset throughput threshold to obtain a third ratio; Calculating a ratio of a preset delay threshold to the delay to obtain a fourth ratio; A preset benefit balance factor is used to calculate a weighted sum of the third ratio and the fourth ratio as the benefit of the newly created network connection.

9. The method according to claim 1, characterized in that: The step of updating the average revenue of the network connection group by using the revenue of the newly created network connection and the preset attenuation factor to obtain an updated average revenue includes: Obtaining an average revenue before the network connection group is updated, where the average revenue before the update is an average revenue when the network connection group does not include the newly-connected network; Calculating the product of the preset attenuation factor and the average income before updating to obtain a first product; Calculate the difference between 1 and the attenuation factor; Calculate the product of the revenue of the newly created network connection and the difference to obtain a second product; The first product and the second product are summed to obtain a sum value as the updated average benefit.

10. A device for determining an initial congestion window value, characterized in that: include: A connection information acquisition module, used to acquire connection information of a newly created network connection, wherein the connection information includes an application scenario type of the newly created network connection; A network connection group determination module, configured to determine, according to the connection information, a network connection group to which the newly created network connection belongs, wherein the network connection group includes network connections of the same application scenario type; an optimal initial congestion window value search module, used to search for the optimal initial congestion window value of the network connection group in a preset initial congestion window value table; wherein each network connection group is provided with a plurality of candidate initial congestion window values, and the optimal initial congestion window value is one of the plurality of candidate initial congestion window values; an initial congestion window value setting module, used to set the initial congestion window value of the newly created network connection to the optimal initial congestion window value; A profit calculation module, used for calculating the profit of the newly created network connection after the data transmission of the newly created network connection is completed; The preset initial congestion window value table update module is used to: Using the revenue of the newly created network connection and a preset attenuation factor to update the average revenue of the network connection group to obtain an updated average revenue; updating the optimal initial congestion window value of the network connection group in the preset initial congestion window value table according to the updated average revenue; The updating of the optimal initial congestion window value of the network connection group in the preset initial congestion window value table according to the updated average revenue comprises: For each candidate initial congestion window value of the network connection group, when the optimal initial congestion window value of the network connection group is the candidate initial congestion window value, calculating an expected value of the candidate initial congestion window value according to an average revenue of the network connection group; Setting the optimal initial congestion window value of the network connection packet in the preset initial congestion window value table to the candidate initial congestion window value with the maximum expected value; Among them, the maximum expected value is calculated by the multi-armed bandit problem optimization algorithm: In the above formula, IW t is the maximum value of the expected value of each candidate initial congestion window value after t trials, Window t is the candidate set of candidate initial congestion window values, Q t (w) is the average benefit of network connection packets when the optimal initial congestion window value is the candidate initial congestion window value w, c is a configurable hyperparameter, N t (w) is the number of times the candidate initial congestion window value w is tried in t trials, is the expected value of the candidate initial congestion window value w after t trials; The revenue calculation module is specifically used for: After the data transmission is completed, a network performance indicator of the newly established network connection during the data transmission process is obtained, and the benefit of the newly established network connection is calculated according to the network performance indicator.

11. An electronic device, characterized in that: The electronic device comprises: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method for determining an initial congestion window value according to any one of claims 1 to 9.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method for determining an initial congestion window value according to any one of claims 1 to 9 is implemented.