Conference bandwidth estimation method, device, equipment and medium

By reducing the code rate and detecting packet loss in the video conferencing system without increasing packet delay, distinguishing network congestion and random packet loss, the audio and video lag caused by bandwidth estimation module in the prior art is solved and the network is networked due to the bandwidth estimation module in the prior art. Congestion problem improves the accuracy of bandwidth estimation.

CN118900313APending Publication Date: 2024-11-05HAOXINYUN (BEIJING) NETWORK COMM CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410756664.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-06-13
Publication Date
2024-11-05

AI Technical Summary

Technical Problem

In existing video conferencing systems, the bandwidth estimation module directly reduces or maintains the bandwidth when packet loss is detected, resulting in audio and video lag or network congestion, making it difficult to distinguish between network congestion and random packet loss, affecting the accuracy of bandwidth estimation.

Method used

When the packet delay does not increase, when packet loss is detected, a lower first code rate is used to send the packet, and the bandwidth estimate is performed based on the packet loss situation of the packet sent by the first code rate, and the routing type is distinguished to improve the packet. Accuracy of bandwidth estimation to alleviate audio and video lag or network congestion.

Benefits of technology

Bandwidth estimation by reducing the packet loss situation after the bit rate is improved, the accuracy of bandwidth estimation can be more accurately judged, and the occurrence of audio and video lag and network congestion can be reduced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118900313A_ABST
    Figure CN118900313A_ABST
Patent Text Reader

Abstract

Provided in an embodiment of the present application are a conference bandwidth estimation method, apparatus, device and medium, the method being applied to a transmitting end device, the method comprising: when it is determined that a data packet delay is not increased, when packet loss is detected, using a first code rate to transmit a data packet, the first code rate is smaller than a second code rate adopted for sending a data packet before packet loss; determining a packet loss condition of sending the data packet by using the first code rate; and estimating the bandwidth according to the packet loss condition of the data packet sent by using the first code rate. Through the technical scheme of the embodiment of the invention, the problem of lagging or network congestion caused by existing bandwidth estimation can be relieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of video conferencing, and in particular, to a method, apparatus, device and medium for estimating conference bandwidth. Background Art

[0002] In the real-time communication (RTC) system, the bandwidth estimation module at the transmitter plays a role in evaluating the network bandwidth and setting a reasonable bit rate for the audio and video encoding module. It is the core module of network transmission in the entire RTC system. The industry has proposed many related technical optimization solutions for the bandwidth estimation module in terms of improving the accuracy of bandwidth estimation, avoiding network congestion, and shortening the tracking convergence time of bandwidth estimation. Among them, the most commonly used is the GCC (Google Congestion Control) algorithm.

[0003] Usually, the GCC algorithm detects network congestion by detecting the delay change of the data packets received by the receiving end, and then notifies the sending end to reduce the sending bit rate. However, when this method is used to estimate bandwidth, there may be problems such as audio and video freezes or network congestion.

[0004] Therefore, how to provide a method for estimating conference bandwidth to alleviate lag or network congestion becomes a problem that needs to be solved. Summary of the invention

[0005] An embodiment of the present application aims to provide a method, apparatus, device and medium for conference bandwidth estimation. The technical solution of the embodiment of the present application can alleviate the problem of freezing or network congestion caused by existing bandwidth estimation.

[0006] In a first aspect, an embodiment of the present application provides a method for estimating conference bandwidth, which is applied to a transmitting device, and the method includes: when it is determined that the data packet delay has not increased and packet loss is detected, sending the data packet using a first code rate, wherein the first code rate is less than a second code rate used to send the data packet before the packet loss; determining the packet loss situation of sending the data packet using the first code rate; and estimating the bandwidth based on the packet loss situation of sending the data packet using the first code rate.

[0007] In the embodiment of the present application, when it is determined that the data packet delay has not increased and packet loss is detected, the data packet is further sent using a lower first bit rate, and the bandwidth is estimated based on the packet loss situation of sending the data packet using the first bit rate. Compared with the prior art that directly reduces the estimated bandwidth or maintains the estimated bandwidth when packet loss is detected, the bandwidth estimation is further combined with the packet loss situation after the bit rate is reduced, which can improve the accuracy of bandwidth estimation and alleviate the problem of audio and video freeze or network congestion.

[0008] In one implementation, estimating bandwidth according to packet loss when sending data packets using the first code rate includes: determining a type of route according to packet loss when sending data packets using the first code rate; and estimating bandwidth according to the type of route.

[0009] In one implementation, determining the type of route according to packet loss when sending data packets using the first code rate includes: determining the type of route as a shallow cache type when it is determined that packet loss when sending data packets using the first code rate is reduced.

[0010] In one embodiment, estimating the bandwidth according to the packet loss situation of sending data packets using the first code rate includes: when it is determined that the packet loss situation of sending data packets using the first code rate has not changed, determining that the packet loss is random packet loss and maintaining the estimated bandwidth size.

[0011] In one embodiment, the method further includes: when it is determined that the delay gradient of the data packet increases, determining that the type of routing is network congestion under non-shallow cache routing, and reducing the estimated bandwidth.

[0012] In one embodiment, the method further includes: when it is determined that the delay gradient of the data packet has increased, the sending device uses a third code rate to send the data packet, wherein the third code rate is greater than the second code rate used to send the data packet previously; determining a packet loss situation when sending the data packet using the third code rate; determining a type of route based on the packet loss situation when sending the data packet using the third code rate, and estimating the bandwidth based on the type of route.

[0013] In one embodiment, the method further includes: if it is determined that the bandwidth evaluated using a generic congestion control algorithm (GCC) is reduced and a user quality experience parameter is degraded, reducing the estimated bandwidth size.

[0014] In a second aspect, an embodiment of the present application provides an apparatus for estimating conference bandwidth, which is applied to a transmitting device, and the apparatus includes: a sending unit, which is used to send a data packet using a first code rate when packet loss is detected when it is determined that the data packet delay has not increased, wherein the first code rate is less than the second code rate used to send the data packet before the packet loss; a determination unit, which is used to determine the packet loss situation of sending the data packet using the first code rate; and the determination unit is also used to estimate the bandwidth based on the packet loss situation of sending the data packet using the first code rate.

[0015] In one implementation, the determining unit is specifically configured to determine a type of route according to a packet loss situation when sending data packets using a first code rate; and estimate a bandwidth according to the type of route.

[0016] In one implementation, the determining unit is specifically configured to determine the type of routing as a shallow cache type when it is determined that packet loss of sending data packets using the first code rate is reduced.

[0017] In one implementation, the determining unit is specifically configured to determine that the packet loss is random packet loss and maintain the estimated bandwidth size when it is determined that the packet loss situation of sending the data packet using the first code rate has not changed.

[0018] In one embodiment, the determining unit is further configured to determine that the type of routing is network congestion under non-shallow cache routing and reduce the estimated bandwidth when it is determined that the data packet delay gradient increases.

[0019] In one embodiment, the determination unit is also used to, when it is determined that the delay gradient of the data packet has increased, cause the sending end device to send the data packet using a third code rate, wherein the third code rate is greater than the second code rate used to send the data packet previously; determine the packet loss situation when sending the data packet using the third code rate; determine the type of route based on the packet loss situation when sending the data packet using the third code rate, and estimate the bandwidth based on the type of route.

[0020] In one embodiment, the determining unit is further configured to reduce the estimated bandwidth size when it is determined that the bandwidth evaluated using the general congestion control algorithm is reduced and the user quality experience parameter is degraded.

[0021] In a third aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, can implement the method as described in the first aspect and any implementation scheme of the first aspect.

[0022] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method described in the first aspect and any one of the embodiments of the first aspect can be implemented.

[0023] In a fifth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a computer program, wherein when the computer program is executed by a processor, it can implement the method described in the first aspect and any one of the embodiments of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the technical solution of an embodiment of the present application, the drawings required for use in an embodiment of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0025] Figure 1 A schematic diagram of a real-time conference system provided for one embodiment of the present application;

[0026] Figure 2 A flow chart of a method for estimating conference bandwidth provided by one embodiment of the present application;

[0027] Figure 3 A flow chart of a method for estimating conference bandwidth provided by another embodiment of the present application;

[0028] Figure 4 A schematic diagram of a device for conference bandwidth estimation provided by an embodiment of the present application;

[0029] Figure 5 A schematic diagram of an electronic device is provided for one embodiment of the present application. DETAILED DESCRIPTION

[0030] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0031] Usually, the GCC algorithm detects network congestion by the delay change of the data packets received by the receiving end, and then notifies the sending end to reduce the sending bit rate. However, when this method is used to estimate bandwidth, there will be problems such as audio and video freezes or network congestion.

[0032] Specifically, the applicant found that when the router packet cache buffer is large, the GCC algorithm detects congestion in the network through the delay change of the data packet received by the receiving end, and then notifies the sending end to reduce the sending bit rate to alleviate the congestion. However, in the case of a small router packet cache buffer, if network congestion occurs, buffer overflow and data packet loss often occur in a very short time. It is difficult for the GCC algorithm to detect network congestion based on the delay change of the received data packet. Although the GCC algorithm continues to enhance the accuracy of bandwidth estimation detection based on packet loss, it is difficult to distinguish between shallow buffer network congestion packet loss and random packet loss in the network in this case. When developers conduct secondary development based on the GCC algorithm, if they continue to use the GCC algorithm, then the estimated bandwidth will be reduced for random packet loss in the network, resulting in audio and video blur and jamming problems. If the packet loss judgment threshold of the GCC algorithm is modified, the estimated bandwidth will not be reduced for shallow buffer network congestion packet loss, resulting in network congestion.

[0033] In view of the above problems, the present application provides a method for estimating conference bandwidth, which uses a lower first bit rate to send data packets when packet loss is detected when determining that the data packet delay has not increased, and estimates the bandwidth based on the packet loss of the data packets sent using the first bit rate. Compared with the prior art of directly reducing the estimated bandwidth or maintaining the estimated bandwidth when packet loss is detected, it can improve the judgment of whether the packet loss is caused by network congestion or random packet loss, and further improve the accuracy of bandwidth estimation, so as to alleviate the problem of audio and video freeze or network congestion.

[0034] In the following, for the sake of ease of understanding and explanation, the execution process and actions of the real-time communication method of the present application in a real-time conference system are explained as an example rather than a limitation.

[0035] It should be understood that the division of large cache routes and shallow cache routes in the embodiments of the present application may have a certain division standard. For example, a route that can cache more than 20,000 RTP packets is a large cache route, and a route with a maximum cache number of less than 20 RTP packets is a shallow cache route. There may also be no strict standard. A large cache route may refer to a route with a relatively large cache, and a shallow cache route may refer to a route with a relatively small cache. The specific division can refer to the division method of large cache and shallow cache by those skilled in the art, which will not be repeated here.

[0036] The following is combined with Figure 1 The overall structure of a real-time conference system provided by an embodiment of the present application is exemplarily described.

[0037] like Figure 1As shown, an embodiment of the present application provides a real-time conference system including: an audio and video stream sending device and an audio and video stream receiving device.

[0038] In the real-time example of the present application, the audio and video stream sending device can also be called a sending end or a sending end device, and the audio and video stream receiving device can also be called a receiving end or a receiving end device, but the real-time example of the present application is not limited to this.

[0039] The device sending the audio and video stream can be a client or a media server. The device receiving the audio and video stream can be a media server or a client.

[0040] For example, for a video conferencing architecture that requires a media server to forward media streams, for uplink transmission, the audio and video stream sending device can be a client, and the audio and video stream receiving device can be a media server; for downlink transmission, the audio and video stream sending device can be a media server, and the audio and video stream receiving device can be a client, where the media server can be a selective forwarding unit (SFU) or a multipoint conferencing unit (MCU).

[0041] For another example, in the case of a mesh system architecture, the audio and video stream sending device is a client, and the audio and video stream receiving device is another client.

[0042] It should be understood that the client in the embodiment of the present application can also be called a user end or a user device or a terminal device. In the real-time example of the present application, the terminal device can be installed with a browser, and real-time communication can be performed through the browser, or an APP or a small program can be installed, and real-time communication can be performed through the APP or the small program. The terminal device in the present application can include a smart phone, a tablet computer, (personal digital assistant, PDA personal digital assistant), a computer, a game console, a wearable device, a tablet computer (portable android device, PAD), etc., and the embodiment of the present application is not limited thereto.

[0043] It should be understood that in the embodiments of the present application, the receiving end will periodically feedback information to let the sending end understand the reception conditions such as delay and packet loss. For example, the receiving end will periodically send the Real-Time Transport Protocol (RTP) control protocol RTCP message. For example, the sending end can send SR (Sender Report) messages to the receiving end, and the receiving end can send RR (Receiver Report) and other messages to the sending end to achieve real-time feedback and monitor network status, such as packet loss rate, delay, jitter, etc. The specific scheme of how the sending end and the receiving end interact to determine the network status can refer to the description in the existing standards. The real-time example of this application does not limit this, and this article will not repeat it.

[0044] The following is combined with Figure 2 A method for conference bandwidth estimation provided by an embodiment of the present application is exemplarily described.

[0045] like Figure 2 The method shown is applied to Figure 1 In the video system shown, Figure 2 The methods shown include:

[0046] 210. When it is determined that the data packet delay has not increased and packet loss is detected, the data packet is sent using a first code rate.

[0047] The first code rate is less than the second code rate used to send the data packet before the packet loss.

[0048] That is to say, the embodiment of the present application first determines whether the data packet delay increases, and then further estimates the bandwidth according to whether the delay increases. Among them, when the detected data packet delay is normal, in order to avoid directly reducing the estimated bandwidth as in the prior art, the embodiment of the present application proposes to reduce the bit rate of the sent data packet, so as to determine whether the packet loss is random packet loss or congestion packet loss caused by shallow buffer routing according to the packet loss situation after reducing the bit rate, thereby improving the accuracy of subsequent bandwidth estimation.

[0049] Specifically, if there is a sudden network packet loss during normal transmission without packet loss, it may be due to network congestion packet loss (sudden drop in network bandwidth or competition traffic in the network) or random network packet loss. At this time, the embodiment of the present application can try to appropriately reduce the sending bit rate and observe whether the network packet loss decreases over a period of time. If the network packet loss decreases, it means that the network packet loss is mainly caused by congestion; if the network packet loss does not decrease, it means that the network packet loss is mainly caused by random packet loss. Based on this approach, the two types of packet loss can be basically distinguished. Then, the embodiment of the present application can perform targeted bandwidth estimation to improve the accuracy of bandwidth estimation.

[0050] It should be understood that the use of the first bit rate to send data packets here can last for a period of time, for example, the time required to detect packet loss after reducing the bit rate is the minimum time, and the duration can be adjusted according to actual conditions, for example, it can last for 5s, 10s, 20s, etc. The embodiments of the present application are not limited to this.

[0051] It should be understood that the first code rate in the embodiment of the present application can be determined according to the second code rate. For example, the first code rate is one of several fixed code rates. For example, several code rates can actually be fixed, and the first code rate can be the largest or second largest code rate selected from several fixed code rates that is lower than the second code rate. Or the first code rate can be determined based on the second code rate. For example, the first code rate can be 80%, 70%, 50%, etc. of the second code rate, and the embodiment of the present application is not limited thereto.

[0052] 220, determine the packet loss situation of sending the data packet using the first code rate.

[0053] Specifically, the transmitting end device determines the packet loss situation after reducing the bit rate. The specific determination method can use the method in the existing standard, which is not limited here.

[0054] 230, estimate the bandwidth according to the packet loss situation of sending the data packets using the first code rate.

[0055] Specifically, in order to perform more accurate bandwidth estimation when packet loss occurs, the embodiment of the present application performs different judgments according to different packet loss situations of data packets sent at the first bit rate, and the corresponding bandwidth estimation processing methods are different. Compared with the prior art that directly reduces the estimated bandwidth when packet loss is detected, the accuracy of bandwidth estimation can be improved.

[0056] Specifically, as an embodiment, estimating the bandwidth according to the packet loss situation of sending the data packet using the first bit rate includes:

[0057] Determining a type of routing according to a packet loss condition of sending a data packet using a first bit rate;

[0058] The bandwidth is estimated according to the type of the route.

[0059] That is to say, the embodiment of the present application can determine the type of route according to the packet loss situation after reducing the bit rate, so as to further perform bandwidth estimation based on the route.

[0060] Further, as another embodiment, determining the type of route according to the packet loss situation of sending the data packet using the first code rate includes:

[0061] When it is determined that the packet loss of sending the data packet using the first code rate is reduced, the type of routing is determined to be a shallow cache type.

[0062] In the embodiment of the present application, after determining that the route type is a shallow buffer type, bandwidth estimation for shallow buffer routing is performed, which can improve the accuracy of bandwidth estimation compared with the prior art of directly reducing bandwidth estimation or maintaining bandwidth estimation. Specifically, after determining that the route type is a shallow buffer type, the bandwidth estimation algorithm for shallow buffer routing can refer to the existing algorithm, which will not be described in detail here.

[0063] Alternatively, as another embodiment, estimating the bandwidth according to the packet loss situation of sending the data packet using the first code rate includes:

[0064] When it is determined that the packet loss situation of sending the data packet using the first code rate has not changed, the packet loss is determined to be random packet loss, and the estimated bandwidth size is maintained.

[0065] That is to say, when determining that there is packet loss, the embodiment of the present application is further based on the packet loss situation after reducing the bit rate. When the packet loss situation after reducing the bit rate does not change, that is, there is still packet loss after reducing the bit rate, and the packet loss rate is roughly the same as before, it means that the network packet loss is not caused by insufficient routing buffering, because if the packet loss is caused by insufficient buffering, the packet loss will be alleviated or reduced with a high probability after reducing the bit rate. In this case, it means that packet loss occurs at any time, and the embodiment of the present application maintains the estimated bandwidth size. The routing type in this case may be large buffer routing or latent buffer routing, and the embodiment of the present application is not limited to this.

[0066] The above describes a bandwidth estimation method when the data includes no extension. The following describes another case: a bandwidth estimation method when the data packet delay gradient increases.

[0067] Alternatively, the method may further include:

[0068] When it is determined that the delay gradient of the data packet increases, it is determined that the type of routing is network congestion under non-shallow cache routing, and the estimated bandwidth is reduced.

[0069] Specifically, the increase in data packet delay indicates that the router caches the data packet. Inversely, it can be concluded that the data packet does not exceed the router cache, indicating that the router cache is relatively large. In this case, it can be determined that the type of route is network congestion under non-shallow cache routing. At the same time, in order to alleviate data delay or packet loss problems, the estimated bandwidth needs to be reduced. After further reducing the estimated bandwidth, how the sender adjusts the bit rate and other parameters of the sent data according to the estimated bandwidth can be referred to the description of relevant standards such as Web Real-Time Communications (WebRTC) related standards, which will not be repeated here.

[0070] It should be noted that when it is detected that the data includes an increase in the delay gradient, for the shallow cache route, it may also be because it caches a small number of data packets, causing the data packet delay gradient to increase. Therefore, for the shallow cache route, there may also be a situation where a low increase in the data packet delay is detected. If the data includes an increase in the delay gradient, the route type is directly determined to be a non-shallow cache route, and the bandwidth estimation performed in sequence may not be very accurate. Further, in order to improve the bandwidth estimation accuracy in this case, as another embodiment, the embodiment of the present application can further improve the bit rate of sending data packets. If it is a shallow cache route, packet loss may easily occur in this case. For large cache routes, packet loss generally does not occur quickly, but congested data packets are cached. Then, the embodiment of the present application can more accurately determine the route type through the packet loss after increasing the bit rate, and then the bandwidth estimation can be further more accurately performed.

[0071] Correspondingly, as another embodiment, when it is determined that the delay gradient of the data packet increases, the transmitting end device sends the data packet using a third code rate, wherein the third code rate is greater than the second code rate used for previously sending the data packet;

[0072] Determine packet loss of data packets sent using a third bit rate;

[0073] The type of route is determined according to the packet loss situation of sending data packets using the third code rate, and the bandwidth is estimated according to the type of route.

[0074] That is to say, under this scheme, the embodiments of the present application can use the sending and receiving trends to determine whether the routing type belongs to the shallow buffer routing. Specifically, for a shallow buffer network, when network congestion occurs, if the sending bit rate continues to increase, the data that the receiving end can receive will not continue to increase. The reason is that the cache of the shallow buffer network is prone to overflow, resulting in data packet loss. If it is a non-shallow buffer network, then the data packet is not easily lost, and the receiving end receiving the packet is equal to the sending end sending the packet.

[0075] Therefore, we combine the feedback of the sending bit rate and the receiving bit rate to perform trend analysis. If the sending bit rate and the receiving bit rate increase synchronously, then the network can be considered to be a non-shallow buffer network; conversely, if the sending bit rate increases but the receiving bit rate does not increase accordingly, then the network can be considered to be a shallow buffer network.

[0076] Optionally, as another embodiment, the method in the implementation of the present application may further include:

[0077] When it is determined that the bandwidth is reduced and the user quality experience parameter is degraded by using a generic congestion control algorithm (GCC), the estimated bandwidth size is reduced.

[0078] Specifically, in the actual network, sudden network jitter caused by sudden bandwidth drop or sudden background traffic has a great impact on the bandwidth evaluation of the GCC algorithm. In order to improve the ability of GCC to resist sudden network jitter, the embodiment of the present application introduces a user quality experience parameter evaluation mechanism. For example, the user quality experience parameter can be QoE (Quality of Experience). The embodiment of the present application can use the QoE feedback mechanism of the receiving end to feed back the main data indicators of the QoE of the receiving end to the sending end through the RTCP message. If the GCC algorithm detects network jitter, the condition that the QoE indicator of the receiving end deteriorates must be met at the same time, and the sending end can reduce the GCC evaluation bandwidth.

[0079] Among them, the QoE indicator in the embodiment of the present application may include at least one of the residual packet loss rate of the receiving end video, the receiving end video stuttering rate, the receiving end audio residual packet loss rate, the receiving end audio stuttering rate and the receiving end video resolution. If the QoE indicator deteriorates, it means that the audio / video effect of the receiving end is not good; if the indicator is good, it means that the audio / video effect is good. At this time, even if the GCC bandwidth estimation result is low, the evaluation bandwidth should not be reduced, but the original bandwidth evaluation level should be maintained. Therefore, the embodiment of the present application can reduce the problem of inaccurate GCC bandwidth estimation.

[0080] Combine the following Figure 3 As an example, the method for estimating conference bandwidth in the real-time example of the present application is described.

[0081] like Figure 3 The methods shown include:

[0082] 310, detecting whether the data packet delay gradient increases.

[0083] If the number of cells increases, step 320 is executed; if the number of cells does not increase, step 330 is executed.

[0084] 320, determine that the route is a non-shallow cache route.

[0085] Then execute step 380.

[0086] 330, Network packet loss detected.

[0087] 340, reduce the sending bit rate.

[0088] Specifically, the transmission code rate is reduced and maintained for a certain period of time. Step 340 corresponds to step 210, and the description of step 210 may be referred to here, and will not be repeated here.

[0089] 350, to determine whether the network packet loss is reduced.

[0090] If the network packet loss is reduced, step 360 is executed, and if the network packet loss is not reduced, step 390 is executed.

[0091] 360, packet loss is caused by network congestion.

[0092] 370, determine that the route type is shallow cache route.

[0093] 380, reduce the estimated bandwidth.

[0094] 390, it is determined that the packet loss is random network loss.

[0095] 3100, the estimated bandwidth is not reduced and the sending bit rate is restored.

[0096] That is, when it is determined that the packet loss is random, it is estimated that the bandwidth is not reduced, and the sending bit rate is restored, that is, the bit rate is restored to the bit rate before the random packet loss occurs.

[0097] It should be understood that Figure 3 The examples are merely illustrative, and the embodiments of the present application are not limited thereto. Figure 3 For the description of the relevant steps, please refer to the description above, which will not be repeated here.

[0098] Please refer to Figure 4 , Figure 4 A block diagram of a device for conference bandwidth estimation provided by an embodiment of the present application is shown. Figure 4 The device 400 shown can be a generating end device or a module in a sending end device. It should be understood that the device 400 corresponds to the sending end device in the above method embodiment and can execute each step performed by the sending end device involved in the above method embodiment. The specific functions of the device 400 can be found in the description above. To avoid repetition, the detailed description is appropriately omitted here.

[0099] Figure 4 The device 400 shown includes at least one software function module that can be stored in a memory or fixed in the device in the form of software or firmware. Figure 4The device 400 shown includes: a sending unit 410, which is used to send a data packet using a first code rate when packet loss is detected when it is determined that the data packet delay has not increased, wherein the first code rate is less than a second code rate used to send the data packet before the packet loss; a determining unit 420, which is used to determine the packet loss situation of sending the data packet using the first code rate; the determining unit 420 is also used to estimate the bandwidth based on the packet loss situation of sending the data packet using the first code rate.

[0100] In one implementation, the determining unit is specifically configured to determine a type of route according to a packet loss situation when sending data packets using a first code rate; and estimate a bandwidth according to the type of route.

[0101] In one implementation, the determining unit is specifically configured to determine the type of routing as a shallow cache type when it is determined that packet loss of sending data packets using the first code rate is reduced.

[0102] In one implementation, the determining unit is specifically configured to determine that the packet loss is random packet loss and maintain the estimated bandwidth size when it is determined that the packet loss situation of sending the data packet using the first code rate has not changed.

[0103] In one embodiment, the determining unit is further configured to determine that the type of routing is network congestion under non-shallow cache routing and reduce the estimated bandwidth when it is determined that the data packet delay gradient increases.

[0104] In one embodiment, the determination unit is also used to, when it is determined that the delay gradient of the data packet has increased, cause the sending end device to send the data packet using a third code rate, wherein the third code rate is greater than the second code rate used to send the data packet previously; determine the packet loss situation when sending the data packet using the third code rate; determine the type of route based on the packet loss situation when sending the data packet using the third code rate, and estimate the bandwidth based on the type of route.

[0105] In one embodiment, the determining unit is further configured to reduce the estimated bandwidth size when it is determined that the bandwidth evaluated using the general congestion control algorithm is reduced and the user quality experience parameter is degraded.

[0106] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the device described above can refer to the corresponding process in the aforementioned method, and will not be described in detail here.

[0107] like Figure 5As shown, an embodiment of the present application provides an electronic device 500, which includes: a memory 510, a processor 520, and a computer program stored in the memory 510 and executable on the processor 520, wherein the processor 520 reads the program from the memory 510 through a bus 530 and executes the program to implement the method performed by the transmitting end device in any of the above embodiments. Optionally, Figure 5 The device shown may also include a transceiver, which may be used to send and / or receive data streams. Figure 5 The device shown may also include a collector, which may be used to collect audio / video data. The optional electronic device 500 may also include other input devices or other hardware devices, etc., but the embodiments of the present application are not limited thereto.

[0108] Processor 520 can process digital signals and can include various computing structures, such as complex instruction set computer structure, reduced instruction set computer structure, or a structure that implements a combination of multiple instruction sets. In some examples, processor 520 can be a microprocessor.

[0109] The memory 510 may be used to store instructions executed by the processor 520 or data related to the execution of instructions. These instructions and / or data may include codes for implementing some or all functions of one or more modules described in the embodiments of the present application. The processor 520 of the disclosed embodiment may be used to execute instructions in the memory 510 to implement the method shown above to be executed by the control end or the client. The memory 510 includes a dynamic random access memory, a static random access memory, a flash memory, an optical memory, or other memory known to those skilled in the art.

[0110] An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, can implement the method performed by a transmitting device in any of the above methods provided in the above embodiments.

[0111] An embodiment of the present application further provides a computer program product, which includes a computer program, wherein when the computer program is executed by a processor, it can implement the method performed by the sending end device in any of the above methods provided in the above embodiments.

[0112] It should be noted that the processor in the embodiment of the present invention (eg, Figure 5The processor in the embodiment of the present invention may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above method embodiment may be completed by an integrated logic circuit of hardware in the processor or an instruction in software form. The above processor may be a general processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention may be implemented or executed. The general processor may be a microprocessor or the processor may be any conventional processor, etc. The software module may be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0113] It can be understood that the memory in the embodiment of the present invention (for example, Figure 5The memory in the memory may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. Among them, the nonvolatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct rambus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0114] The application programs involved in the embodiments of the present application include any application installed on the requesting end, including but not limited to browsers, email, instant messaging services, word processing, keyboard virtualization, widgets, encryption, digital rights management, voice recognition, voice replication, positioning (such as functions provided by the global positioning system), music playback, etc.

[0115] It should be understood that the transceiver unit or transceiver in the embodiment of the present invention may also be referred to as a communication unit.

[0116] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instruction is loaded and executed on a computer, the process or function according to the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instruction can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instruction can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a high-density digital video disc (DVD)), or a semiconductor medium (eg, a solid state disk (SSD)).

[0117] The terms "component", "module", "system", etc. used in this specification are used to represent computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program and / or a computer. By way of illustration, both applications running on a computing device and a computing device can be components. One or more components may reside in a process and / or an execution thread, and a component may be located on a computer and / or distributed between two or more computers. In addition, these components may be executed from various computer-readable media having various data structures stored thereon. Components may, for example, communicate through local and / or remote processes according to signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system and / or a network, such as the Internet interacting with other systems through signals).

[0118] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present invention. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present invention, the size of the sequence number of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0119] In addition, the terms "system" and "network" are often used interchangeably in this article. The term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0120] It should be understood that in the embodiment of the present invention, "B corresponding to A" means that B is associated with A, and B can be determined according to A. However, it should also be understood that determining B according to A does not mean determining B only according to A, and B can also be determined according to A and / or other information.

[0121] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0122] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0123] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, or can be electrical, mechanical or other forms of connection.

[0124] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present invention.

[0125] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0126] In short, the above is only a preferred embodiment of the technical solution of the present invention, and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for estimating conference bandwidth, characterized in that: Applied to a transmitting device, the method comprises: In the case where it is determined that the data packet delay has not increased, when packet loss is detected, sending the data packet using a first code rate, wherein the first code rate is less than a second code rate used to send the data packet before the packet loss; Determine packet loss when sending data packets using a first bit rate; The bandwidth is estimated according to the packet loss situation of sending the data packets by using the first code rate.

2. The method according to claim 1, characterized in that The estimating of bandwidth according to packet loss of data packets sent using the first bit rate includes: Determining a type of routing according to a packet loss condition of sending a data packet using a first bit rate; The bandwidth is estimated according to the type of the route.

3. The method according to claim 2, characterized in that The determining the type of route according to the packet loss situation of sending the data packet using the first code rate includes: When it is determined that the packet loss of sending the data packet using the first code rate is reduced, the type of routing is determined to be a shallow cache type.

4. The method according to claim 1, characterized in that The estimating of bandwidth according to packet loss of data packets sent using the first bit rate includes: When it is determined that the packet loss situation of sending the data packet using the first code rate has not changed, the packet loss is determined to be random packet loss, and the estimated bandwidth size is maintained.

5. The method according to claim 1, characterized in that The method further comprises: When it is determined that the delay gradient of the data packet increases, it is determined that the type of routing is network congestion under non-shallow cache routing, and the estimated bandwidth is reduced.

6. The method according to claim 1, characterized in that The method further comprises: When it is determined that the delay gradient of the data packet increases, the transmitting end device sends the data packet using a third code rate, wherein the third code rate is greater than the second code rate used for previously sending the data packet; Determine packet loss of data packets sent using a third bit rate; The type of route is determined according to the packet loss situation of sending data packets using the third code rate, and the bandwidth is estimated according to the type of route.

7. The method according to claim 1, characterized in that The method further comprises: When it is determined that the bandwidth estimated by using the general congestion control algorithm is reduced and the user quality experience parameter is degraded, the estimated bandwidth size is reduced.

8. A device for estimating conference bandwidth, characterized in that: Applied to a transmitting end device, the device comprises: A sending unit, configured to send the data packet using a first code rate when detecting packet loss when determining that the data packet delay has not increased, wherein the first code rate is less than a second code rate used to send the data packet before the packet loss; A determination unit, configured to determine a packet loss condition of sending a data packet using a first bit rate; The determining unit is further configured to estimate the bandwidth according to a packet loss condition of sending data packets using the first code rate.

9. An electronic device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the computer program executes the method according to any one of claims 1 to 7 when being run by the processor.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program executes the method according to any one of claims 1 to 7 when executed by a processor.