Method, device, equipment and medium for controlling bit rate of conference-participating terminals based on visual networking

By adjusting the bitrate of internet-connected terminals in real time through a traffic audit and management system, the problem of screen flickering and stuttering caused by internet terminals in video conferencing was solved, ensuring the stability and quality of online meetings.

CN112004048BActive Publication Date: 2024-11-08VISIONVERA INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202010727730.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-07-22
Publication Date
2024-11-08
Estimated Expiration
2040-07-22

AI Technical Summary

Technical Problem

In video conferencing, the presence of internet terminals can easily lead to screen flickering and stuttering. Existing technologies cannot effectively control the bitrate of internet terminals, thus affecting the quality of the online meeting.

Method used

The traffic audit management system reads the current bitrate of the internet-participating terminals in real time and adjusts the bitrate of the internet-participating terminals according to the relationship between the preset bandwidth threshold and the current bitrate, so as to ensure that the bandwidth usage in the online meeting meets the preset requirements.

Benefits of technology

This effectively avoids the internet terminal bitrate exceeding the network bandwidth, prevents screen flickering and lag, and improves the quality and stability of online meetings.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112004048B_ABST
    Figure CN112004048B_ABST
Patent Text Reader

Abstract

The embodiments of the present invention provide a method, device, electronic device and storage medium for controlling the bit rate of a conference participant terminal based on a visual network, which are applied to a traffic audit management system. The method comprises: in a network conference held between the visual network and the Internet, reading the current bit rate of an Internet conference participant terminal located in the Internet; determining whether to adjust the bit rate of the Internet conference participant terminal based on a bandwidth threshold preset in the visual network and corresponding to the network conference, and the relationship between the current bit rate of the Internet conference participant terminal and the current bit rate of the visual network conference participant terminal in the network conference; and in the case of determining to adjust the bit rate of the Internet conference participant terminal, controlling the Internet conference participant terminal to adjust its own current bit rate through the visual network.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of network communication technology, and in particular to a method, device, equipment and medium for controlling bit rate of conference participants based on a visual network. Background Art

[0002] The visual network adopts the world's most advanced VisionVera real-time HD video exchange technology, realizing real-time transmission of HD video across the entire network, which is currently impossible with the Internet. It integrates dozens of video, voice, image, text, communication, data and other services such as HD video conferencing, video surveillance, remote training, intelligent monitoring and analysis, emergency command, video calls, live broadcasts, TV mails, information releases, etc. into one system platform, and realizes real-time interconnection of HD quality video communications through a variety of terminal devices.

[0003] In related technologies, if multiple video conferences are held in a city and all the participants are video conference terminals, the entire meeting will be stable and will not experience screen distortion or lag. However, in reality, video conferences are often jointly participated by video conference terminals and Internet terminals. If an Internet terminal is involved in the meeting, the network conference will become abnormal, for example, it will experience screen distortion and lag. Therefore, it is urgent to implement bandwidth control for network conferences involving Internet terminals to avoid screen distortion and lag. Summary of the Invention

[0004] In view of the above problems, an embodiment of the present invention provides a method, device, electronic device and storage medium for controlling the bit rate of a participating terminal based on a visual network, so as to overcome the above problems or at least partially solve the above problems.

[0005] A first aspect of an embodiment of the present invention discloses a method for controlling the bit rate of a conference terminal based on a visual network, which is applied to a traffic audit management system. The method includes:

[0006] In an online conference held between the visual network and the Internet, reading a current bit rate of an Internet conference participant terminal located in the Internet;

[0007] Determining whether to adjust the bit rate of the Internet participating terminal based on a bandwidth threshold corresponding to the online conference preset in the visual network and a size relationship between the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal in the online conference;

[0008] In the case of determining to adjust the bit rate of the Internet conference participating terminal, the Internet conference participating terminal is controlled by the visual network to adjust its own current bit rate.

[0009] Optionally, determining whether to adjust the bit rate of the Internet participating terminal according to a bandwidth threshold preset in the visual network and corresponding to the online conference, and a magnitude relationship between the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal in the online conference, includes:

[0010] When the bandwidth occupied by the sum of the current bit rate of the Internet conference participating terminal and the current bit rate of the visual network conference participating terminal does not exceed the bandwidth threshold, and the current bit rate of the Internet conference participating terminal is greater than the current bit rate of the visual network conference participating terminal, determining to reduce the bit rate of the Internet conference participating terminal;

[0011] When the bandwidth occupied by the sum of the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal does not exceed the bandwidth threshold, and the current bit rate of the Internet participating terminal is less than the current bit rate of the visual network participating terminal, determine to increase the bit rate of the Internet participating terminal.

[0012] Optionally, the method further includes:

[0013] Determining whether to adjust the bit rate of the visual network conference terminal according to the bandwidth threshold and the current bit rate of the visual network conference terminal;

[0014] When it is determined to adjust the bit rate of the visual network conference terminal, the bit rate of the visual network conference terminal is adjusted.

[0015] Optionally, when it is determined to adjust the bit rate of the Internet conference participant terminal, controlling the Internet conference participant terminal to adjust its current bit rate through the visual network includes:

[0016] Requesting a bitrate modification permission from a GK server on the Internet for managing the Internet conference terminal, wherein the GK server is configured to determine whether to allow the Internet conference terminal to adjust the bitrate based on its own preset bandwidth threshold;

[0017] In response to the modification consent instruction returned by the GK server, the Internet conference participating terminal is controlled to adjust its own current bit rate.

[0018] Optionally, controlling the Internet conference participant terminal to adjust its current bit rate through the visual network includes:

[0019] A rate modification signaling that complies with the RAS protocol in the H323 protocol cluster is sent to the Internet conference participating terminal, so that the Internet conference participating terminal adjusts its current rate to the rate in the rate modification signaling.

[0020] Optionally, reading the current bit rate of the Internet conference participant terminal located in the Internet includes:

[0021] Determining a virtual terminal bound to the Internet conference participant terminal;

[0022] The current bit rate of the Internet conference participating terminal is determined according to the audio and video data sent by the Internet conference participating terminal and received by the virtual terminal.

[0023] A second aspect of an embodiment of the present invention provides a device for controlling the bit rate of a conference terminal based on a visual network, which is applied to a traffic audit management system. The device includes:

[0024] A reading module, configured to read the current bit rate of an Internet conference participant terminal located in the Internet during an online conference held between the visual network and the Internet;

[0025] A determination module, configured to determine whether to adjust the bit rate of the Internet participating terminal based on a bandwidth threshold corresponding to the online conference preset in the visual network and a magnitude relationship between the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal in the online conference;

[0026] The adjustment module is used to control the Internet conference participating terminal to adjust its own current bit rate through the visual network when it is determined to adjust the bit rate of the Internet conference participating terminal.

[0027] According to a third aspect of the embodiments of the present invention, an electronic device is disclosed, including:

[0028] one or more processors; and

[0029] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the device to execute the method for controlling the bit rate of participating terminals based on visual networking as described in the first aspect of the embodiment of the present invention.

[0030] The fourth aspect of the embodiments of the present invention further discloses a computer-readable storage medium, which stores a computer program that enables a processor to execute the method for controlling the bit rate of a participating terminal based on a visual network as described in the first aspect of the embodiments of the present invention.

[0031] In this embodiment, the traffic audit management system can read the current bit rate of the Internet participating terminal located on the Internet; and determine whether to adjust the bit rate of the Internet participating terminal based on the bandwidth threshold corresponding to the network conference and the size relationship between the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal; if it is determined to adjust the bit rate of the Internet participating terminal, the Internet participating terminal is controlled by the visual network to adjust its own current bit rate.

[0032] The embodiments of the present invention include the following advantages:

[0033] Since the current bit rate of the Internet participating terminal can be read, and based on the size relationship between the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal and the bandwidth threshold preset for the online conference, it is determined whether to adjust the current bit rate of the Internet participating terminal. When adjustment is needed, the Internet participating terminal can be controlled by the visual network to adjust its own bit rate. In this way, in an online conference jointly held by the visual network and the Internet, the traffic audit management system within the visual network can control the bit rate of the Internet participating terminal in the online conference, thereby preventing the bit rate of the Internet participating terminal from exceeding the network bandwidth pre-allocated by the visual network for the online conference, thereby avoiding the phenomenon of screen distortion and freeze, and improving the quality of the online conference. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments of the present application. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0035] Figure 1 This is a system architecture diagram of a traffic audit management system according to an embodiment of the present invention;

[0036] Figure 2 is a communication environment diagram of an embodiment of the present invention;

[0037] Figure 3 This is a flowchart of a method for controlling bit rate of a conference terminal based on a visual network according to an embodiment of the present invention;

[0038] Figure 4 This is a flowchart of another method for controlling bit rate of a conference terminal based on a visual network according to an embodiment of the present invention;

[0039] Figure 5 This is a flow chart of a method for controlling bit rate of a conference terminal based on a visual network according to an embodiment of the present invention;

[0040] Figure 6 This is a structural diagram of a device for controlling bit rate of conference terminals based on a visual network according to an embodiment of the present invention. DETAILED DESCRIPTION

[0041] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0042] In the visual network, since the visual network is a hierarchical and centrally controlled network structure, in practice, when conducting visual services, such as holding an online audio and video conference in the visual network, users will apply to the visual network for a conference reservation for the audio and video conference. In this case, the visual network will allocate network bandwidth for the conference in advance based on the number of participating terminals in the audio and video conference, to avoid the situation where the required network bandwidth resources are insufficient during the audio and video conference, affecting the normal progress of the audio and video conference.

[0043] However, with the increasing interaction between the visual network and the internet, audio and video conferencing often requires both the visual network terminals within the visual network and the internet terminals within the internet. In this case, we've repeatedly observed that these conferences often experience anomalies such as screen distortion or freezing. After network investigation, we ultimately determined that the bitrate of the participating internet terminals was too high, causing the overall conference bandwidth to exceed the preset value and impacting other meetings held in the same city.

[0044] However, even if the cause of the failure is found to be that the bit rate of the Internet terminals participating in the meeting is too high, since the visual network cannot control the modification of the bit rate of the Internet terminals, the cause of the failure cannot be solved to ensure the normal progress of the audio and video conference.

[0045] In light of this, the applicant has proposed the following core technical concept: using a traffic audit management system to read the current bitrate of internet conference terminals on the internet in real time, and combining it with a bandwidth threshold preset in the visual network corresponding to the web conference, as well as the relationship between the current bitrate of the internet conference terminal and the current bitrate of the visual network conference terminals in the web conference, the visual network controls the internet conference terminals to adjust their own bitrates. This allows the visual network to control the bitrates of internet terminals located on the internet during web conferences jointly held on the internet and the visual network.

[0046] Reference Figure 1 As shown, a system structure diagram of the traffic audit management system in an embodiment of the present application is shown. The traffic audit management system can be located in a visual network and includes a traffic audit server and a coordination server.

[0047] Among them, the traffic audit server is used to control the video bit rate of the visual network terminal, audit the data traffic size of the audio and video of the visual network terminal in the meeting, and dynamically set and manage the bandwidth occupied by the meeting to ensure that the bandwidth occupied by the bit rate of the visual network terminal does not exceed the preset bandwidth allocated to it in advance.

[0048] Among them, the cooperative conversion server can be connected to the terminal communication on the Internet, and is responsible for converting the streaming media protocol and encapsulating audio and video data packets between the visual network and the Internet.

[0049] Reference Figure 2 As shown, Figure 2 The communication environment diagram of the traffic audit management system is shown as follows: Figure 2 As shown, it includes a traffic audit management system 201, multiple visual network conference terminals communicating with the traffic audit server in the traffic audit management system 201, and multiple Internet conference terminals communicating with the coordination server. The coordination server also communicates with multiple visual network conference terminals at the same time, and multiple Internet conference terminals are also respectively connected to the GK server in the Internet.

[0050] Among them, the GK server, also known as the gatekeeper server, is mainly involved in the bandwidth management function of Internet conference terminals on the Internet.

[0051] Among them, the traffic audit server and the cooperative transfer server can communicate through the visual network server, that is, the traffic audit server and the cooperative transfer server must both register on the visual network server to join the visual network, and subsequently the two will also transfer data through the visual network server during the communication process.

[0052] Among them, in a network conference jointly held between the Internet and the visual network, the visual network participating terminal located in the visual network can send its own audio and video data to the coordination server. The coordination server can perform protocol conversion on the audio and video data sent by the visual network participating terminal, obtain Internet audio and video data that can be transmitted in the Internet, and then send the Internet audio and video data to the Internet participating terminal. Similarly, in this network conference, the Internet participating terminal located in the Internet can send its own audio and video data to the coordination server. The coordination server can perform protocol conversion on the audio and video data sent by the Internet participating terminal, obtain Visual Network Audio and Video Data that can be transmitted in the visual network, and then send the Visual Network Audio and Video Data to the Visual Network participating terminal.

[0053] To enable communication with Internet terminals, the coordination server, when turned on, will create virtual terminals capable of protocol conversion, allowing these virtual terminals to join the video network and the Internet. Upon receiving a join request from an Internet participant terminal, the coordination server can assign the virtual terminals created by the coordination server to the Internet participant terminal. This virtual terminal acts as a data interface for communication between the Internet participant terminal and the coordination server, receiving data sent by the Internet participant terminal and forwarding some data to the Internet participant terminal.

[0054] Among them, the Internet conference terminal can refer to smart devices such as tablets, computers, and mobile phones, and the visual network conference terminal can refer to a set-top box used in the visual network.

[0055] Combine Figure 2In the communication environment shown, in a web conference held jointly between the visual network and the Internet, the traffic audit server pre-allocates bandwidth for transmitting audio and video streams in the web conference to the visual network participant terminals 1 and 2 in the visual network, ensuring sufficient bandwidth for the web conference. Generally speaking, this pre-allocated bandwidth is only guaranteed to be used by the visual network participant terminals 1 and 2 on the visual network side, and the network bandwidth resources available for allocation within the visual network are limited. For example, if the network bandwidth resources are only 20M and need to be allocated to 10 web conferences held during this time period, the total bandwidth allocated to each web conference will not exceed 20M.

[0056] However, once participating terminals on the internet join the conference, they need to exchange audio and video data with the terminals on the video network, which inevitably consumes bandwidth resources within the video network. However, the video network cannot pre-allocate or limit the bandwidth used by internet terminals, making the above-mentioned pre-allocated network bandwidth uncontrollable. Therefore, if the actual bandwidth used by a web conference exceeds the allocated bandwidth, it will not only affect the convening of the conference itself, but also the bandwidth of other web conferences, making them unable to proceed normally.

[0057] Reference Figure 2 As shown, the embodiment of the present application utilizes a traffic audit server and a coordination server. Through the coordination server, the function of the traffic audit server to manage bandwidth restriction can be radiated across the network to the Internet conference terminal, so as to achieve the purpose of real-time control of the bit rate of the Internet conference terminal during the online conference.

[0058] Combine Figure 2 The communication environment shown in FIG. 1 is used to describe the method for controlling the bit rate of the conference terminal based on the visual network in the embodiment of the present application. Figure 3 FIG. 1 is a flowchart showing a method for controlling the bit rate of a conference terminal based on a visual network according to an embodiment of the present invention, which may include the following steps:

[0059] Step S301: In an online conference held between the visual network and the Internet, the current bit rate of the Internet conference terminal located in the Internet is read.

[0060] In this embodiment, a web conference held between the visual network and the Internet can be understood as one in which the participating terminals include both visual network participating terminals located in the visual network and Internet participating terminals located on the Internet. During the web conference, the coordination server in the traffic audit management system can respond to the bitrate read instruction sent by the traffic audit server to read the current bitrate of the Internet participating terminals.

[0061] Among them, the bit rate refers to the number of data bits transmitted per unit time during data transmission. The generally used unit is kbps, that is, kilobits per second. In this embodiment, the current bit rate of the Internet participating terminal refers to: the size of the audio and video data sent by the Internet participating terminal to the coordination server per unit time.

[0062] In an optional example of this embodiment, when determining to read the current bit rate of an Internet conference terminal located in the Internet, the coordination server can determine its own virtual terminal bound to the Internet conference terminal; and determine the current bit rate of the Internet conference terminal based on the audio and video data sent by the Internet conference terminal received by the virtual terminal.

[0063] In this optional example, since the cooperative conversion server assigns the cooperative conversion virtual terminal to the Internet conference terminal, the audio and video data sent by the Internet conference terminal is received by the virtual terminal. In this process, the cooperative conversion server can read the size of the audio and video data received by the virtual terminal per unit time, and then obtain the current bit rate of the Internet conference terminal.

[0064] Step S302: Determine whether to adjust the bit rate of the Internet participating terminal based on the bandwidth threshold corresponding to the network conference preset in the visual network and the size relationship between the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal in the network conference.

[0065] In this embodiment, the process of step S302 can be performed by the traffic audit server in the traffic audit management system. After reading the current bit rate of the Internet conference terminal, the coordination server in the traffic audit management system can feed back the current bit rate of the Internet conference terminal to the traffic audit server in the traffic audit management system. The traffic audit server can then determine whether the remaining bandwidth in the current network conference can still withstand the bit rate of the Internet conference terminal based on the bandwidth threshold pre-allocated to the network conference in the visual network and the current bit rate of the visual network conference terminal. The remaining bandwidth refers to the bandwidth remaining after the bandwidth threshold pre-allocated to the current network conference is occupied by the visual network conference terminal.

[0066] In practice, when the remaining bandwidth in the current network conference can still bear the bit rate of the Internet participating terminal, there is no need to adjust the current bit rate of the Internet participating terminal; when the remaining bandwidth in the current network conference is not enough to bear the bit rate of the Internet participating terminal, the current bit rate of the Internet participating terminal can be adjusted.

[0067] Step S303: When it is determined to adjust the bit rate of the Internet conference participating terminal, the Internet conference participating terminal is controlled by the visual network to adjust its own current bit rate.

[0068] In this embodiment, controlling the Internet conference participating terminal to adjust its own current bit rate through the visual network may refer to: the traffic audit management system located in the visual network controls the bit rate adjustment of the Internet conference participating terminal across the network.

[0069] During specific implementation, when the traffic audit server determines that the bit rate of the Internet conference terminal needs to be adjusted, the traffic audit server can send a bit rate adjustment instruction to the coordination server in the system, and then the coordination server sends the bit rate adjustment instruction to the Internet conference terminal through the virtual terminal, so that the Internet conference terminal adjusts its own current bit rate.

[0070] Specifically, the bit rate adjustment instruction may include the target bit rate to be adjusted, and the Internet conference terminal may adjust its current bit rate to the target bit rate, so that the Internet conference terminal can send audio and video data to the coordination server according to the adjusted bit rate.

[0071] By adopting the technical solution of this embodiment, the current bit rate of the Internet participating terminal can be read, and based on the size relationship between the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal and the bandwidth threshold preset for the network conference, it can be determined whether to adjust the current bit rate of the Internet participating terminal.

[0072] When the remaining bandwidth in the current network conference is insufficient to support the bit rate of the Internet participating terminal, the current bit rate of the Internet participating terminal can be adjusted, thereby achieving a network conference jointly held by the visual network and the Internet. The traffic audit management system within the visual network can control the bit rate of the Internet participating terminal in the network conference, avoiding the bit rate of the Internet participating terminal exceeding the remaining network bandwidth of the current network conference, thereby ensuring that sufficient bandwidth is reserved for the current network conference for audio and video data transmission, avoiding the Internet participating terminal occupying the bandwidth of other network conferences, thereby causing screen distortion and freezes in multiple network conferences, and improving the quality of network conferences.

[0073] Reference Figure 4 FIG. 1 is a flowchart showing another method for controlling bit rate of a conference terminal based on a visual network according to the present embodiment, which may specifically include the following steps:

[0074] Step S401: In an online conference held between the visual network and the Internet, the current bit rate of the Internet conference terminal located in the Internet is read.

[0075] The process of step S401 is similar to that of step S301 above. For the relevant details, please refer to the description of step S301 and will not be repeated here.

[0076] Step S402: Determine whether to adjust the bit rate of the Internet participating terminal based on the bandwidth threshold corresponding to the network conference preset in the visual network and the relationship between the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal in the network conference.

[0077] Specifically, in this embodiment, determining whether to adjust the bit rate of the Internet conference terminal can be divided into increasing the bit rate of the Internet conference terminal and decreasing the bit rate of the Internet conference terminal. Specifically, whether to increase the bit rate or decrease the bit rate can be determined according to the following situations:

[0078] Case 1: When the bandwidth occupied by the sum of the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal does not exceed the bandwidth threshold, and the current bit rate of the Internet participating terminal is greater than the current bit rate of the visual network participating terminal, determine to reduce the bit rate of the Internet participating terminal.

[0079] In this case, if the bandwidth occupied by the sum of the current bitrate of the Internet participant terminal and the current bitrate of the visual network participant terminal does not exceed the bandwidth threshold, it can be guaranteed that the network bandwidth allocated to the online conference is sufficient to support the audio and video data sent by each participant terminal (including the Internet participant terminal and the visual network participant terminal). However, since the current bitrate of the Internet participant terminal is greater than the current bitrate of the visual network participant terminal, the audio and video data sent by the Internet participant terminal will occupy the bandwidth space of the audio and video data sent by the visual network participant terminal. Therefore, the bitrate of the Internet participant terminal can be reduced.

[0080] In one example, the bit rate of the Internet conference terminal can be reduced to a bit rate consistent with the bit rate of the visual network conference terminal.

[0081] Case 2: When the bandwidth occupied by the sum of the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal does not exceed the bandwidth threshold, and the current bit rate of the Internet participating terminal is less than the current bit rate of the visual network participating terminal, it is determined to increase the bit rate of the Internet participating terminal.

[0082] In this case, if the bandwidth occupied by the sum of the current bitrate of the Internet participant terminal and the current bitrate of the visual network participant terminal does not exceed the bandwidth threshold, it can be guaranteed that the network bandwidth allocated to the online conference is sufficient to support the audio and video data sent by each participant terminal (including the Internet participant terminal and the visual network participant terminal). If the current bitrate of the Internet participant terminal is lower than the current bitrate of the visual network participant terminal, it can be considered that the audio and video data sent by the Internet participant terminal will not occupy the bandwidth space of the audio and video data sent by the visual network participant terminal, that is, the bitrate of the audio and video data sent by the Internet participant terminal is lower.

[0083] In practice, since the lower the bit rate, the less clear the video image is, therefore, if the bandwidth threshold of the network conference is sufficient, the bit rate of the Internet participating terminal can be appropriately increased to improve the clarity of the video image of the Internet participating terminal.

[0084] In one example, the bit rate of the Internet conference terminal can be increased to a bit rate that is consistent with the bit rate of the visual network conference terminal, or increased to a bit rate that is close to the bit rate of the visual network conference terminal.

[0085] Case three: When the bandwidth occupied by the sum of the current bit rate of the Internet conference terminal and the current bit rate of the visual network conference terminal exceeds the bandwidth threshold, it is determined to reduce the bit rate of the Internet conference terminal.

[0086] When the sum of the current bitrates of the internet-connected participating terminals and the video-connected participating terminals exceeds the bandwidth threshold, the bandwidth for the online conference becomes insufficient. In this case, the participating terminals in the online conference will squeeze the bandwidth of other online conferences held simultaneously, causing screen distortion and lag in other online conferences. In this case, the bitrate of the internet-connected participating terminals is reduced.

[0087] In one example, the bit rate of the Internet participating terminal can be reduced to a bit rate lower than the bit rate of the visual network participating terminal based on the standard that the bandwidth occupied by the sum of the bit rate of the Internet participating terminal and the bit rate of the visual network participating terminal is less than a preset bandwidth threshold.

[0088] Step S403: When it is determined to adjust the bit rate of the Internet conference terminal, a request is made to the GK server in the Internet for managing the Internet conference terminal for bit rate modification permission. The GK server is used to determine whether to allow the Internet conference terminal to adjust the bit rate based on its own preset bandwidth threshold.

[0089] In this embodiment, since multiple Internet conference terminals are also respectively connected to the GK server in the Internet, and the GK server mainly manages the bandwidth of the Internet conference terminals in the Internet, when it is necessary to adjust the current bit rate of the Internet conference terminal, you can first request the bit rate modification permission from the GK server.

[0090] In some embodiments, the process of obtaining the GK server's permission to request a bitrate modification may include: the traffic audit server sends a bitrate adjustment instruction to a co-transfer server in the system; the co-transfer server then sends a bitrate modification request to the GK server via a virtual terminal bound to the GK server based on the bitrate adjustment instruction. The bitrate modification request may include an indication of whether to increase or decrease the bitrate.

[0091] In yet other embodiments, the process of obtaining the GK server's permission to request bitrate modification may include: the traffic audit server sends a bitrate adjustment instruction to a co-transfer server in the system; the co-transfer server then sends the bitrate adjustment instruction to an internet conference participant terminal via a virtual terminal; and the internet conference participant terminal, based on the bitrate adjustment instruction, sends a bitrate modification request to the GK server. The bitrate modification request may include an indication of whether to increase or decrease the bitrate.

[0092] The GK server can determine whether to allow an Internet participant terminal to modify its bitrate based on the bandwidth currently occupied by the Internet devices it manages and the bandwidth threshold preset in the Internet. In specific implementations, if the Internet participant terminal determines that the bitrate adjustment strategy (increase or decrease) does not exceed the tolerance of the current Internet bandwidth, it will allow the Internet participant terminal to modify its bitrate; otherwise, it will not allow it.

[0093] Step S404: In response to the modification consent instruction returned by the GK server, the Internet conference participant terminal is controlled to adjust its current bit rate.

[0094] In this embodiment, when the co-transfer server sends a rate modification request to the GK server through the virtual terminal bound to the GK server according to the rate adjustment instruction, the consent modification instruction returned by the GK server can be returned to the co-transfer server, and then the co-transfer server controls the Internet participating terminal to adjust its own current rate according to the rate adjustment instruction previously issued by the traffic audit server.

[0095] Among them, when the Internet sends a rate modification request to the GK server according to the rate adjustment instruction, the consent modification instruction returned by the GK server can be returned to the Internet terminal, and then the Internet terminal returns the consent modification instruction to the coordination server, and then the coordination server controls the Internet participating terminal to adjust its own current rate according to the rate adjustment instruction previously sent by the traffic audit server.

[0096] In practice, Internet participating terminals generally use the H323 protocol to participate in online conferences. In this case, in order to adapt to the communication protocol of the Internet participating terminals, when the Internet participating terminals are controlled by the visual network to adjust their own current bit rate, the coordination server in the traffic audit management system can send a bit rate modification signaling that complies with the RAS protocol in the H323 protocol cluster to the Internet participating terminals, so that the Internet participating terminals adjust their own current bit rate to the bit rate in the bit rate modification signaling.

[0097] Among them, the RAS protocol is a protocol executed between endpoints (terminals or gateways) and network gatekeepers in the Internet, and it belongs to the H323 protocol cluster. In this embodiment, the coordination server can perform protocol conversion on the rate adjustment instructions sent by the traffic audit server, and convert them into rate modification signaling that complies with the RAS protocol in the H323 protocol cluster. The rate modification signaling can be used to transmit to the Internet participating terminals in the Internet.

[0098] Specifically, the above-mentioned protocol conversion may be performed by the Internet conference participating terminal and the virtual terminal bound to the Internet conference participating terminal.

[0099] In an embodiment of the present application, it is also possible to determine whether to adjust the bit rate of the visual network conference terminal based on the bandwidth threshold and the current bit rate of the visual network conference terminal; if it is determined to adjust the bit rate of the visual network conference terminal, the bit rate of the visual network conference terminal is adjusted.

[0100] Of course, in this embodiment, the traffic audit server can control the bitrate of not only the Internet participating terminals, but also the bitrate of the visual network participating terminals. Specifically, the traffic audit server can monitor the bitrate of the visual network participating terminals in real time. When the bandwidth occupied by the sum of the bitrates of each visual network participating terminal in the online conference exceeds the preset bandwidth threshold, the bitrate of the visual network participating terminal can be reduced. Conversely, when the bitrate of a visual network participating terminal in the online conference is lower than the preset bitrate, the video image corresponding to the visual network participating terminal is very blurry. In this case, the bitrate of the visual network participating terminal can be increased.

[0101] By adopting the technical solution of the embodiment of the present invention, the current bit rate of the Internet participating terminal can be read, and based on the size relationship between the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal and the bandwidth threshold preset for the network conference, it is determined whether to adjust the current bit rate of the Internet participating terminal.

[0102] On the one hand, when the remaining bandwidth in the current network conference is insufficient to support the bit rate of the Internet participating terminal, the current bit rate of the Internet participating terminal can be reduced to prevent the bit rate of the Internet participating terminal from exceeding the remaining network bandwidth of the current network conference, thereby ensuring that sufficient bandwidth is reserved for the current network conference for audio and video data transmission, avoiding the Internet participating terminal occupying the bandwidth of other network conferences, thereby preventing screen distortion and freezes in multiple network conferences, and improving the quality of network conferences.

[0103] On the other hand, since the remaining bandwidth in the current network conference is sufficient to support the bit rate of the Internet participating terminal, and the bit rate of the Internet participating terminal is lower than the bit rate of the visual network participating terminal, the current bit rate of the Internet participating terminal can be increased, thereby improving the clarity of the video image of the Internet participating terminal.

[0104] Reference Figure 5 FIG. 1 is a schematic diagram showing the overall flow of a method for controlling bit rate of a conference terminal based on a visual network according to an embodiment of the present invention. Figure 5 The Zhongjiguang terminal refers to the visual network terminal in the visual network, in which the coordination server has a visual network module VMSchan and a virtual terminal module. The virtual terminal module can be called a RASchan module, which is mainly responsible for communication with the Huawei te30 terminal.

[0105] Below, in conjunction with this specific example, the bit rate control method of the participant terminal of the visual network of the present invention is briefly described:

[0106] 1. After setting up the environment, start the co-transfer server. The co-transfer server will co-transfer some virtual terminals that can perform protocol conversion and wait for the virtual terminals to access the network normally.

[0107] 2. After the virtual terminal successfully joins the network, the traffic audit server instructs the co-transmission server to find the virtual terminal bound to the Huawei te30 terminal, and then obtains the current bit rate of the device read by the co-transmission server, and compares the current bit rate with the bit rate of other participating Aurora terminals to see if they are consistent. If they are inconsistent, a modification request will be initiated, and the data to be modified will be filled in the request signaling 8e01 ​​and sent to the visual network server.

[0108] 3. After receiving the request signaling 8e01, the visual network server converts it into a request signaling 8e02 format and sends it to the visual network module VMSchan of the coordination server. VMSchan parses the 8e02 signaling and reads the modified bandwidth data from it. It then sends this message to the RASchan module through the coordination server's internal communication mechanism.

[0109] 4. The RASchan module then constructs a FlowControlCommand flow control signaling message in the H245 protocol and sends it to the Huawei te30 terminal. After receiving this signaling message, the Huawei te30 terminal sends a Bandwidth Change Request (BRQ) message to the GK server that manages it. The GK server determines whether the request is acceptable. If the GK server deems the request unacceptable, it responds with a Bandwidth Change Reject (BRJ) message to the endpoint. If the GK server deems the request acceptable, it responds with a Bandwidth Change Confirm (BCF) message. In this case, we use the BCF message to confirm the change.

[0110] 5. When the Huawei te30 receives the modification approval from the GK, it sends this approval back to the co-transfer server. The RASchan module in the co-transfer server then sends a closeLogicalChannel message to close the logical channel. Because the Huawei te30's call bandwidth has already been modified to the bitrate sent by the RAS module and is sufficient to support the channel, the te30 responds to the RASchan module in the co-transfer server with an openLogicalChannelAck message. Otherwise, it responds with an openLogicalChannelReject message, indicating that the bitrate is unacceptable.

[0111] 6. The RASchan module uses openLogicalChannel to reopen the logical channel and adopt the new bit rate. If the Huawei te30 terminal wants to receive the channel with the new bit rate, it must first ensure that the change in channel rate does not cause insufficient call bandwidth.

[0112] 7. When the RASchan module receives the openLogicalChannelAck signaling from the Huawei te30 terminal, it will send the reply signaling back to the VMSchan module through the internal inter-module communication of the coordination server.

[0113] 8. VMSchan will convert the reply signaling into the reply 8e01req of the visual network protocol and send it to the visual network server. The visual network server will then convert the signaling into the reply signaling 8e02res and send it to the visual network traffic audit server.

[0114] It should be noted that for the sake of simplicity, the method embodiments are described as a series of actions. However, those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described because, depending on the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0115] refer to Figure 6 , shows a device for controlling the bit rate of a participant terminal based on a visual network, characterized in that it is applied to a traffic audit management system, and the device may specifically include the following modules:

[0116] The reading module 601 is located in the coordination server and is used to read the current bit rate of the Internet conference terminal located in the Internet during the network conference held between the visual network and the Internet;

[0117] Determination module 602, located in the traffic audit server, is used to determine whether to adjust the bit rate of the Internet participating terminal based on a bandwidth threshold corresponding to the online conference preset in the visual network and a relationship between the current bit rate of the Internet participating terminal and the current bit rate of the visual network participating terminal in the online conference;

[0118] The adjustment module 603 is located in the coordination server and is used to control the Internet conference terminal to adjust its own current bit rate through the visual network when it is determined to adjust the bit rate of the Internet conference terminal.

[0119] In an optional example, the adjustment module 603 may be located in a virtual terminal in the coordination server that is bound to the Internet conference participant terminal.

[0120] Optionally, the determining module 602 may specifically include the following units:

[0121] The first unit is configured to determine to reduce the bit rate of the Internet conference participating terminal when the bandwidth occupied by the sum of the current bit rate of the Internet conference participating terminal and the current bit rate of the visual network conference participating terminal does not exceed the bandwidth threshold, and the current bit rate of the Internet conference participating terminal is greater than the current bit rate of the visual network conference participating terminal;

[0122] The second unit is used to determine to increase the bit rate of the Internet conference terminal when the bandwidth occupied by the sum of the current bit rate of the Internet conference terminal and the current bit rate of the visual network conference terminal does not exceed the bandwidth threshold and the current bit rate of the Internet conference terminal is less than the current bit rate of the visual network conference terminal.

[0123] Optionally, the device may further include the following modules:

[0124] A visual network bit rate determination module, configured to determine whether to adjust the bit rate of the visual network conference terminal according to the bandwidth threshold and the current bit rate of the visual network conference terminal;

[0125] The visual network bit rate adjustment module is used to adjust the bit rate of the visual network conference terminal when it is determined to adjust the bit rate of the visual network conference terminal.

[0126] Optionally, the adjustment module 603 may specifically include the following units:

[0127] a permission requesting unit, configured to request a bitrate modification permission from a GK server in the Internet for managing the Internet conference terminal, wherein the GK server is configured to determine whether to allow the Internet conference terminal to adjust the bitrate based on its own preset bandwidth threshold;

[0128] The modification unit is used to control the Internet conference participating terminal to adjust its own current bit rate in response to the modification consent instruction returned by the GK server.

[0129] Optionally, the adjustment module 603 may be specifically configured to send a rate modification signaling in accordance with the RAS protocol in the H323 protocol cluster to the Internet conference participant terminal, so that the Internet conference participant terminal adjusts its current rate to the rate in the rate modification signaling.

[0130] Optionally, the reading module 601 may specifically include the following units:

[0131] A virtual terminal determining unit, configured to determine a virtual terminal bound to the Internet conference participating terminal;

[0132] The bit rate reading unit is used to determine the current bit rate of the Internet conference participating terminal according to the audio and video data sent by the Internet conference participating terminal and received by the virtual terminal.

[0133] It should be noted that the device embodiment is similar to the method embodiment, so the description is relatively simple, and the relevant parts can be referred to the method embodiment.

[0134] An embodiment of the present invention further provides an electronic device, including:

[0135] one or more processors; and

[0136] One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the device to execute the method for controlling the bit rate of participating terminals based on visual networking as described in any of the above embodiments of the present invention.

[0137] An embodiment of the present invention further provides a computer-readable storage medium, which stores a computer program that enables a processor to execute the method for controlling the bit rate of a participating terminal based on a visual network as described in any of the above embodiments of the present invention.

[0138] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0139] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, apparatus, or computer program products. Thus, embodiments of the present invention may take the form of a fully hardware embodiment, a fully software embodiment, or an embodiment combining software and hardware. Furthermore, embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0140] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the process in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0141] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0142] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0143] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they become aware of the basic creative concepts. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0144] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or terminal device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that includes the element.

[0145] The above is a detailed introduction to the method, device, equipment and storage medium for controlling the bit rate of participating terminals based on visual networking provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, based on the ideas of the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for controlling the bit rate of a conference terminal based on a visual network, characterized in that: Applied to a traffic audit management system, the traffic audit management system includes a traffic audit server and a coordination server, and the method includes: In a network conference held between the visual network and the Internet, reading a current bit rate of an Internet conference participant terminal located in the Internet; According to the bandwidth threshold value corresponding to the network conference preset in the visual network and the size relationship between the current bit rate of the Internet conference participant terminal and the current bit rate of the visual network conference participant terminal in the network conference, it is determined whether the remaining bandwidth in the network conference can bear the current bit rate of the Internet conference participant terminal, so as to determine whether to adjust the bit rate of the Internet conference participant terminal; wherein, when the Internet conference participant terminal performs audio and video interaction with the visual network conference participant terminal, it occupies the bandwidth resources in the visual network; When it is determined that the remaining bandwidth in the network conference is insufficient to support the current bit rate of the Internet participating terminal, the traffic audit server sends a bit rate adjustment instruction to the coordination server, and the coordination server sends the bit rate adjustment instruction to the Internet participating terminal through a virtual terminal, so as to control the Internet participating terminal to adjust its own current bit rate through the visual network; wherein the traffic audit server and the coordination server join the visual network by registering on the visual network server, the traffic audit server is used to audit the data traffic size of the audio and video of the visual network participating terminal in the network conference, and dynamically set and manage the bandwidth occupied by the network conference, and the virtual terminal is used to receive data sent by the Internet participating terminal, and forward data to the Internet participating terminal.

2. The method according to claim 1, characterized in that Determining whether to adjust the bit rate of the Internet conference participant terminal according to a bandwidth threshold value corresponding to the network conference preset in the visual network and a size relationship between the current bit rate of the Internet conference participant terminal and the current bit rate of the visual network conference participant terminal in the network conference includes: When the bandwidth occupied by the sum of the current bit rate of the Internet conference participant terminal and the current bit rate of the visual network conference participant terminal does not exceed the bandwidth threshold, and the current bit rate of the Internet conference participant terminal is greater than the current bit rate of the visual network conference participant terminal, determine to reduce the bit rate of the Internet conference participant terminal; When the bandwidth occupied by the sum of the current bit rate of the Internet conference terminal and the current bit rate of the visual network conference terminal does not exceed the bandwidth threshold, and the current bit rate of the Internet conference terminal is less than the current bit rate of the visual network conference terminal, determine to increase the bit rate of the Internet conference terminal.

3. The method according to claim 1, characterized in that The method further comprises: Determining whether to adjust the bit rate of the visual network conference terminal according to the bandwidth threshold and the current bit rate of the visual network conference terminal; When it is determined to adjust the bit rate of the visual network conference participating terminal, the bit rate of the visual network conference participating terminal is adjusted.

4. The method according to claim 1, characterized in that: In the case of determining to adjust the bit rate of the Internet conference participant terminal, controlling the Internet conference participant terminal to adjust its current bit rate through the visual network includes: Requesting a bit rate modification permission from a GK server in the Internet for managing the Internet conference terminal, wherein the GK server is used to determine whether to allow the Internet conference terminal to adjust the bit rate according to its own preset bandwidth threshold; In response to the modification consent instruction returned by the GK server, the Internet conference participant terminal is controlled to adjust its current bit rate.

5. The method according to claim 1, characterized in that Controlling the Internet conference participant terminal to adjust its current bit rate through the visual network includes: A rate modification signaling that complies with the RAS protocol in the H323 protocol cluster is sent to the Internet conference participant terminal, so that the Internet conference participant terminal adjusts its current rate to the rate in the rate modification signaling.

6. The method according to claim 1, characterized in that Reading the current bit rate of the Internet conference terminal located in the Internet includes: Determining a virtual terminal bound to the Internet conference participating terminal; The current bit rate of the Internet conference participating terminal is determined according to the audio and video data sent by the Internet conference participating terminal and received by the virtual terminal.

7. A device for controlling the bit rate of a conference terminal based on a visual network, characterized in that: Applied to a traffic audit management system, the traffic audit management system includes a traffic audit server and a coordination server, and the device includes: A reading module, used for reading the current bit rate of an Internet conference participant terminal located in the Internet during a network conference held between the visual network and the Internet; A determination module, for determining whether the remaining bandwidth in the network conference can bear the current bit rate of the Internet conference terminal according to the bandwidth threshold value corresponding to the network conference preset in the visual network and the size relationship between the current bit rate of the Internet conference terminal and the current bit rate of the visual network conference terminal in the network conference, so as to determine whether to adjust the bit rate of the Internet conference terminal; wherein the Internet conference terminal occupies the bandwidth resources in the visual network when performing audio and video interaction with the visual network conference terminal; An adjustment module is used to send a bit rate adjustment instruction to the coordination server through the traffic audit server when it is determined that the remaining bandwidth in the network conference is insufficient to bear the current bit rate of the Internet participating terminal, and use the coordination server to send the bit rate adjustment instruction to the Internet participating terminal through a virtual terminal, so as to control the Internet participating terminal to adjust its own current bit rate through the visual network; wherein the traffic audit server and the coordination server join the visual network by registering on the visual network server, the traffic audit server is used to audit the data flow size of the audio and video of the visual network participating terminal in the network conference, and dynamically set and manage the bandwidth occupied by the network conference, and the virtual terminal is used to receive data sent by the Internet participating terminal, and forward data to the Internet participating terminal.

8. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes, the method for controlling the bit rate of a conference participant terminal based on a visual network is implemented.

9. A computer-readable storage medium, characterized in that: The computer program stored therein enables the processor to execute the method for controlling the bit rate of a conference participant terminal based on visual networking as described in any one of claims 1-6.