Video conference system and control method thereof

Abstract

The invention discloses a video conference system and a control method thereof. The video conference system comprises a signaling server, an interactive media server cascade group, a onlooker media server and a terminal, the terminal comprises an interaction terminal and a onlooks terminal; the interactive media server cascade group adopts a master-slave mechanism, establishes an audio and video transceiving channel with the interactive terminal, and uses an SFU forwarding mechanism; the onlooker media server uses an MCU mechanism, establishes a sound and video receiving channel with the interactive media server cascade group, and establishes a sound and video receiving channel with the onlooker terminal; and the signaling server establishes a control channel with the signaling server when each terminal participates in the conference to carry out signaling interaction, and also carries out signaling interaction with each media server and the onlooker media server in the interactive media server cascade group. According to the invention, the SFU server and the MCU server are reasonably deployed, and the load pressure of the SFU is effectively reduced on the premise of ensuring the real-time performance of interaction.

Description

Technical Field

[0001] The present invention relates to the technical field of video conferencing, and more particularly, to a video conferencing system and a control method thereof. Background Art

[0002] With the rapid development of network technology, communication technology and streaming media technology, as well as the increasing mobility of people's work and study, the demand for video communication from enterprises and individuals is increasing, and audio and video conferencing systems have come into being.

[0003] In the prior art, there are two types of video conferencing systems: MCU and SFU. The SFU has good real-time interactive effects, but its disadvantage is also obvious - high bandwidth occupancy. Assuming that there are n participants in the meeting, and the bandwidth occupied by one audio and video is A, then the forwarding bandwidth consumed is n*(n-1)*A. Relatively speaking, the bandwidth occupied by the MCU is only n*A, and the bandwidth occupancy is lower. However, the disadvantage of the MCU is also obvious, and the delay is relatively large.

[0004] Therefore, in medium and large-scale video conferencing, using MCU or SFU alone cannot meet the requirements of video conferencing well. Summary of the invention

[0005] In order to solve the problem of realizing more efficient and real-time medium and large-scale video conferences, the present invention provides a video conference scheduling method and device, and the technical solution adopted by the present invention is as follows.

[0006] In a first aspect, the present invention provides a video conferencing system, comprising: a signaling server, a cascade group of interactive media servers, a spectator media server, and a terminal;

[0007] The terminals include: interactive terminals and spectator terminals, the spectator terminals can only receive audio and video, and the interactive terminals can both push and receive audio and video;

[0008] The interactive media server cascade group adopts a master-slave mechanism to establish an audio and video receiving and sending channel with the interactive terminal, and uses an SFU forwarding mechanism to receive and forward the audio and video data of the interactive terminal connected to it;

[0009] The spectator media server uses the MCU mechanism to establish a receiving and audio / video channel with the interactive media server cascade group, and to establish a receiving and audio / video channel with the spectator terminal, to receive the audio / video data forwarded by the main interactive media server and to forward the received audio / video data to the spectator terminal;

[0010] The signaling server establishes a control channel with the signaling server when each terminal joins the conference to perform signaling interaction;

[0011] The signaling server also performs signaling interaction with each media server and the spectator media server in the interactive media server cascade group.

[0012] In one implementation, the spectator media server establishes a sound and receive video channel with a main interactive media server in the interactive media server cascade group.

[0013] In one implementation, the spectator media server decodes the received audio and video and merges them into one picture, and forwards the merged picture to each spectator terminal.

[0014] In a second aspect, the present invention provides a method for controlling a video conference, wherein the video conference adopts the aforementioned video conference system, and the control method is applied in a signaling server of the video conference system, and the control method comprises:

[0015] Receiving a joining request from a terminal to join a conference, and obtaining a weight of the terminal to join the conference;

[0016] When the weight of the terminal to be admitted is lower than a preset weight threshold, the terminal is defined as a pending spectator terminal;

[0017] Acquire a first carrying capacity of the interactive media server cascade group, wherein the first carrying capacity is the carrying capacity of the terminal to join the conference at the time of joining the conference;

[0018] When the first carrying capacity is lower than a preset first carrying capacity threshold, the pending spectator terminal is enabled to establish a video channel for sound and reception with the interactive media server cascade group.

[0019] In one embodiment, it further includes:

[0020] When the first carrying capacity is not lower than a preset first carrying capacity threshold, the pending spectator terminal is enabled to establish an audio and video channel with the spectator media server.

[0021] In one embodiment, it further includes:

[0022] Continuously monitoring the carrying capacity of the interactive media server cascade group to obtain a second carrying capacity;

[0023] When the second carrying capacity is not lower than a preset second carrying capacity threshold, if there are pending spectator terminals that are to establish audio and video transmission channels with the interactive media server cascade group, one or more of the pending spectator terminals are disconnected from their audio and video transmission and reception links with the interactive media server cascade group, and are allowed to establish audio and video transmission channels with the spectator media server.

[0024] In one embodiment, the interactive terminal includes: a first interactive terminal and a second interactive terminal, the first interactive terminal having a higher weight than the second interactive terminal;

[0025] The control method further comprises:

[0026] When a spectator terminal needs to be switched to an interactive terminal, if the third carrying capacity of the interactive media server cascade group is not less than a preset third carrying capacity threshold, a terminal is selected from the second interactive terminals as a replaced terminal, and the audio and video transceiver link between the replaced terminal and the interactive media server cascade group is disconnected, so that the replaced terminal establishes an audio and video channel with the spectator media server; wherein the third carrying capacity is the carrying capacity at the moment when the spectator terminal needs to be switched to an interactive terminal;

[0027] The spectator terminal that needs to be switched to an interactive terminal is connected to the audio and video channel of the interactive media server cascade group, and the audio and video receiving link between the spectator terminal and the spectator media server is disconnected.

[0028] In one implementation, the process of selecting a terminal from the second interactive terminals as a replaced terminal includes:

[0029] According to the number of speeches of each second interactive terminal and the most recent speech time, a second interactive terminal is selected as the terminal to be replaced.

[0030] In one embodiment, it further includes:

[0031] When a spectator terminal needs to switch to an interactive terminal, if the third carrying capacity of the interactive media server cascade group is lower than the preset third carrying capacity threshold, the terminal that needs to switch to the interactive terminal is connected to the audio and video channel of the interactive media server cascade group, and its audio and video receiving link with the spectator media server is disconnected.

[0032] In a third aspect, the present invention provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the above-mentioned methods when executing the program.

[0033] In a fourth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the method of any of the above-mentioned embodiments.

[0034] In the present invention, according to the special features of medium and large conferences: few speakers and many listeners, the conference is reasonably organized, and the conference terminals are classified by roles, and the terminals corresponding to the users who need to speak are determined as interactive terminals, and the terminals corresponding to the users who do not need to speak and only watch the conference are determined as spectator terminals; in addition, according to the needs of audio and video sent and received by different roles, two types of servers, SFU and MCU, are reasonably deployed, wherein the SFU service is used to forward audio and video with a limited number of channels to ensure the interactive effect under reasonable bandwidth pressure, and the MCU is used to receive the pictures from the SFU, which can be forwarded to the spectator terminals after decoding, merging and re-encoding, so that the load pressure of the SFU can be effectively reduced under the premise of ensuring the real-time interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 It is a schematic diagram of the overall structure of the first embodiment of the present invention.

[0036] Figure 2 It is a flow chart of an implementation method of the second embodiment of the present invention. DETAILED DESCRIPTION

[0037] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0038] It should be noted that the terms "first\second\..." involved in the embodiments of the present invention are only used to distinguish similar objects, and do not represent a specific order for the objects. It is understandable that the specific order or sequence of "first\second\..." can be interchanged where permitted. It should be understood that the objects distinguished by "first\second\..." can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein.

[0039] Embodiment 1

[0040] like Figure 1 As shown, Figure 1It is a schematic diagram of the overall structure of the video conferencing system of the present invention. A video conferencing system includes: a signaling server (SignalServer), an interactive media server cascade group (MediaServer), a viewing media server (ViewerServer), and a terminal. A conference needs to carry 100 to 1000 terminals. When the terminals join the conference, the conference terminals can be divided into interactive terminals (Interactor) that can directly participate in the interaction, that is, can both push and receive audio and video, and viewing terminals (Viewer) that can only watch audio and video.

[0041] In video conferencing, there are two types: MCU and SFU: SFU (Selective Forwarding Unit) is the abbreviation of Selective Forwarding Unit. It is a relatively new video conferencing technology mainly used in WebRTC (Web Real-Time Communications) applications. SFU acts as an intermediate node, which receives video and audio streams from one or more sources and can selectively forward these streams to other participants, but does not mix or process the streams. The main advantage of SFU is that it can reduce latency and improve scalability because it does not need to process all streams, but simply forwards the selected streams; MCU (Multipoint Control Unit) is the abbreviation of multipoint control unit. It acts as a central node in the video conferencing system and is responsible for handling the mixing, switching and routing of multiple video and audio streams. MCU allows multiple participants to join the same conference and can merge their video and audio signals so that all participants can see and hear each other. MCU is a key component for implementing many-to-many communication. It supports large-scale video conferencing and can process multiple video sources and distribute them to multiple destinations.

[0042] like Figure 1 As shown, the interactive media server cascade cluster adopts a master-slave mechanism, generally including a master media server and a slave media server connected to the master media server. The interactive media server cascade cluster uses a forwarding (SFU) mechanism to establish an audio and video receiving and sending channel with the interactive terminal, and receives and forwards the audio and video data of the interactive terminal connected to it.

[0043] At the same time, the observer media server uses the MCU mechanism as the central node in the video conferencing system, establishes an audio and video channel with the interactive media server cascade group, establishes an audio and video channel with the observer terminal, receives the audio and video data forwarded by the main interactive media server, and forwards the received audio and video data to the observer terminal.

[0044] Preferably, the spectator media server establishes a sound and receive video channel with a main interactive media server in the interactive media server cascade group.

[0045] Preferably, the spectator media server decodes and merges the received audio and video into one picture, and forwards the merged picture to each spectator terminal.

[0046] Each terminal establishes a control channel with the signaling server to interact with the signaling server when joining the conference. The interactive terminal establishes an audio and video receiving channel with the server in the interactive media server cascade group, and the spectator terminal establishes an audio and video receiving channel with the spectator media server. Figure 1 As shown, the interactive terminal can be connected to a master media server in the interactive media server cascade group, and can also be connected to a slave media server.

[0047] At the same time, the signaling server also performs signaling interaction with each media server and the spectator media server in the interactive media server cascade group.

[0048] In practice, medium and large conferences have special features: few people speak, but many listen. According to the 80 / 20 rule and practical experience, at a certain moment in the meeting, only about 20% (or less, if there are too many people speaking at the same time, it may be difficult to hear clearly) of the participants need to speak, and about 80% of the participants only need to watch the audio and video of others for most of the time. According to the above characteristics, the present invention organizes the meeting reasonably, classifies the conference terminals by roles, and divides them into terminals corresponding to users who need to speak as interactive terminals, and terminals corresponding to users who do not need to speak and only watch the meeting as spectator terminals; in addition, according to the needs of audio and video sent and received by different roles, two types of servers, SFU and MCU, are reasonably deployed, wherein the SFU service is used to forward audio and video with a limited number of channels to ensure the interactive effect under reasonable bandwidth pressure, and the MCU is used to receive the pictures from the SFU, which can be forwarded to the spectator terminal after decoding, merging and re-encoding, so that the load pressure of the SFU can be effectively reduced under the premise of ensuring the real-time interaction.

[0049] In addition, in the present invention, all conference participants establish a long link with the signaling server to send and receive control signals in real time. The interactive terminal only establishes an audio and video receiving channel with the media server, and the spectator terminal only establishes an audio and video receiving channel with the spectator server. The media server can establish a cluster according to the actual load situation, and a master media server can lead multiple slave media servers. However, in order to ensure the delay, the spectator server only establishes an audio and video receiving channel with the master media server.

[0050] Embodiment 2

[0051] See also Figure 2 , Figure 2The flowchart of a method for controlling a video conference provided in the second embodiment of the present invention is a flowchart of a method for controlling a video conference. The video conference adopts the system for controlling a video conference as described in the first embodiment. The method for controlling a video conference is applied in a signaling server of the system for controlling a video conference. The method comprises: step S110, step S120, step S130 and step S140. It should be noted that step S110, step S120, step S130 and step S140 are merely reference numerals for the purpose of clearly explaining the embodiment and the appendix. Figure 1 The corresponding relationship does not limit the order of the steps in this embodiment.

[0052] Step S110, receiving a joining request from a terminal to join the conference, and obtaining a weight of the terminal to join the conference;

[0053] Step S120, when the weight of the terminal to join the conference is lower than a preset weight threshold, define it as a pending spectator terminal;

[0054] Step S130, obtaining a first carrying capacity of the interactive media server cascade group, wherein the first carrying capacity is the carrying capacity of the terminal to join the conference at the time of joining the conference;

[0055] Step S140: when the first carrying capacity is lower than a preset first carrying capacity threshold, the pending spectator terminal is instructed to establish a video channel for receiving and emitting sound with the interactive media server cascade group.

[0056] In this method, each terminal is given a weight, and the interactive terminal has a higher weight, while the spectator terminal has a lower weight. Therefore, in step S110, when a terminal's request to join a meeting is received, the weight of the terminal requesting to join the meeting is immediately obtained. When the weight is lower than the preset weight threshold, it is defined as a spectator terminal, and when the weight is not lower than the preset weight threshold, it is defined as an interactive terminal.

[0057] For interactive terminals, they must be connected to the interactive media server cascade group, but for spectator terminals, they do not have to be connected to the spectator media server, so step S130 first obtains the current carrying capacity of the interactive media server cascade group, and step S140 determines whether the current carrying capacity is greater than a preset first carrying capacity threshold. When the load of the interactive media server is low, the spectator terminal automatically becomes an interactor and establishes a video channel for receiving and sending audio and video with the interactive media server.

[0058] This allows as many terminals as possible to interact during the meeting as long as the interactive media server can bear the load.

[0059] In one implementation, the method for controlling a video conference further includes: step S150.

[0060] Step S150: when the first carrying capacity is not lower than a preset first carrying capacity threshold, the pending spectator terminal is instructed to establish an audio and video channel with the spectator media server.

[0061] This implementation mode is that when the load of the interactive media server is high, the spectator terminal can only establish an audio and video channel with the spectator media server according to the original plan.

[0062] In one implementation, the method for controlling a video conference further includes: step S160 and step S170.

[0063] Step S160, continuously monitoring the carrying capacity of the interactive media server cascade group to obtain a second carrying capacity;

[0064] Step S170, when the second carrying capacity is not less than a preset second carrying capacity threshold, if there are pending spectator terminals that are to establish audio and video transmission channels with the interactive media server cascade group, one or more of the pending spectator terminals are disconnected from their audio and video transmission and reception links with the interactive media server cascade group, and are allowed to establish audio and video transmission channels with the spectator media server.

[0065] Even if the pending spectator terminal is connected to the audio and video transceiver link of the interactive media server cascade group, it is a terminal with a low weight and should not be connected to the interactive media server cascade group for a long time, occupying the position of other interactive terminals with higher weights. Therefore, in this embodiment, a second carrying capacity threshold is set, and the second carrying capacity threshold can be the same as the first carrying capacity threshold or different. When the carrying capacity of the interactive media server cascade group is continuously monitored to reach or even exceed the second carrying capacity threshold, the pending spectator terminal should make room for the interactive terminal with a higher weight.

[0066] In one embodiment, the interactive terminal includes: a first interactive terminal and a second interactive terminal, the first interactive terminal having a higher weight than the second interactive terminal;

[0067] The video conference control method further includes: step S210 and step S220.

[0068] Step S210, when a spectator terminal needs to be switched to an interactive terminal, if the third carrying capacity of the interactive media server cascade group is not lower than a preset third carrying capacity threshold, a terminal is selected from the second interactive terminals as a replaced terminal, and the audio and video transceiver link between the replaced terminal and the interactive media server cascade group is disconnected, so that the replaced terminal establishes an audio and video channel with the spectator media server; wherein the third carrying capacity is the carrying capacity at the moment when the spectator terminal needs to be switched to an interactive terminal;

[0069] Step S220: The spectator terminal that needs to be switched to an interactive terminal is connected to the audio and video channel of the interactive media server cascade group, and its audio and video receiving link with the spectator media server is disconnected.

[0070] First, this embodiment divides the interactive terminals into two categories: first interactive terminals and second interactive terminals. The weight of the first interactive terminal is higher than that of the second interactive terminal. The first interactive terminal is an interactive terminal used by more important people, that is, an interactive terminal that must be kept, such as an interactive terminal used by the host, leader or other important people in the meeting. The second interactive terminal is an interactive terminal with a lower weight and can be replaced.

[0071] During the meeting, if the organizer interacts with a bystander A, its role will be switched to an interactive party. If the load of the interactive media server is relatively high (reaching a certain threshold), a low-weight and least active (least recently spoken) interactive party B will be switched to a bystander, that is, its audio and video receiving link with the interactive media server will be disconnected, and it will be notified to establish an audio and video receiving link with the bystander media server; then, bystander A will be allowed to connect to the audio and video of the interactive media server, and its audio and video receiving link with the bystander media server will be disconnected.

[0072] In the present invention, since all conference participants establish a long-link link with the signaling server, the role switching between the spectator and the interactor only requires disconnecting the audio and video data channel with a certain media server, and then establishing an audio and video channel with another server, without disconnecting the control channel with the signaling server, and without having to perform operations such as handshakes, thereby simplifying the switching steps. In the present embodiment, the terminal disconnects the audio and video channel with the media service or spectator server during the role switching process, which can reduce its load. Maintaining the connection with the signaling server for a long time is conducive to quickly switching roles while keeping the signaling server under low load.

[0073] In one implementation, the process of selecting a terminal from the second interactive terminals as a replaced terminal includes:

[0074] According to the number of speeches of each second interactive terminal and the most recent speech time, a second interactive terminal is selected as the terminal to be replaced.

[0075] This implementation uses the number of speeches and the most recent speech time as factors, and finds a second interactive terminal with the lowest activity as the terminal to be replaced according to a preset model.

[0076] In one implementation, the method for controlling a video conference further includes: step S230.

[0077] Step S230, when a spectator terminal needs to switch to an interactive terminal, if the third bearing capacity of the interactive media server cascade group is lower than the preset third bearing capacity threshold, the terminal that needs to switch to the interactive terminal is connected to the audio and video channel of the interactive media server cascade group, and the audio and video receiving link between the terminal and the spectator media server is disconnected.

[0078] In this implementation, when a spectator terminal needs to be switched to an interactive terminal, if the load of the interactive media server is not high, it is directly connected to the interactive media server cascade group without finding a second interactive terminal as the replaced terminal.

[0079] Embodiment 3

[0080] An embodiment of the present invention further provides a storage medium on which computer instructions are stored. When the instructions are executed by a processor, the video conference control method of any of the above embodiments is implemented.

[0081] Those skilled in the art can understand that: all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiments; and the aforementioned storage medium includes: mobile storage devices, random access memories (RAM), read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0082] Alternatively, if the above-mentioned integrated unit of the present invention is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present invention can be essentially or partly reflected in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, terminal, or network device, etc.) to execute all or part of the methods of each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, RAM, ROM, magnetic disks or optical disks.

[0083] Corresponding to the above-mentioned computer storage medium, in one embodiment, a computer device is also provided, which includes a memory, an encoder, and a computer program stored in the memory and executable on the encoder, wherein when the encoder executes the program, a video conference control method as described in any one of the above-mentioned embodiments is implemented.

[0084] The above computer equipment has special features in practice: few people speak and many people listen. According to the 80 / 20 rule and practical experience, at a certain moment in the meeting, only about 20% (or less, if there are too many people speaking at the same time, it may not be heard clearly) of the participants need to speak, and about 80% of the participants only need to watch the audio and video of others for most of the time. According to the above characteristics, the present invention organizes the meeting reasonably, classifies the conference terminals by roles, and divides them into terminals corresponding to users who need to speak as interactive terminals, and terminals corresponding to users who do not need to speak and only watch the meeting as spectator terminals; in addition, according to the needs of audio and video sent and received by different roles, two types of servers, SFU and MCU, are reasonably deployed, wherein the SFU service is used to forward audio and video with a limited number of channels to ensure the interactive effect under reasonable bandwidth pressure, and the MCU is used to receive the pictures from the SFU, which can be forwarded to the spectator terminal after decoding, merging and re-encoding, so that the load pressure of the SFU can be effectively reduced under the premise of ensuring the real-time interaction.

[0085] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0086] Obviously, the above embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention. For those skilled in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to list all the embodiments here. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the claims of the present invention.

Claims

1. A video conferencing system, characterized in that: include: Signaling server, interactive media server cascade group, spectator media server, terminal; The terminals include: interactive terminals and spectator terminals, the spectator terminals can only receive audio and video, and the interactive terminals can both push and receive audio and video; The interactive media server cascade group adopts a master-slave mechanism to establish an audio and video receiving and sending channel with the interactive terminal, and uses an SFU forwarding mechanism to receive and forward the audio and video data of the interactive terminal connected to it; The spectator media server uses the MCU mechanism to establish a receiving and audio / video channel with the interactive media server cascade group, and to establish a receiving and audio / video channel with the spectator terminal, to receive the audio / video data forwarded by the main interactive media server and to forward the received audio / video data to the spectator terminal; The signaling server establishes a control channel with the signaling server when each terminal joins the conference to perform signaling interaction; The signaling server also performs signaling interaction with each media server and the spectator media server in the interactive media server cascade group.

2. The video conferencing system according to claim 1, characterized in that: The spectator media server establishes a sound and receive video channel with a main interactive media server in the interactive media server cascade group.

3. The video conferencing system according to claim 1, characterized in that: The spectator media server decodes the received audio and video and combines them into one picture, and forwards the combined picture to each spectator terminal.

4. A method for controlling a video conference, characterized in that: The video conference uses the video conference system as described in claims 1-3, and the control method is applied in a signaling server of the video conference system, and the control method includes: Receiving a joining request from a terminal to join a conference, and obtaining a weight of the terminal to join the conference; When the weight of the terminal to be admitted is lower than a preset weight threshold, the terminal is defined as a pending spectator terminal; Acquire a first carrying capacity of the interactive media server cascade group, wherein the first carrying capacity is the carrying capacity of the terminal to join the conference at the time of joining the conference; When the first carrying capacity is lower than a preset first carrying capacity threshold, the pending spectator terminal is enabled to establish a video channel for receiving and emitting sound with the interactive media server cascade group.

5. The video conference control method according to claim 4, characterized in that: Also includes: When the first carrying capacity is not lower than a preset first carrying capacity threshold, the pending spectator terminal is enabled to establish an audio and video channel with the spectator media server.

6. The video conference control method according to claim 4, characterized in that: Also includes: Continuously monitoring the carrying capacity of the interactive media server cascade group to obtain a second carrying capacity; When the second carrying capacity is not lower than a preset second carrying capacity threshold, if there are pending spectator terminals that are to establish audio and video transmission channels with the interactive media server cascade group, one or more of the pending spectator terminals are disconnected from their audio and video transmission and reception links with the interactive media server cascade group, and are allowed to establish audio and video transmission channels with the spectator media server.

7. The video conference control method according to claim 4, characterized in that: The interactive terminal includes: a first interactive terminal and a second interactive terminal, and the weight of the first interactive terminal is higher than that of the second interactive terminal; The control method further comprises: When a spectator terminal needs to be switched to an interactive terminal, if the third carrying capacity of the interactive media server cascade group is not less than a preset third carrying capacity threshold, a terminal is selected from the second interactive terminals as a replaced terminal, and the audio and video transceiver link between the replaced terminal and the interactive media server cascade group is disconnected, so that the replaced terminal establishes an audio and video channel with the spectator media server; wherein the third carrying capacity is the carrying capacity at the moment when the spectator terminal needs to be switched to an interactive terminal; The spectator terminal that needs to be switched to an interactive terminal is connected to the audio and video channel of the interactive media server cascade group, and the audio and video receiving link between the spectator terminal and the spectator media server is disconnected.

8. The method for controlling a video conference according to claim 7, characterized in that: The process of selecting a terminal to be replaced from the second interactive terminals includes: According to the number of speeches of each second interactive terminal and the most recent speech time, a second interactive terminal is selected as the terminal to be replaced.

9. The video conference control method according to claim 7, characterized in that: Also includes: When a spectator terminal needs to switch to an interactive terminal, if the third carrying capacity of the interactive media server cascade group is lower than the preset third carrying capacity threshold, the terminal that needs to switch to the interactive terminal is connected to the audio and video channel of the interactive media server cascade group, and its audio and video receiving link with the spectator media server is disconnected.

10. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 4 to 9 is implemented.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 4 to 9 is implemented.

Images