Video conference processing method and system, electronic equipment and storage medium

By analyzing and managing the polling information of the monitored terminal on the conference management server and dynamically adjusting the terminal list, the flexibility and adaptability of the video conferencing system are improved, and multi-list monitoring is supported, which solves the display of monitored terminals in the existing technology in the existing technology The problem of insufficient flexibility.

CN119071545APending Publication Date: 2024-12-03VISIONVERA INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410992667.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-23
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

In the existing video conferencing system, when the monitoring terminal polls and displays video streams of multiple conference terminals, it lacks flexibility and adaptability, and cannot meet the requirement of monitoring the list of multiple conference terminals at the same time.

Method used

By reading and parsing the polling information of the monitor terminal on the conference management server, dynamically manage the terminal list information corresponding to each decoding channel, and streaming the video to each decoding channel, so that the monitor terminal can be at least two Under the polling mechanism, split-screen polling displays video streams of multiple different terminal lists.

Benefits of technology

It improves the flexibility and adaptability of the video conferencing system, supports multi-list monitoring, simplifies the operation of the monitoring terminal, optimizes resource utilization efficiency, and meets more complex monitoring needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071545A_ABST
    Figure CN119071545A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a method and a system for processing a video conference, which are applied to a conference management server, and the method comprises the following steps: reading polling information of a broadcast monitoring terminal; terminal list information corresponding to each decoding channel of the broadcast monitoring terminal under at least two polling mechanisms is analyzed from the polling information; and transmitting a video stream of a video conference to each decoding channel according to the terminal list information, so that the broadcast monitoring terminal polls and displays the video stream. According to the embodiment of the invention, through centralized management of the polling information and dynamic adjustment of the terminal list, the flexibility, adaptability and real-time performance of the video conference system are improved, multi-list monitoring is supported, the operation of the monitoring terminal is simplified, and the resource utilization efficiency is optimized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of video conferencing, and in particular to a method for processing a video conferencing, a system for processing a video conferencing, an electronic device, and a computer-readable storage medium. Background Art

[0002] In the current video conferencing system, the monitoring terminal is an important management tool used to monitor and display the video streams of multiple conference terminals in real time. One of the main functions of the monitoring terminal is polling display, that is, through timed switching, the video streams of multiple conference terminals are displayed on the screen of the monitoring terminal in turn, so that the monitoring personnel can effectively monitor the status of each conference terminal.

[0003] Monitoring terminals usually use split-screen mode for polling display. The monitoring terminal divides the screen into multiple areas, and each area displays the video streams of different conference terminals in turn. However, no matter which area is polled for display, it can only display the video streams of conference terminals in the unified terminal list, which reduces the flexibility and adaptability of the monitoring terminal and cannot meet the needs of monitoring multiple conference terminal lists at the same time. Summary of the invention

[0004] In view of the above problems, embodiments of the present invention are proposed to provide a method for processing a video conference, a processing system for a video conference, an electronic device, and a computer-readable storage medium that overcome the above problems or at least partially solve the above problems.

[0005] In order to solve the above problems, an embodiment of the present invention discloses a method for processing a video conference, which is applied to a conference management server, and the method includes: reading out polling information of a monitoring terminal; parsing terminal list information corresponding to each decoding channel of the monitoring terminal under at least two polling mechanisms from the polling information; transmitting the video stream of the video conference to each decoding channel according to the terminal list information, so that the monitoring terminal polls and displays the video stream.

[0006] Optionally, the reading out the polling information of the monitoring terminal includes: reading out the polling information from a terminal polling container of the conference management server according to a preset period.

[0007] Optionally, reading the polling information from the terminal polling container of the conference management server according to a preset period includes: acquiring terminal identification information of the monitoring terminal; and querying the polling information associated with the terminal identification information in the terminal polling container according to the preset period.

[0008] Optionally, transmitting the video stream of the video conference to each of the decoding channels according to the terminal list information so that the monitoring terminal polls and displays the video stream, includes: parsing the polling terminal list information and polling cursor information of the monitoring terminal under at least two of the polling mechanisms from the polling information, the polling terminal list information including the decoding information of each of the decoding channels, and the polling cursor information indicating the conference terminal information corresponding to the video stream to be polled and displayed; transmitting the video stream to each of the decoding channels according to the terminal list information, the polling terminal list information and the polling cursor information, so that the monitoring terminal polls and displays the video stream.

[0009] Optionally, transmitting the video stream to each of the decoding channels according to the terminal list information, the polling terminal list information and the polling cursor information includes: querying the target conference terminal in the terminal list information according to the polling cursor information; generating a monitoring and streaming switching instruction according to the video stream of the target conference terminal and the polling terminal list information; transmitting the monitoring and streaming switching instruction to the conference operation server, so that the conference operation server transmits the video stream to each of the decoding channels according to the monitoring and streaming switching instruction.

[0010] Optionally, before reading out the polling information of the monitoring terminal, the method further includes: acquiring the polling information from the conference client; and storing the polling information in the terminal polling container.

[0011] Optionally, after transmitting the video stream of the video conference to each decoding channel according to the terminal list information so that the monitoring terminal polls and displays the video stream, the method also includes: obtaining polling end notification information from the conference client; and deleting the polling information from the terminal polling container according to the polling end notification information.

[0012] An embodiment of the present invention also discloses a video conference processing system, which is applied to a conference management server. The system includes: a polling information reading module, which is used to read the polling information of the monitoring terminal; a terminal list parsing module, which is used to parse the terminal list information corresponding to each decoding channel of the monitoring terminal under at least two polling mechanisms from the polling information; and a video stream polling display module, which is used to transmit the video stream of the video conference to each decoding channel according to the terminal list information, so that the monitoring terminal polls and displays the video stream.

[0013] Optionally, the polling information reading module is used to read the polling information from the terminal polling container of the conference management server according to a preset period.

[0014] Optionally, the polling information reading module includes: a terminal identification acquisition module, used to obtain the terminal identification information of the monitoring terminal; and a polling information query module, used to query the polling information associated with the terminal identification information in the terminal polling container according to the preset period.

[0015] Optionally, the video stream polling and display module includes: a polling information parsing module, used to parse the polling information to obtain the polling terminal list information and polling cursor information of the monitoring terminal under at least two of the polling mechanisms, the polling terminal list information includes the decoding information of each of the decoding channels, and the polling cursor information indicates the conference terminal information corresponding to the video stream to be polled and displayed; a video stream transmission module, used to transmit the video stream to each of the decoding channels according to the terminal list information, the polling terminal list information and the polling cursor information, so that the monitoring terminal polls and displays the video stream.

[0016] Optionally, the video stream transmission module includes: a target terminal query module, used to query the target conference terminal in the terminal list information according to the polling cursor information; a monitoring instruction generation module, used to generate a monitoring stream switching instruction according to the video stream of the target conference terminal and the polling terminal list information; a monitoring instruction transmission module, used to transmit the monitoring stream switching instruction to the conference operation server, so that the conference operation server transmits the video stream to each decoding channel according to the monitoring stream switching instruction.

[0017] Optionally, the system further comprises: a polling information acquisition module, used to acquire the polling information from the conference client before the polling information reading module reads the polling information of the monitoring terminal; and a polling information storage module, used to store the polling information in the terminal polling container.

[0018] Optionally, the system also includes: a polling notification acquisition module, which is used to obtain polling end notification information from the conference client after the video stream polling and display module transmits the video stream of the video conference to each decoding channel according to the terminal list information, so that the monitoring terminal polls and displays the video stream; and a polling container update module, which is used to delete the polling information from the terminal polling container according to the polling end notification information.

[0019] An embodiment of the present invention also discloses an electronic device, comprising: one or more processors; and one or more machine-readable media storing instructions thereon, which, when executed by the one or more processors, enables the electronic device to execute the video conference processing method as described above.

[0020] The embodiment of the present invention further discloses a computer-readable storage medium, which stores a computer program that enables a processor to execute the video conference processing method as described above.

[0021] The embodiments of the present invention include the following advantages:

[0022] The video conference processing solution provided by the embodiment of the present invention is applied to a conference management server, which reads the polling information of the monitoring terminal, and then parses the terminal list information corresponding to each decoding channel of the monitoring terminal under at least two polling mechanisms from the polling information. Next, the video stream of the video conference is transmitted to each decoding channel according to the terminal list information, so that the monitoring terminal polls and displays the video stream.

[0023] The conference management server in the embodiment of the present invention is responsible for reading and parsing the polling information of the monitoring terminal, and transmitting the terminal list information corresponding to the decoding channel to the monitoring terminal. This centralized management method simplifies the configuration and operation of the monitoring terminal, and the monitoring terminal no longer needs to process the complex polling logic by itself. By parsing the polling information on the conference management server, the video conferencing system can dynamically adjust the terminal list according to actual needs. This means that the conference terminals to be monitored can be added or removed at any time, which improves the flexibility and adaptability of the video conferencing system. Allowing the monitoring terminal to display the video streams of multiple different terminal lists in split screen polling under at least two polling mechanisms solves the problem that only a unified terminal list can be displayed in the background technology. The monitoring terminal can monitor multiple conference terminal lists at the same time under at least two polling mechanisms, meeting more complex monitoring requirements. Placing the parsing and management of the polling information on the conference management server simplifies the operation and configuration of the monitoring terminal. The monitoring terminal only needs to receive the video stream transmitted by the server, without having to process complex polling and terminal list management logic.

[0024] In summary, the video conferencing processing solution applied to the conference management server improves the flexibility, adaptability and real-time performance of the video conferencing system by centrally managing polling information and dynamically adjusting the terminal list, supports multi-list monitoring, simplifies the operation of the monitoring terminal, and optimizes resource utilization efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 is a flowchart of a method for processing a video conference according to an embodiment of the present invention;

[0026] Figure 2 It is a schematic diagram of the principle of a dual polling solution of five-channel monitoring terminals based on a visual network according to an embodiment of the present invention;

[0027] Figure 3 It is a structural block diagram of a video conference processing system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0028] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0029] The video conference processing solution proposed in the embodiment of the present invention is applied to the conference management server, and the terminal list information corresponding to each decoding channel of the monitoring terminal under at least two polling mechanisms is dynamically managed by reading and parsing the polling information of the monitoring terminal. Then, the conference management server transmits the video stream of the video conference to each decoding channel according to the parsed terminal list information, thereby realizing the polling display of the monitoring terminal. This solution not only improves the flexibility and adaptability of the video conferencing system, enabling the monitoring terminal to monitor multiple conference terminal lists at the same time, but also optimizes the resource utilization efficiency, simplifies the operation of the monitoring terminal, and improves the real-time performance and overall monitoring effect.

[0030] Reference Figure 1 , shows a flowchart of a method for processing a video conference according to an embodiment of the present invention. The method for processing a video conference can be applied to a conference management server, and the method for processing a video conference can specifically include the following steps:

[0031] Step 101, read out the polling information of the monitoring terminal.

[0032] In the embodiment of the present invention, in the video conference system, the conference management server needs to read the polling information of the monitoring terminal. The polling information refers to the detailed data of the monitoring terminal about its polling settings, including the polling time interval, the polled terminal list, the polling order, etc.

[0033] For example, suppose a monitoring terminal of an enterprise sets up a polling scheme to monitor the meeting status of different departments. The polling information may include the following data:

[0034] Time interval: The video stream display time of each conference terminal is 30 seconds.

[0035] Terminal list: including conference terminals of various departments such as sales department, technical department, marketing department, etc.

[0036] Polling order: Poll in the order of sales department -> technical department -> marketing department.

[0037] The conference management server needs to read and record this polling information so that subsequent steps can accurately parse and process the video stream transmission. The process of reading polling information may involve receiving data packets from the monitoring terminal or other terminals, communicating through network protocols, and storing in the server's memory or database.

[0038] Step 102: parse the polling information to obtain terminal list information corresponding to each decoding channel of the monitoring terminal under at least two polling mechanisms.

[0039] In an embodiment of the present invention, after reading the polling information of the monitoring terminal, the next task of the conference management server is to parse the terminal list information corresponding to each decoding channel of the monitoring terminal under at least two polling mechanisms from these polling information. The purpose of this step is to clarify which conference terminal's video streams need to be displayed for each decoding channel, so as to achieve accurate polling display. The polling mechanism can represent the way in which the monitoring terminal displays the video stream on a single screen or split screen. Usually, each polling mechanism can correspond to a terminal list information. For example, the monitoring terminal is divided into a large split screen and four small split screens. Among them, one large split screen corresponds to polling mechanism one; four small split screens correspond to polling mechanism two. Polling mechanism one indicates that a large split screen displays the main video stream of each terminal in turn according to the order of each terminal in terminal list one and at a preset interval. Polling mechanism two indicates that four small split screens display the auxiliary video stream of each terminal in turn according to the order of each terminal in terminal list two and at a preset interval. The polling mechanism can be set according to actual conditions.

[0040] The terminal list information corresponding to each decoding channel includes the number of the decoding channel and its corresponding conference terminal. For example, on a monitoring terminal, there are four decoding channels, and each decoding channel can poll and display different conference terminals. The parsing work needs to determine the specific display content of each decoding channel based on the polling information read.

[0041] For example, decoding channel 1 needs to display the conference terminals of the sales department. Decoding channel 2 needs to poll and display the conference terminals of the sales department and the technical department. Decoding channel 3 needs to poll and display the conference terminals of the technical department and the marketing department. Decoding channel 4 needs to display the conference terminal of the marketing department. Moreover, the conference terminals of each department can exist in the form of a conference terminal list.

[0042] Step 103: Transmit the video stream of the video conference to each decoding channel according to the terminal list information, so that the monitoring terminal polls and displays the video stream.

[0043] In the embodiment of the present invention, after completing the parsing of the terminal list information corresponding to the decoding channel, the conference management server transmits the video stream of the video conference to each decoding channel according to the parsed terminal list information. The purpose of this step is to ensure that the monitoring terminal can accurately display the video stream of each conference terminal according to the predetermined polling order and time interval.

[0044] The conference management server needs to obtain the corresponding video stream from the source according to the parsed terminal list information, and transmit it to each decoding channel of the monitoring terminal through the network. The specific operation process is as follows:

[0045] Video stream acquisition: Get real-time video streams from each conference terminal. The video stream acquisition method may involve requesting the video source and using a specific streaming protocol to obtain video data.

[0046] Video stream transmission: The acquired video stream is transmitted to the corresponding decoding channel according to the parsed terminal list information. The stability and low latency of the video stream need to be ensured during the transmission process to ensure that the monitoring terminal can display the video content in real time.

[0047] Polling control: Control the switching of video streams of each decoding channel according to the time interval and sequence in the polling information. The conference management server needs to set a timer or other mechanism to switch the video stream regularly to achieve the effect of polling display.

[0048] The video conference processing solution provided by the embodiment of the present invention is applied to a conference management server, which reads the polling information of the monitoring terminal, and then parses the terminal list information corresponding to each decoding channel of the monitoring terminal under at least two polling mechanisms from the polling information. Next, the video stream of the video conference is transmitted to each decoding channel according to the terminal list information, so that the monitoring terminal polls and displays the video stream.

[0049] The conference management server in the embodiment of the present invention is responsible for reading and parsing the polling information of the monitoring terminal, and transmitting the terminal list information corresponding to the decoding channel to the monitoring terminal. This centralized management method simplifies the configuration and operation of the monitoring terminal, and the monitoring terminal no longer needs to process the complex polling logic by itself. By parsing the polling information on the conference management server, the video conferencing system can dynamically adjust the terminal list according to actual needs. This means that the conference terminals to be monitored can be added or removed at any time, which improves the flexibility and adaptability of the video conferencing system. Allowing the monitoring terminal to display the video streams of multiple different terminal lists in split screen polling under at least two polling mechanisms solves the problem that only a unified terminal list can be displayed in the background technology. The monitoring terminal can monitor multiple conference terminal lists at the same time under at least two polling mechanisms, meeting more complex monitoring requirements. Placing the parsing and management of the polling information on the conference management server simplifies the operation and configuration of the monitoring terminal. The monitoring terminal only needs to receive the video stream transmitted by the server, without having to process complex polling and terminal list management logic.

[0050] In summary, the video conferencing processing solution applied to the conference management server improves the flexibility, adaptability and real-time performance of the video conferencing system by centrally managing polling information and dynamically adjusting the terminal list, supports multi-list monitoring, simplifies the operation of the monitoring terminal, and optimizes resource utilization efficiency.

[0051] In an exemplary embodiment of the present invention, one implementation method of reading out the polling information of the monitoring terminal is to read out the polling information from the terminal polling container of the conference management server according to a preset period. In the actual application process, the conference management server will maintain a terminal polling container, which stores the polling information of all monitoring terminals in the current video conferencing system. The polling information includes a list of conference terminals that the monitoring terminal needs to poll, a polling time interval, a polling order, etc. In order to ensure the real-time and accuracy of the polling information, the conference management server will read the polling information from the terminal polling container regularly according to a preset time period. Specifically, when the video conferencing system is started, the conference management server will read the initial polling information from the configuration file or other terminals and store it in the terminal polling container. This container will be continuously updated to reflect the current status of the video conferencing system. The conference management server will set a fixed time period, for example, every 10 seconds or 30 seconds, to regularly trigger the reading operation. This time period can be adjusted according to the needs of the video conferencing system and network conditions. At each preset time point, the conference management server will read the current polling information from the terminal polling container. The read operation includes obtaining detailed information such as the polling list, time interval and order of each monitoring terminal. The polling information read will be parsed and processed to ensure the integrity and accuracy of the data. The conference management server will check the data format, verify the validity of the information, and perform necessary error handling.

[0052] For example, suppose an enterprise has multiple conference rooms, each with its own monitoring terminal. The polling information of these monitoring terminals is stored in the terminal polling container of the conference management server. The polling information can indicate that: monitoring terminal MT001 polls once every 20 seconds, and displays the conference video streams of Room1, Room2, and Room3 in turn; monitoring terminal MT002 polls once every 15 seconds, and displays the conference video streams of Room5 and Room4 in turn.

[0053] The conference management server reads the above polling information from the terminal polling container according to the preset 30-second cycle. Specifically, the polling information of the monitoring terminal MT001 can be obtained, and its display order and time interval can be confirmed. The polling information of the monitoring terminal MT002 can be obtained, and its display order and time interval can be confirmed.

[0054] The conference management server verifies the validity of the polling information during the reading operation. For example, it checks whether there are empty or duplicate values ​​in the terminal list to ensure the rationality of the polling order. If a problem is found, the conference management server will record the log and take appropriate error handling measures.

[0055] The embodiment of the present invention periodically reads polling information to ensure that the monitoring terminal always displays according to the latest polling settings, thereby improving the real-time performance and response speed of the video conferencing system. By dynamically reading polling information, the video conferencing system can adjust the polling list and sequence at any time according to actual needs, adapt to different monitoring scenarios, and improve the flexibility of the monitoring terminal. The preset periodic reading operation ensures the consistency of the polling information and avoids display errors caused by untimely updates of the polling information. Regularly reading and verifying polling information can promptly discover and handle errors in the data to ensure the stable operation of the video conferencing system. The centralized management of terminal polling containers simplifies the operating procedures of the video conferencing system, reduces the complexity of manual configuration, and improves overall management efficiency.

[0056] In an exemplary embodiment of the present invention, one implementation method of reading polling information from a terminal polling container of a conference management server according to a preset period is to obtain the terminal identification information of the monitoring terminal; and query the polling information associated with the terminal identification information in the terminal polling container according to the preset period. In actual application, when the video conference system is initialized or the monitoring terminal is registered, the conference management server will obtain and record the unique identification information (such as terminal ID) of all monitoring terminals. These identification information are used to query the associated polling information in the terminal polling container. The conference management server will set a fixed time period (such as every 10 seconds or 30 seconds) to regularly trigger the reading operation of the polling information. This time period can be adjusted according to actual needs and system conditions to ensure the balance between the real-time reading of the polling information and the system performance. According to the preset period, the conference management server will query the polling information associated with each monitoring terminal identification information in the terminal polling container. The terminal polling container stores the polling information of all monitoring terminals in the current video conference system, including the list of conference terminals that need to be polled, the polling time interval, and the polling order. The polling information read needs to be parsed and verified to ensure the integrity and validity of the data. The conference management server will check the format and content of the polling information, verify the validity of the terminal list and the rationality of the polling order, and perform necessary error handling.

[0057] For example, suppose that in an enterprise's video conferencing system, there are multiple monitoring terminals used to monitor the meetings of different departments. The conference management server obtains the terminal identification information of each monitoring terminal and queries the relevant polling information in the terminal polling container to ensure that the video conferencing system can be monitored efficiently. When the video conferencing system is initialized, the conference management server records the unique identification information of each monitoring terminal. For example, the identification information of monitoring terminal A is "MT001", and the identification information of monitoring terminal B is "MT002". The conference management server sets a fixed time period, such as triggering a read operation every 20 seconds. Every time the preset 20-second time point is reached, the conference management server will query the terminal polling container for polling information associated with "MT001" and "MT002". Assume that the polling information in the terminal polling container is as follows:

[0058] Polling information of monitoring terminal "MT001": The list of conference terminals displayed includes Room1, Room2, and Room3, and the polling interval is 20 seconds.

[0059] Polling information of monitoring terminal "MT002": The list of conference terminals displayed includes Room4 and Room5, and the polling interval is 30 seconds.

[0060] The conference management server reads and parses the polling information to ensure the integrity and validity of the data. For example, the conference management server verifies whether Room1, Room2, Room3, Room4, and Room5 are valid conference terminals, and checks the rationality of the polling time interval and sequence.

[0061] The embodiment of the present invention reads polling information according to a preset period to ensure that the monitoring terminal always displays according to the latest polling settings, thereby improving the real-time performance and response speed of the video conferencing system. By obtaining the terminal identification information of the monitoring terminal and dynamically querying the relevant polling information, the polling list and sequence can be adjusted at any time according to actual needs to adapt to different monitoring scenarios, thereby improving the flexibility of the monitoring terminal. The preset period reading operation ensures the consistency of the polling information and avoids display errors caused by untimely information updates. Regularly reading and verifying the polling information can timely discover and handle errors in the data to ensure the stable operation of the video conferencing system. Through the associated query of the terminal identification information, the operation process of the video conferencing system is simplified, the complexity of manual configuration is reduced, and the overall management efficiency is improved.

[0062] In an exemplary embodiment of the present invention, according to the terminal list information, the video stream of the video conference is transmitted to each decoding channel, so that the monitoring terminal polls and displays the video stream. One implementation method is to parse the polling terminal list information and polling cursor information of the monitoring terminal under at least two polling mechanisms from the polling information. The polling terminal list information contains the decoding information of each decoding channel, and the polling cursor information indicates the conference terminal information corresponding to the video stream to be polled and displayed; according to the terminal list information, the polling terminal list information and the polling cursor information, the video stream is transmitted to each decoding channel, so that the monitoring terminal polls and displays the video stream.

[0063] In actual application, the polling information read by the conference management server includes polling terminal list information and polling cursor information. Among them, the polling terminal list information contains detailed decoding information of each decoding channel, such as the IP address, port number, supported encoding format, etc. of the decoder. This information ensures that the video stream can be correctly transmitted to the corresponding decoding channel. The polling cursor information indicates the conference terminal information corresponding to the video stream to be polled and displayed, that is, the specific conference terminal currently polled and its related identification information, such as terminal ID, conference room number, etc. According to the terminal list information, polling terminal list information and polling cursor information, the corresponding video stream is transmitted to each decoding channel. The terminal list information determines the conference terminal to be polled and lists all the terminal information to be polled. The polling terminal list information provides specific decoding channel information to ensure that the video stream can be correctly decoded and displayed. The polling cursor information indicates the current polling position to ensure that the video stream is displayed in a predetermined order. The decoded video stream is transmitted to the monitoring terminal through the decoding channel. The monitoring terminal displays the video streams of each conference terminal in turn according to the polling cursor information.

[0064] For example, suppose there are three conference terminals and one monitoring terminal in a video conference system. The monitoring terminal needs to poll and display the video streams of the three conference terminals. The polling information read by the conference management server includes the following:

[0065] The polling terminal list information includes decoding information of conference terminals Room1, Room2, and Room3.

[0066] Polling cursor information: Currently pointing to Room1, indicating that the video stream of Room1 needs to be displayed.

[0067] According to the terminal list information, it is determined that the conference terminals that need to be polled are Room1, Room2, and Room3.

[0068] Determine the decoding information of each conference terminal based on the polled terminal list information:

[0069] Room1: Decoding channel 1, IP address 192.168.1.101, port 8001.

[0070] Room2: Decoding channel 2, IP address 192.168.1.102, port 8002.

[0071] Room3: Decoding channel 3, IP address 192.168.1.103, port 8003.

[0072] According to the polling cursor information, the video stream of Room1 is currently transmitted to decoding channel 1. When the polling cursor moves to Room2, the video stream of Room2 is transmitted to decoding channel 2; when it moves to Room3, the video stream of Room3 is transmitted to decoding channel 3. Decoding channel 1 decodes the video stream of Room1 and transmits it to the monitoring terminal for display. After the polling cursor moves to Room2, decoding channel 2 decodes the video stream of Room2 and transmits it to the monitoring terminal for display. After the polling cursor moves to Room3, decoding channel 3 decodes the video stream of Room3 and transmits it to the monitoring terminal for display.

[0073] The embodiment of the present invention parses the polling information and transmits the video stream according to the terminal list information, the polling terminal list information and the polling cursor information. The video conferencing system can respond in real time and flexibly adjust the order and content of the polling display. The detailed decoding information and polling cursor information ensure that the video stream can be accurately transmitted to the corresponding decoding channel, reducing transmission errors and display delays, and improving the stability of the video conferencing system. The transmission process of the video stream is simplified, so that the conference management server can centrally manage and control each decoding channel and monitoring terminal, improving the overall management efficiency.

[0074] In an exemplary embodiment of the present invention, according to the terminal list information, the polling terminal list information and the polling cursor information, an implementation method of transmitting the video stream to each decoding channel is to query the target conference terminal in the terminal list information according to the polling cursor information; generate a monitoring stream switching instruction according to the video stream of the target conference terminal and the polling terminal list information; and transmit the monitoring stream switching instruction to the conference operation server so that the conference operation server transmits the video stream to each decoding channel according to the monitoring stream switching instruction. In the actual application process, according to the polling cursor information, the target conference terminal currently polled is queried in the terminal list information. The polling cursor information includes the identification information of the conference terminal currently required to be displayed, such as the terminal ID or the conference room number. According to the queried video stream information of the target conference terminal and the polling terminal list information, a monitoring stream switching instruction is generated. The monitoring stream switching instruction includes relevant information of the video stream, such as the source address of the video stream, information of the target decoding channel, etc. The generation of the monitoring stream switching instruction needs to take into account the specific requirements and capabilities of each decoding channel to ensure that the video stream can be decoded and displayed as expected. The generated monitoring stream switching instruction is transmitted to the conference operation server. The conference operation server is responsible for receiving and parsing these monitoring and switching instructions, and transmitting the video stream to each decoding channel according to the content of the instructions. During the transmission process, network delay and communication stability need to be considered to ensure that the instructions can be transmitted to the target in a timely and accurate manner.

[0075] For example: Assume that there are three conference terminals (Room1, Room2, Room3) and one monitoring terminal in a video conference system. The monitoring terminal displays the video streams of the three conference terminals in turn according to the polling cursor information. When the polling cursor points to Room1, the video stream information of Room1 is queried according to the polling cursor information. When the polling cursor points to Room2, the video stream information of Room2 is queried. When the polling cursor points to Room3, the video stream information of Room3 is queried. For each queried target conference terminal, a monitoring stream switching instruction is generated according to its video stream information and the polling terminal list information. For example, when the polling cursor points to Room1, a monitoring stream switching instruction is generated to transmit the video stream of Room1 to decoding channel 1. When the polling cursor points to Room2, a monitoring stream switching instruction is generated to transmit the video stream of Room2 to decoding channel 2. When the polling cursor points to Room3, a monitoring stream switching instruction is generated to transmit the video stream of Room3 to decoding channel 3. The generated monitoring stream switching instruction is transmitted to the conference operation server through the network. After receiving the monitoring stream switching instruction, the conference operation server transmits the video stream from the corresponding source address to the corresponding decoding channel according to the instruction content. After receiving the video stream, each decoding channel decodes it and transmits it to the monitoring terminal for display.

[0076] By generating and transmitting monitoring and cutting stream instructions, the embodiment of the present invention enables the video conferencing system to achieve rapid response and dynamic adjustment, thereby ensuring the timely transmission and display of the video stream. The monitoring and cutting stream instructions ensure the accuracy of video stream transmission, avoid inaccurate display or freezing due to transmission errors or delays, and improve the stability and reliability of the video conferencing system. By automatically generating monitoring and cutting stream instructions, the operation process of the video conferencing system is simplified, the possibility of manual intervention is reduced, and the operation efficiency and management convenience are improved. The monitoring and cutting stream instructions are dynamically generated according to the polling cursor information, and the display order and content can be flexibly adjusted to adapt to different meeting needs and scene changes.

[0077] In an exemplary embodiment of the present invention, before reading out the polling information of the monitoring terminal, an implementation method is to obtain the polling information from the conference client; and store the polling information in the terminal polling container. In actual application, the conference client usually refers to the terminal device that participates in and manages the conference, such as a PC, a mobile device, or a conference room system. These conference clients will generate various data during the conference, including conference status, participant information, and video stream information. The process of obtaining polling information involves obtaining information such as the current conference status and the list of terminals that need to be polled from these conference clients.

[0078] For example, suppose a video conferencing system has multiple conference rooms, each with different participants and video streams. The monitoring terminal needs to obtain the polling order of these conference rooms and the video stream information that needs to be displayed. By obtaining it from the conference client, the video stream information of each conference room and the polling order can be obtained in real time. For example, the polling order is determined according to the priority of the conference room or the importance of the participants.

[0079] Once the polling information is obtained from the conference client, it needs to be managed and stored effectively so that the monitoring terminal can access it at any time and display the video stream in a predetermined order. The terminal polling container can be a database, a cache structure in memory, or other types of data storage facilities to store and manage all data related to the polling display.

[0080] For example, storing the acquired polling information in the terminal polling container can be specifically to create a polling information table in the database, which contains fields such as the conference room identification, participant information, and display order. Each time the conference status changes or the monitoring terminal needs to update the polling order, it can be achieved by updating the database record to ensure the real-time and accuracy of the polling information.

[0081] The embodiment of the present invention obtains polling information from the conference client to achieve real-time monitoring and response to the conference status. The monitoring terminal can adjust the polling display order according to the latest conference participants and video stream information to ensure that the display content is consistent with the actual progress of the meeting. The polling information stored in the terminal polling container can be dynamically adjusted according to the needs of different meetings. For example, in important meetings, it may be necessary to adjust the display order according to the meeting agenda, while ordinary meetings may pay more attention to the equal display of participants. By centrally managing polling information, managers can more conveniently monitor and adjust the polling display behavior of the monitoring terminal. This centralized management reduces human errors and operational complexity and improves management efficiency. As the center of data storage, the terminal polling container ensures the consistency and reliability of polling information. The monitoring terminal obtains information through a unified data source to avoid the problem of inconsistent or missing information.

[0082] In an exemplary embodiment of the present invention, after the video stream of the video conference is transmitted to each decoding channel according to the terminal list information so that the monitoring terminal can poll and display the video stream, an implementation method is to obtain polling end notification information from the conference client; and delete the polling information from the terminal polling container according to the polling end notification information. In the video conferencing system, the conference management server obtains the polling end notification information through the conference client. These polling end notification information generally include the conference terminal identifier of the current polling, the end mark of the polling sequence, and other contents. The purpose of obtaining these polling end notification information is to enable the monitoring terminal to accurately know when to end the polling display of a certain conference terminal.

[0083] For example, if the monitoring terminal is polling and displaying the video streams of conference rooms A, B, and C, the conference client can send a polling end notification to the conference management server, such as a message "polling ended for conference room A". After receiving the notification, the conference management server can perform subsequent operations, such as updating the polling display order or stopping the transmission of related video streams.

[0084] Once the conference management server receives the polling end notification information, it needs to update the terminal polling container according to the polling end notification information to ensure the real-time and accuracy of the polling information, including deleting the polling information that has ended from the terminal polling container.

[0085] For example, when the conference management server receives the notification of "polling ended for conference room A", it will delete the polling information related to conference room A from the terminal polling container according to this notification information. This polling information may include the video stream source address and decoding channel information of conference room A. After deleting this information, the monitoring terminal can continue to display the video streams of other conference terminals or end the polling display according to the updated polling container.

[0086] The embodiment of the present invention can achieve rapid response and dynamic adjustment of the conference status by timely acquiring and processing polling end notification information. The monitoring terminal can update the polling display order in time to ensure that the display content is consistent with the actual progress of the meeting. Deleting polling information that no longer needs to be displayed can optimize the use of video conferencing system resources. For example, stopping the transmission of video streams that are no longer needed can save bandwidth and decoding resources and improve the overall performance of the system. Automated processing of polling end notification information simplifies the operation process of the video conferencing system and reduces the possibility of manual intervention. Managers can monitor and manage the display behavior of the monitoring terminal more centrally, improving operational efficiency and management convenience. Updating the terminal polling container according to the polling end notification ensures the consistency and reliability of the polling information.

[0087] Based on the above description of the embodiment of a video conference processing method, a dual polling solution for five monitoring terminals based on a video network is introduced below. Figure 2 , shows a schematic diagram of the principle of a dual polling scheme of five-channel monitoring terminals based on a visual network according to an embodiment of the present invention. The dual polling scheme of five-channel monitoring terminals based on a visual network involves a conference client, a conference management server and five-channel monitoring terminals.

[0088] In response to the polling start click operation, the conference client sends polling information containing two different terminal lists to the conference management server. The conference management server saves the polling information in the terminal polling container five_polling_info_map according to the structure of (monitoring terminal-polling terminal list information (large and small polling (1-large polling, 2-small polling)-polling cursor poll_pos (which conference terminal is the turn, the default value is 1)-terminal list)). Among them, large polling and small polling can represent two polling mechanisms respectively.

[0089] The conference management server adds a five-channel monitoring polling resident thread, which traverses the terminal polling container five_polling_info_map every 5 seconds, takes out the polling information of each five-channel monitoring terminal in turn, associates its polling terminal list information according to the monitoring terminal number, points the polling cursor in the large polling to the auxiliary stream of conference terminal m in terminal list M, assigns it to the first decoding channel of the monitoring terminal, and increases the polling cursor poll_pos1 by one (when it is greater than the total number of terminal list M, it is set back to 1), and assigns the mainstream of the four conference terminals after terminal n in terminal list N pointed by the polling cursor in the small polling to the 2nd, 3rd, 4th, and 5th decoding channels of the monitoring terminal, and increases the polling cursor poll_pos2 by one (when it is greater than the total number of terminal list N, it is set back to 1). Then send the assembled monitoring stream switching instruction to the conference operation server for stream switching.

[0090] When the conference client responds to the polling end click operation, the conference management server removes the polling information from the terminal polling container five_polling_info_map.

[0091] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0092] Reference Figure 3 , shows a structural block diagram of a video conference processing system according to an embodiment of the present invention. The video conference processing system can be applied to a conference management server, and the video conference processing system can specifically include the following modules.

[0093] The polling information reading module 31 is used to read the polling information of the monitoring terminal;

[0094] The terminal list parsing module 32 is used to parse the polling information to obtain the terminal list information corresponding to each decoding channel of the monitoring terminal under at least two polling mechanisms;

[0095] The video stream polling and display module 33 is used to transmit the video stream of the video conference to each of the decoding channels according to the terminal list information, so that the monitoring terminal polls and displays the video stream.

[0096] In an exemplary embodiment of the present invention, the polling information reading module 31 is used to read the polling information from the terminal polling container of the conference management server according to a preset period.

[0097] In an exemplary embodiment of the present invention, the polling information reading module 31 includes:

[0098] A terminal identification acquisition module, used to acquire the terminal identification information of the monitoring terminal;

[0099] The polling information query module is used to query the polling information associated with the terminal identification information in the terminal polling container according to the preset period.

[0100] In an exemplary embodiment of the present invention, the video stream polling display module 33 includes:

[0101] A polling information parsing module, used to parse the polling information to obtain the polling terminal list information and polling cursor information of the monitoring terminal under at least two of the polling mechanisms, wherein the polling terminal list information includes the decoding information of each decoding channel, and the polling cursor information indicates the conference terminal information corresponding to the video stream to be polled and displayed;

[0102] The video stream transmission module is used to transmit the video stream to each decoding channel according to the terminal list information, the polling terminal list information and the polling cursor information, so that the monitoring terminal polls and displays the video stream.

[0103] In an exemplary embodiment of the present invention, the video stream transmission module includes:

[0104] A target terminal query module, used to query the target conference terminal in the terminal list information according to the polling cursor information;

[0105] A monitoring instruction generation module, used to generate a monitoring stream switching instruction according to the video stream of the target conference terminal and the polling terminal list information;

[0106] The monitoring instruction transmission module is used to transmit the monitoring stream switching instruction to the conference operation server, so that the conference operation server transmits the video stream to each decoding channel according to the monitoring stream switching instruction.

[0107] In an exemplary embodiment of the present invention, the system further comprises:

[0108] A polling information acquisition module, used to acquire the polling information from the conference client before the polling information reading module 31 reads the polling information of the monitoring terminal;

[0109] The polling information storage module is used to store the polling information in the terminal polling container.

[0110] In an exemplary embodiment of the present invention, the system further comprises:

[0111] A polling notification acquisition module, configured to obtain polling end notification information from the conference client after the video stream polling display module 33 transmits the video stream of the video conference to each decoding channel according to the terminal list information so that the monitoring terminal polls and displays the video stream;

[0112] The polling container updating module is used to delete the polling information from the terminal polling container according to the polling end notification information.

[0113] As for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0114] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0115] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0116] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0117] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0118] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0119] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0120] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0121] The above is a detailed introduction to a video conference processing method and a video conference processing system provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for processing a video conference, characterized in that: Applied to a conference management server, the method comprises: Read out the polling information of the monitoring terminal; Parsing the polling information to obtain terminal list information corresponding to each decoding channel of the monitoring terminal under at least two polling mechanisms; The video stream of the video conference is transmitted to each of the decoding channels according to the terminal list information, so that the monitoring terminal polls and displays the video stream.

2. The method according to claim 1, characterized in that The step of reading out the polling information of the monitoring terminal includes: The polling information is read from the terminal polling container of the conference management server according to a preset period.

3. The method according to claim 2, characterized in that The step of reading the polling information from the terminal polling container of the conference management server according to a preset period includes: Obtaining terminal identification information of the monitoring terminal; According to the preset period, the terminal polling container is queried for the polling information associated with the terminal identification information.

4. The method according to claim 1, characterized in that: The step of transmitting the video stream of the video conference to each decoding channel according to the terminal list information so that the monitoring terminal polls and displays the video stream includes: Parsing the polling terminal list information and polling cursor information of the monitoring terminal under at least two of the polling mechanisms from the polling information, wherein the polling terminal list information includes decoding information of each decoding channel, and the polling cursor information indicates conference terminal information corresponding to the video stream to be polled and displayed; According to the terminal list information, the polling terminal list information and the polling cursor information, the video stream is transmitted to each decoding channel, so that the monitoring terminal polls and displays the video stream.

5. The method according to claim 4, characterized in that The step of transmitting the video stream to each decoding channel according to the terminal list information, the polling terminal list information and the polling cursor information includes: Querying the target conference terminal in the terminal list information according to the polling cursor information; Generate a monitoring stream switching instruction according to the video stream of the target conference terminal and the polling terminal list information; The monitoring and switching stream instruction is transmitted to a conference operation server, so that the conference operation server transmits the video stream to each of the decoding channels according to the monitoring and switching stream instruction.

6. The method according to claim 2, characterized in that Before reading out the polling information of the monitoring terminal, the method further includes: Acquire the polling information from the conference client; The polling information is stored in the terminal polling container.

7. The method according to claim 6, characterized in that After transmitting the video stream of the video conference to each decoding channel according to the terminal list information so that the monitoring terminal polls and displays the video stream, the method further includes: Obtaining polling end notification information from the conference client; The polling information is deleted from the terminal polling container according to the polling end notification information.

8. A video conference processing system, characterized in that: Applied to a conference management server, the system comprises: The polling information reading module is used to read the polling information of the monitoring terminal; A terminal list parsing module, used to parse the polling information to obtain terminal list information corresponding to each decoding channel of the monitoring terminal under at least two polling mechanisms; The video stream polling and display module is used to transmit the video stream of the video conference to each of the decoding channels according to the terminal list information, so that the monitoring terminal polls and displays the video stream.

9. An electronic device, characterized in that: include: one or more processors; and One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to execute the video conference processing method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer program stored therein enables the processor to execute the video conference processing method as described in any one of claims 1 to 7.