Video conference processing method and system, electronic equipment and storage medium
By obtaining and judging the conference information of the participating terminal in real time in the video conferencing system and automatically sending reminder information, the problem of insufficient monitoring of key participants' participation and departure is solved, and the efficiency of meeting management and decision-making accuracy is improved.
Patent Information
- Application Number
- CN202411115677.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-14
- Publication Date
- 2024-11-22
AI Technical Summary
The existing video conferencing system cannot effectively ensure that key participants will join the meeting in a timely manner and continue to be online, and there is insufficient monitoring of the departure, resulting in inefficient meeting management and delayed decision-making.
By obtaining the meeting information of the participating terminal in real time on the server side, we will determine whether it is the target terminal (key participants), and automatically sending reminder information to the host terminal to ensure timely attention and handling of failure to join or leave the meeting in time.
It improves the reliability of participants, especially key personnel, and online monitoring efficiency, reduces the dependence of manual intervention, reduces the risk of missed judgment caused by negligence, and ensures the smooth progress of the meeting and the timeliness of decision-making.
Smart Images

Figure CN119011765A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of video conferencing, and in particular to a method for processing a video conferencing, a system for processing a video conferencing, an electronic device, and a computer-readable storage medium. Background Art
[0002] With the rapid development of remote work, online education and global communication, video conferencing systems have become an important communication tool for enterprises, educational institutions and other organizations. However, existing video conferencing systems have certain limitations in managing the entry and exit of participants, especially in the management of key participants, and cannot ensure that these participants can join the meeting in time and stay online throughout the meeting.
[0003] At present, the typical process of a video conference is that before the meeting starts, the server will send text messages or other reminders to some participants, or the host will manually share the meeting information with the participants. This method has the following problems:
[0004] 1. Unable to ensure that participants attend the meeting: Only by SMS notification or information sharing by the host, it is impossible to ensure that participants, especially key participants, can receive notifications and enter the meeting in time before the meeting starts. If these key participants fail to attend the meeting on time, it may have an adverse impact on the effectiveness of the meeting and the achievement of decision-making.
[0005] 2. Insufficient monitoring of meeting departures: The current system can only allow the host or conference administrator to manually check the status of participants through the display of the meeting member list. This method is not only inefficient, but may also result in omissions, especially when the meeting is large or the host needs to deal with other matters, it is easier to ignore the departure of some participants. This poses a great management risk for meetings that need to pay attention to the continuous online status of key participants.
[0006] 3. Lack of timely reminders: When key participants fail to join the meeting on time or leave the meeting during the meeting, the host can only find out the status changes of these key personnel when he actively checks the member list. This passive monitoring method can easily lead to the lag of key information, affecting the smooth progress of the meeting and the timeliness of decision-making. Summary of the invention
[0007] In view of the above problems, embodiments of the present invention are proposed to provide a method for processing a video conference, a processing system for a video conference, an electronic device, and a computer-readable storage medium that overcome the above problems or at least partially solve the above problems.
[0008] In order to solve the above problems, an embodiment of the present invention discloses a method for processing a video conference, which is applied to a first server, and the method includes: obtaining conference information of at least one first terminal, the conference information including the conference status of the first terminal in the video conference; judging whether the first terminal is a target terminal according to the conference information, and the target terminal represents a participant terminal for key participants to access the video conference; if the first terminal is the target terminal, sending reminder information of the first terminal to a second terminal according to the conference information, so that the second terminal displays the conference status of the first terminal according to the reminder information.
[0009] Optionally, determining whether the first terminal is a target terminal based on the conference information includes: reading terminal identification information of the first terminal from the conference information; querying whether the terminal identification information exists in a target terminal list; if the terminal identification information exists in the target terminal list, querying whether the terminal identification information exists in a white list; if the terminal identification information does not exist in the white list, determining the first terminal as the target terminal.
[0010] Optionally, obtaining conference information of at least one first terminal includes: receiving the conference information from the first terminal before or during the video conference, or obtaining the conference information from a second server; wherein the second server is used to monitor the heartbeat data of the first terminal.
[0011] Optionally, the receiving the conference information from the first terminal includes: when the first terminal responds to an active leaving operation of the user, using a conference interface of the first server to receive the conference information from the first terminal.
[0012] Optionally, the acquiring the conference information from the second server includes: when the second server fails to monitor the heartbeat data of the first terminal, receiving the conference information from the second server.
[0013] Optionally, sending reminder information of the first terminal to the second terminal according to the conference information includes: generating the reminder information according to the conference information; sending the reminder information to the second server using the streaming media interface of the second server, so that the second server forwards the reminder information to the second terminal.
[0014] Optionally, before obtaining conference information of at least one first terminal, the method further includes: obtaining terminal information of the target terminal from the second terminal; creating and updating the target terminal list and the whitelist according to the terminal information; and transmitting conference information to the target terminal according to the terminal information.
[0015] An embodiment of the present invention also discloses a video conference processing system, which is applied to a first server, and the system includes: a conference information acquisition module, which is used to obtain conference information of at least one first terminal, and the conference information includes the conference status of the first terminal in the video conference; a target terminal judgment module, which is used to judge whether the first terminal is a target terminal based on the conference information, and the target terminal represents a participant terminal for key participants to access the video conference; a target terminal reminder module, which is used to send reminder information of the first terminal to a second terminal based on the conference information if the first terminal is the target terminal, so that the second terminal displays the conference status of the first terminal based on the reminder information.
[0016] Optionally, the target terminal judgment module includes: an identification reading module, used to read the terminal identification information of the first terminal from the conference information; a list query module, used to query whether the terminal identification information exists in the target terminal list; a whitelist query module, used to query whether the terminal identification information exists in the whitelist if the terminal identification information exists in the target terminal list; and a terminal confirmation module, used to determine the first terminal as the target terminal if the terminal identification information does not exist in the whitelist.
[0017] Optionally, the conference information acquisition module is used to receive the conference information from the first terminal before or during the video conference, or to acquire the conference information from a second server; wherein the second server is used to monitor the heartbeat data of the first terminal.
[0018] Optionally, the conference information acquisition module is configured to receive the conference information from the first terminal by using a conference interface of the first server in response to an active leaving operation of the user.
[0019] Optionally, the conference information acquisition module is used to receive the conference information from the second server when the second server fails to monitor the heartbeat data of the first terminal.
[0020] Optionally, the target terminal reminder module includes: a reminder information generation module, used to generate the reminder information according to the meeting information; a reminder information sending module, used to send the reminder information to the second server using the streaming media interface of the second server, so that the second server forwards the reminder information to the second terminal.
[0021] Optionally, the system also includes: a terminal information acquisition module, used to obtain the terminal information of the target terminal from the second terminal before the conference information acquisition module obtains the conference information of at least one first terminal; a list and whitelist maintenance module, used to create and update the target terminal list and the whitelist according to the terminal information; and a conference information transmission module, used to transmit conference information to the target terminal according to the terminal information.
[0022] An embodiment of the present invention also discloses an electronic device, comprising: one or more processors; and one or more machine-readable media storing instructions thereon, which, when executed by the one or more processors, enables the electronic device to execute the video conference processing method as described above.
[0023] The embodiment of the present invention further discloses a computer-readable storage medium, which stores a computer program that enables a processor to execute the video conference processing method as described above.
[0024] The embodiments of the present invention include the following advantages:
[0025] The video conference processing scheme provided by the embodiment of the present invention is applied to a first server. The first server obtains conference information of at least one first terminal, and the conference information includes the conference status of the first terminal in the video conference. Then, it is determined whether the first terminal is a target terminal according to the conference information. If the first terminal is a target terminal, and the target terminal represents a conference terminal for key participants to access the video conference, then the reminder information of the first terminal is sent to the second terminal according to the conference information, so that the second terminal displays the conference status of the first terminal according to the reminder information.
[0026] The first server of the embodiment of the present invention can obtain the conference information of at least one first terminal in real time, and determine whether there are key participants who have not joined the meeting in time based on the conference information. When the key participants fail to join the meeting on time, the first server will immediately send a reminder message to the second terminal (such as the host's device) to ensure that the key participants can be paid attention to and processed in time before the meeting starts. This automated reminder mechanism effectively makes up for the shortcomings of traditional reliance on SMS notifications or manual sharing of information, and significantly improves the reliability of participants, especially key personnel, to join the meeting. Allow the first server to automatically monitor the status of participants, especially the online status of key participants, based on the acquired conference information. Compared with the traditional method that requires the host to manually view the member list, the status changes of key participants are automatically identified and notified in time, which improves the monitoring efficiency of key personnel, reduces the reliance on manual intervention, and reduces the risk of missed judgment due to manual negligence. When the key participants leave the meeting or the status changes during the meeting, the first server can send a reminder message to the second terminal in time. This active reminder mechanism enables the host or conference administrator to immediately know the status changes of key participants, avoiding delays or errors in conference decisions caused by delays or failures. This real-time reminder mechanism improves the continuity and decision-making efficiency of video conferences and ensures the smooth progress of video conferences.
[0027] In summary, the embodiments of the present invention significantly improve the efficiency and accuracy of participant management through an intelligent monitoring and reminder mechanism, especially in the management of key participants, thereby ensuring the smooth progress of the video conference. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] Figure 1 is a flowchart of a method for processing a video conference according to an embodiment of the present invention;
[0029] Figure 2 This is a schematic diagram of the principle of a solution for reminding key users to leave a video conference in an embodiment of the present invention;
[0030] Figure 3 It is a structural block diagram of a video conference processing system according to an embodiment of the present invention. DETAILED DESCRIPTION
[0031] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
[0032] The video conference processing solution proposed in the embodiment of the present invention obtains the conference information of the participating terminal through the first server, and monitors the conference status of the participants in real time based on the conference information. In particular, when a key participant fails to join the meeting in time or leaves the meeting during the meeting, the participating terminal will be automatically determined as the target terminal, and a reminder message will be sent to the conference terminal of the host or administrator so that the host or administrator can understand the status changes of the key personnel in time. This automated monitoring and reminder mechanism not only ensures that the key participants join the meeting in time and stay online, but also reduces the management burden of the host, and improves the management efficiency of the video conference and the accuracy of decision-making.
[0033] Reference Figure 1 , shows a flowchart of a method for processing a video conference according to an embodiment of the present invention. The method for processing a video conference can be applied to a first server, and the method for processing a video conference can specifically include the following steps:
[0034] Step 101: Acquire conference information of at least one first terminal.
[0035] In an embodiment of the present invention, the conference information includes the conference status of the first terminal in the video conference. The first server first needs to obtain the conference information of at least one first terminal. This process is the basis for ensuring that the video conferencing system (referred to as the system) can monitor the status of participants in real time and respond accordingly. Conference information refers to various data and status information related to the first terminal, which can reflect the specific status of the first terminal in the current video conference.
[0036] In actual operation, the conference information may include multiple aspects, such as whether the first terminal has been connected to the video conference, whether the video or audio function is enabled, whether the first terminal is currently speaking, the stability of the network connection, the battery status, etc. However, the most critical content is the conference status of the first terminal in the video conference. This status can be a clear mark such as "joined the conference", "not joined the conference", "left the conference", etc., which is used to determine whether the first terminal is currently active in the video conference.
[0037] For example, suppose a company is holding an important project review meeting, and the participants include several key personnel such as the project manager, technical director, and financial director. In order to ensure that these key personnel can join the meeting in time and stay online during the meeting, the system will remind them to join the meeting through SMS or other notification methods before the meeting starts. When these key personnel try to connect to the meeting, the first server will record the connection status and other relevant information of these key personnel's conference terminals, and store it as meeting information in the system. For example, the project manager's conference terminal successfully connects at the beginning of the meeting and turns on the video and audio functions. This information will be recorded as part of the meeting information. The technical director's conference terminal may not be successfully connected due to network problems, or it may leave the meeting due to network fluctuations after connecting. These status information will also be updated and recorded in real time.
[0038] In this step, the acquisition of conference information is usually achieved in a variety of ways. The first server can obtain this information through real-time data exchange with the first terminal. This data exchange can be based on various communication protocols, such as Transmission Control Protocol / Internet Protocol (TCP / IP) or other protocols suitable for video conferencing. In addition, the first server may further improve the acquisition and update mechanism of conference information by monitoring network data packets and analyzing the heartbeat packets or status feedback of the terminal.
[0039] Step 102: determine whether the first terminal is a target terminal according to the conference information.
[0040] In an embodiment of the present invention, after the conference information is acquired, it is determined whether the first terminal is a target terminal based on the conference information. A target terminal generally refers to a participant terminal that needs to be focused on in a specific conference scenario. For example, a target terminal indicates a participant terminal for key participants to access a video conference. The definition of a target terminal may vary according to the needs of different conferences.
[0041] In actual applications, the basis for judgment may include the following aspects: identity information of the first terminal (such as user account, role), conference status of the first terminal (such as whether it is online, whether it is speaking), connection quality of the first terminal (such as network delay, packet loss rate), and importance or priority of the video conference. For example, if a first terminal is the host or a key role of the video conference, then the first terminal will be automatically judged as the target terminal.
[0042] For example, suppose that in a company-wide online meeting, the technical director's terminal fails to join the meeting on time. After the first server obtains the meeting information of the terminal, it immediately determines that the technical director's terminal is the target terminal. Because the technical director is a key role in the video conference, his online or not directly affects the progress of the video conference.
[0043] Step 103: If the first terminal is the target terminal, reminder information of the first terminal is sent to the second terminal according to the conference information, so that the second terminal displays the conference status of the first terminal according to the reminder information.
[0044] In an embodiment of the present invention, after the target terminal is determined, corresponding processing measures are taken for the first terminal that has been identified as the target terminal. These measures include sending reminder information to the second terminal, so that the second terminal can display the conference status of the first terminal according to the reminder information. This link ensures that the conference host or administrator can understand the status changes of key participating terminals in real time and make necessary responses.
[0045] The sending of reminder information is a key action in the entire solution. Its purpose is to quickly convey the changes in the conference status of the target terminal to the conference manager so that they can take timely action. The reminder information can contain a variety of content, such as the identity information of the target terminal, the current conference status, possible problems (such as network anomalies, disconnection, etc.), and recommended solutions.
[0046] In actual operation, the second terminal is usually the participating terminal used by the host or conference administrator. After receiving the reminder information, the second terminal can display the information to the user through pop-up prompt boxes, sending notifications, voice reminders, etc. For example, when a key participant suddenly goes offline, the system can send a reminder message to the host's participating terminal, including the person's identity (such as "technical director"), current status (such as "disconnected"), and suggestions (such as "please try to reconnect"). Based on this information, the host can quickly contact the person or adjust the meeting process according to the situation.
[0047] For example, in a project review meeting, a technical leader's connection is unstable due to network fluctuations. After detecting this state, the system immediately sends a reminder message to the host's terminal. After receiving the reminder, the host can choose to pause the meeting and wait for the leader to reconnect, or temporarily skip the leader's speech to keep the meeting going smoothly.
[0048] The video conference processing scheme provided in an embodiment of the present invention is applied to a first server. The first server obtains conference information of at least one first terminal, and the conference information includes the conference status of the first terminal in the video conference. Then, it is determined whether the first terminal is a target terminal according to the conference information, and the target terminal indicates the conference terminal for key participants to access the video conference. If the first terminal is the target terminal, the reminder information of the first terminal is sent to the second terminal according to the conference information, so that the second terminal displays the conference status of the first terminal according to the reminder information.
[0049] The first server of the embodiment of the present invention can obtain the conference information of at least one first terminal in real time, and determine whether there are key participants who have not joined the meeting in time based on the conference information. When the key participants fail to join the meeting on time, the first server will immediately send a reminder message to the second terminal (such as the host's device) to ensure that the key participants can be paid attention to and processed in time before the meeting starts. This automated reminder mechanism effectively makes up for the shortcomings of traditional reliance on SMS notifications or manual sharing of information, and significantly improves the reliability of participants, especially key personnel, to join the meeting. Allow the first server to automatically monitor the status of participants, especially the online status of key participants, based on the acquired conference information. Compared with the traditional method that requires the host to manually view the member list, the status changes of key participants are automatically identified and notified in time, which improves the monitoring efficiency of key personnel, reduces the reliance on manual intervention, and reduces the risk of missed judgment due to manual negligence. When the key participants leave the meeting or the status changes during the meeting, the first server can send a reminder message to the second terminal in time. This active reminder mechanism enables the host or conference administrator to immediately know the status changes of key participants, avoiding delays or errors in conference decisions caused by delays or failures. This real-time reminder mechanism improves the continuity and decision-making efficiency of video conferences and ensures the smooth progress of video conferences.
[0050] In summary, the embodiments of the present invention significantly improve the efficiency and accuracy of participant management through an intelligent monitoring and reminder mechanism, especially in the management of key participants, thereby ensuring the smooth progress of the video conference.
[0051] In an exemplary embodiment of the present invention, one implementation method of determining whether a first terminal is a target terminal according to conference information is to read the terminal identification information of the first terminal from the conference information; query whether the terminal identification information exists in the target terminal list; if the terminal identification information exists in the target terminal list, query whether the terminal identification information exists in the white list; if the terminal identification information does not exist in the white list, determine the first terminal as the target terminal. This implementation method involves a specific process of how to determine whether the first terminal is a target terminal according to conference information. In this implementation method, the core of the judgment is to finally determine whether the first terminal is a target terminal by comparing the terminal identification information with the pre-set target terminal list and white list. This process ensures that the system can effectively identify the terminals that need to be focused on and improves the accuracy of video conference management through a series of queries and comparisons. In actual application, the first server reads the terminal identification information of the first terminal from the conference information. The terminal identification information is key data used to uniquely identify each first terminal or participating terminal, which can usually be a device's media access control (Media Access Control, referred to as MAC) address, Internet Protocol (Internet Protocol, referred to as IP) address, user identification (User Identification, referred to as ID), etc. This information can uniquely identify a terminal device, thereby helping the system to accurately identify and track the status of each participant. Next, the first server will query the target terminal list for the terminal identification information. The target terminal list is a pre-set list that contains terminal information that needs special attention in a specific meeting. This list is usually set by the conference administrator before the meeting starts, and contains terminals such as important roles (such as chairman, project manager, technical director, etc.) or specific functions (such as display screens, recording devices, etc.). By querying the target terminal list, the first server can quickly determine whether the first terminal is an object that needs special attention. If the first server finds matching terminal identification information in the target terminal list, the next step is to query in the white list. The white list is another pre-set list that contains terminals that can be ignored in certain special circumstances. For example, some auxiliary devices or test devices may be included in the white list, and even if they are in the target terminal list, they do not need special attention. Or, some participating terminals ask for leave from the host and are approved by the host. In this case, if the terminal identification information of the first terminal exists in the white list, the first server will not regard it as a target terminal. The setting of the white list enables the system to be more flexible in managing the first terminal and avoids unnecessary interference.
[0052] However, if the terminal identification information of the first terminal exists in the target terminal list, but the corresponding terminal identification information is not found in the white list, the first server will determine the first terminal as the target terminal. This judgment means that the first terminal is indeed an object that needs special attention and cannot be ignored, so it should be specially handled, such as real-time monitoring of its status, or sending a reminder to relevant managers when its status changes.
[0053] In the embodiment of the present invention, by double querying the target terminal list and the whitelist, the first server can more accurately identify the participating terminals that need special attention, reducing the possibility of misjudgment. The introduction of the whitelist allows the first server to effectively filter certain participating terminals that do not need special attention, avoid unnecessary interference, and allow flexible management of different types of devices. Through the automated identification and judgment mechanism, the first server can quickly determine the status of key terminals during the meeting and take corresponding management measures, such as reminding the host or administrator. This automated process reduces manual intervention and improves the efficiency of conference management.
[0054] In an exemplary embodiment of the present invention, an implementation method of obtaining conference information of at least one first terminal is to receive conference information from the first terminal before or during a video conference, or to obtain conference information from a second server; wherein the second server is used to monitor the heartbeat data of the first terminal. In actual application, the first way to obtain conference information is to directly receive conference information from the first terminal before or during a video conference. The first terminal refers to any device participating in a video conference, such as a personal computer, a smart phone, a tablet computer, etc. The conference information usually includes key data such as the connection status, video and audio status, and network quality of the first terminal. These conference information are very important for the video conference system because they determine how the system manages and coordinates the interaction of each terminal. For example, when a video conference is about to start, the first server may obtain its current status from each participating terminal to ensure that all key participants are connected and their devices are working properly. In this direct acquisition method, the first server relies on the active data transmission of the first terminal. This means that when the first terminal is connected to the conference, it periodically sends its own conference information to the first server. The advantage of this method is that the real-time nature of the conference information is high, and the first server can immediately obtain the latest status of each first terminal and make corresponding adjustments as needed.
[0055] Another way to obtain conference information is through a second server, especially when the first terminal does not send data directly to the first server. The second server is specifically used to monitor the heartbeat data of the first terminal. Heartbeat data is a small data packet sent periodically to indicate the activity status of the first terminal and the stability of the connection. By monitoring the heartbeat data, the second server can understand the connection status of each first terminal in real time and find any problems that may affect the smooth progress of the meeting. In practical applications, monitoring of heartbeat data is crucial to ensuring the stability of video conferencing. For example, if a first terminal cannot send heartbeat data due to a network interruption, the second server can immediately detect this anomaly and feed the information back to the first server.
[0056] In the embodiment of the present invention, by directly acquiring conference information from the first terminal or monitoring heartbeat data through the second server, the first server can understand the status of each first terminal in real time. This real-time performance ensures that the first server can quickly respond to any situation that may affect the smooth progress of the meeting, such as terminal disconnection, network instability, etc. By monitoring the heartbeat data, the second server can detect potential problems in advance and take preventive measures before the problems affect the meeting. By fully grasping the conference information, the first server can make optimization adjustments based on the status of different first terminals, thereby improving the overall conference experience. By obtaining conference information in a timely manner, the first server can effectively avoid conference interruptions caused by poor status of the first terminal. In particular, when there is a problem with the participating terminal of key participants, the host or conference administrator can be quickly reminded, so that necessary measures can be taken to ensure the continuity of the meeting.
[0057] In an exemplary embodiment of the present invention, an implementation method of receiving conference information from the first terminal is to use the conference interface of the first server to receive conference information from the first terminal in response to the user's active leaving operation. In actual application, the user's active leaving operation refers to the behavior of the participant choosing to exit the current video conference on his or her first terminal. This operation may be caused by the end of the meeting, personal affairs or other reasons. When the user performs the leaving operation, the first terminal will pass the relevant conference information to the first server by calling the conference interface of the first server. The conference interface is a predefined communication channel that allows data exchange between the first terminal and the first server. Since it is an operation actively triggered by the user, the first terminal can immediately send the leaving information to the first server, avoiding the possibility of information delay or loss.
[0058] To give a specific example, suppose that during a company's annual summary meeting, the CFO needs to leave the meeting early due to urgent matters. He clicks the "Leave Meeting" button on his laptop (first terminal). At this time, the first terminal sends a meeting message by calling the conference interface of the first server, which contains the CFO's user ID, departure time, and relevant identification information of the meeting. After receiving this meeting message, the first server immediately updates the participant list, marks the CFO as having left the meeting, and may trigger other operations, such as notifying the host or marking in the meeting minutes.
[0059] By sending conference information instantly when the user takes the initiative to operate, the embodiment of the present invention enables the first server to grasp the dynamics of the participants in real time and ensure the timeliness of conference management. Since the conference information comes directly from the user operation of the first terminal, the accuracy of the data is guaranteed, and information errors caused by network delays or other factors are avoided. Timely acquisition of the departure information of the participants allows the conference manager to adjust the conference process according to the actual situation, such as reallocating the speaking order, recording the meeting time, etc., thereby improving the flexibility and efficiency of the meeting.
[0060] In an exemplary embodiment of the present invention, an implementation method of obtaining conference information from the second server is to receive conference information from the second server when the second server fails to monitor the heartbeat data of the first terminal. In actual application, heartbeat data refers to a small data packet periodically sent by the first terminal, which is used to report its online status to the second server. Through the heartbeat data, the second server can monitor the connection status of the first terminal in real time to ensure that all participants are continuously online in the conference. However, in some cases, such as network interruption, equipment failure or other reasons, the first terminal may not be able to send heartbeat data. At this time, the second server cannot judge the status of the first terminal through the heartbeat data, which may lead to blind spots and potential risks in conference management. In order to cope with this problem, a mechanism for obtaining conference information from the second server is introduced. When the second server fails to monitor the heartbeat data of a first terminal, it will automatically obtain the conference information of the first terminal and pass it to the first server. The second server is usually a device specifically used to monitor and manage heartbeat data, and has the ability to continuously monitor the first terminal. It can not only detect the absence of heartbeat data, but also trigger a series of operations according to the situation to ensure the integrity of the conference information.
[0061] When the second server fails to receive the heartbeat data from a first terminal, it will trigger an early warning mechanism. This early warning mechanism may include multiple attempts to re-detect the heartbeat data to eliminate short-term network problems or other temporary obstacles. If the heartbeat data is still not received after multiple attempts, the second server will instead obtain the conference information of the first terminal. This conference information may include the last status of the first terminal, the data of the last successful connection, the network environment, etc. This conference information is usually stored in the log of the second server and can be obtained by query. The second server passes the obtained conference information to the first server. Based on this conference information, the first server decides whether to take further action, such as reminding the conference host, recording the status change of the terminal, or trying to restore the connection with the terminal.
[0062] For example, suppose that in an international video conference, a participant's terminal has a heartbeat data interruption due to a network problem. At this time, after the second server detects this situation, it sends the last connection information of the participant terminal (such as its IP address, network delay, last speaking time, etc.) to the first server. The first server can make corresponding processing based on this, such as notifying the participant to try to reconnect, or recording the offline status of the participant.
[0063] The embodiment of the present invention can still maintain monitoring of conference information even when the heartbeat data of the first terminal is interrupted. This redundant design improves the robustness of the system and ensures that conference management is not interrupted. Even if the first terminal fails, the first server can still obtain key conference information through the second server to avoid information loss caused by the failure of a single data source. By obtaining conference information when the heartbeat data is interrupted, the first server can respond to the abnormality of the first terminal in a timely manner to ensure the continuity of the meeting and the smooth progress of decision-making.
[0064] In an exemplary embodiment of the present invention, an implementation method of sending reminder information of the first terminal to the second terminal according to conference information is to generate reminder information according to the conference information; send reminder information to the second server using the streaming interface of the second server, so that the second server forwards the reminder information to the second terminal. In the actual application process, the generation of reminder information is completed based on the conference information of the first terminal. Conference information includes but is not limited to the connection status, speaking status, network quality, etc. of the participants. These conference information are crucial in video conferences, especially when key participants are involved. For example, if a participant suddenly disconnects or the network condition is poor, corresponding reminder information needs to be generated to quickly notify relevant personnel to take measures. The generation of reminder information usually takes into account the specific needs of the meeting and the roles of the participants. For example, in a meeting that requires real-time decision-making, if a key person (such as a project manager or technical expert) is temporarily offline due to network problems, the reminder information may include the offline time of the participant, possible network problems, and recommended treatment measures. This information can help other participants quickly understand the situation and make corresponding adjustments.
[0065] Next, the generated reminder information needs to be sent through the streaming media interface of the second server. The streaming media interface is a communication channel that can transmit audio, video and other data in real time. In this embodiment, the streaming media interface is not only used to transmit video and audio, but also can be used to send important reminder information. The advantage of this design is that it uses existing communication channels and does not require additional hardware or software support, so that efficient transmission of information can be achieved.
[0066] When the reminder information is sent to the second server through the streaming interface, the second server will further process the reminder information and forward it to the second terminal. The second terminal is usually the conference terminal used by the conference manager or other key participants. They can receive the reminder information in the first time and take corresponding actions according to the information content of the reminder information. For example, the host may suspend the meeting and wait for key participants to reconnect, or notify the technical support team to solve the network problem.
[0067] For example, suppose that at an international seminar, the expert in charge of the technical demonstration suddenly loses connection. When the system detects this, it will automatically generate a reminder message, including the identity of the expert, the time of disconnection, and the network status. The reminder message is then sent to the second server through the streaming interface, and forwarded by the second server to the host and the technical team. After receiving the reminder message, the host can decide whether to temporarily interrupt the meeting and notify the expert to restore the connection as soon as possible.
[0068] The embodiment of the present invention transmits reminder information through a streaming media interface, thereby ensuring the real-time nature of the information, and enabling the conference manager to learn about the changes in the status of the participants in the shortest possible time and respond quickly. By using a streaming media interface to transmit reminder information, there is no need to configure a new communication channel, which maximizes the use of existing system resources and reduces implementation complexity and cost. Reminder information is generated and sent in a timely manner, so that the conference manager can flexibly adjust the conference process according to the changes in the status of the participants, ensuring the smooth progress of the meeting.
[0069] In an exemplary embodiment of the present invention, before obtaining the conference information of at least one first terminal, an implementation method is to obtain the terminal information of the target terminal from the second terminal; create and update the target terminal list and the white list according to the terminal information; and transmit the conference information to the target terminal according to the terminal information. In actual application, the second terminal usually refers to the control terminal used by the conference management system or the administrator. It has higher authority and wider functions, and can collect and manage the relevant information of each terminal participating in the conference. By obtaining the terminal information of the target terminal from the second terminal, the first server can obtain the information of the terminal devices that need special attention, such as the network address, identity identification and device characteristics of these devices. This information is crucial for subsequent conference management and control. Secondly, according to the terminal information obtained from the second terminal, the first server will create and update the target terminal list and the white list. The target terminal list contains all terminal devices that need special attention, which may include devices of key participants, devices that require specific permissions, or devices that require special network configuration. The white list is a security mechanism that contains a list of terminal devices that are allowed to participate in the conference. By updating the white list, the first server can ensure that only authorized devices can access the conference, prevent unauthorized devices from participating in the conference, and ensure the security and privacy of the conference. Next, based on the acquired terminal information, the first server will transmit the meeting information to the target terminal. Meeting information usually includes key information such as the time, location (virtual conference room), access method, and meeting agenda of the meeting. The purpose of transmitting this information to the target terminal is to ensure that participants can obtain detailed information related to the meeting in a timely manner, prepare in advance, and can smoothly access the meeting when the meeting starts. For some particularly important participants, the first server may also send multiple reminders or provide alternative access methods to ensure that they can smoothly attend the meeting.
[0070] For example, in a high-level meeting of a multinational company, some participants are located in different time zones and require special network configuration to access the meeting. The first server first obtains the terminal information of these senior managers through the second terminal, then adds these terminal information to the target terminal list and updates the whitelist to ensure that their participating terminals can access the meeting first. Then, the first server will send detailed meeting information to the participating terminals or portable devices of these managers, including the time of the meeting and the specific access method, and provide multiple reminders before the meeting starts to ensure that they participate on time.
[0071] The embodiment of the present invention can ensure that only authorized participating terminals can participate in the meeting through the whitelist mechanism, prevent unauthorized devices from accessing the meeting, and improve the security and privacy protection of the meeting. By collecting and configuring the information of the target terminal before the meeting starts, it can be ensured that these devices can smoothly access the meeting, especially when important participants are involved, potential technical problems can be eliminated in advance, and the reliability of the meeting can be enhanced. The process of creating and updating the target terminal list and whitelist makes meeting management more accurate and orderly, and the administrator can make reasonable management decisions based on the terminal information to improve the efficiency and effectiveness of meeting management. By transmitting detailed meeting information to the target terminal, participants can obtain meeting-related content in advance and make adequate preparations, especially in the case of cross-time zones and multiple terminals, so as to better coordinate meeting time and arrangements and improve user experience.
[0072] Based on the above description of the embodiment of a method for processing a video conference, a solution for reminding key users to leave the conference in a video conference is introduced below. Figure 2 , shows a schematic diagram of the principle of a key user leaving a video conference in an embodiment of the present invention. The key user leaving a video conference reminder solution may involve: a streaming media server (second server), a pserver (first server), a mobile terminal and a video network terminal.
[0073] When the host creates a meeting, he can set key users. He can check one or more key users. He can also edit key users during the meeting to add or remove key users. When the meeting starts, pserver pushes the meeting joining message and sends the meeting joining SMS to each key user client. If the key user has not joined the meeting within 5 minutes after the meeting starts, the host client will send a reminder to inform the host which key users have not joined the meeting, and pop up the contact information for the host to contact the key users.
[0074] If a key user leaves a meeting during the meeting, the key user's client calls the pserver interface to send the person's departure information, which includes the meeting number, user ID, name, and mobile phone number.
[0075] The pserver obtains the meeting leaving information sent by the interface and determines whether the user is a key user of the meeting. If the user is a key user of the meeting, the pserver calls the streaming interface to send the user ID, name, mobile phone number and meeting number to inform the streaming server that the key user has left the meeting.
[0076] The streaming media server then sends the reminder information to the host client through signaling, notifying the host that the key user has left the meeting.
[0077] The host client receives the reminder message sent by this signal, and a pop-up option is displayed for the host to contact the key user immediately or remind him / her again in 5 minutes. If the host chooses to contact immediately, the host client will pop up the contact information for the host to contact the key user. If the host chooses to ask again in 5 minutes, the host client will start the timer, and the timer will stop when all the key users who have left the meeting join the meeting within 5 minutes. If there are still key users who have not joined the meeting after 5 minutes, the host client will send a reminder that some key users have not joined the meeting, and a pop-up option is displayed to contact the key users immediately and remind them again in 5 minutes, and the above process will be repeated.
[0078] If a key user in a conference leaves the conference due to poor network or manually closing the conference client, the key user's client will lose the heartbeat connection with the streaming server and go offline. The streaming server sends the conference information of the key user whose heartbeat is broken to the pserver. The pserver determines whether these users are key users of a conference. If they are key users, the pserver calls the streaming interface to send the user ID, name, mobile phone number and conference number to tell the streaming server that the key user has left the conference, and repeats the above process.
[0079] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.
[0080] Reference Figure 3 , shows a structural block diagram of a video conference processing system according to an embodiment of the present invention. The video conference processing system is applied to a first server, and the video conference processing system may specifically include the following modules.
[0081] A conference information acquisition module 31, configured to acquire conference information of at least one first terminal, wherein the conference information includes a conference status of the first terminal in a video conference;
[0082] A target terminal determination module 32, configured to determine whether the first terminal is a target terminal according to the conference information, wherein the target terminal indicates a terminal for key participants to access the video conference;
[0083] The target terminal reminding module 33 is configured to send the reminder information of the first terminal to the second terminal according to the conference information if the first terminal is the target terminal, so that the second terminal displays the conference status of the first terminal according to the reminder information.
[0084] In an exemplary embodiment of the present invention, the target terminal determination module 32 includes:
[0085] An identification reading module, used to read the terminal identification information of the first terminal from the conference information;
[0086] A list query module, used to query whether the terminal identification information exists in the target terminal list;
[0087] A whitelist query module, configured to query whether the terminal identification information exists in the whitelist if the terminal identification information exists in the target terminal list;
[0088] The terminal confirmation module is configured to determine the first terminal as the target terminal if the terminal identification information does not exist in the white list.
[0089] In an exemplary embodiment of the present invention, the conference information acquisition module 31 is used to receive the conference information from the first terminal before or during the video conference, or to acquire the conference information from the second server;
[0090] The second server is used to monitor the heartbeat data of the first terminal.
[0091] In an exemplary embodiment of the present invention, the conference information acquisition module 31 is used to receive the conference information from the first terminal by using the conference interface of the first server in response to the user's active leaving operation.
[0092] In an exemplary embodiment of the present invention, the conference information acquisition module 31 is used to receive the conference information from the second server when the second server fails to monitor the heartbeat data of the first terminal.
[0093] In an exemplary embodiment of the present invention, the target terminal reminder module 33 includes:
[0094] A reminder information generating module, used to generate the reminder information according to the meeting information;
[0095] The reminder information sending module is used to send the reminder information to the second server by using the streaming media interface of the second server, so that the second server forwards the reminder information to the second terminal.
[0096] In an exemplary embodiment of the present invention, the system further comprises:
[0097] A terminal information acquisition module, configured to acquire the terminal information of the target terminal from the second terminal before the conference information acquisition module 31 acquires the conference information of at least one first terminal;
[0098] A list whitelist maintenance module, used to create and update the target terminal list and the whitelist according to the terminal information;
[0099] The conference information transmission module is used to transmit the conference information to the target terminal according to the terminal information.
[0100] As for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0101] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0102] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0103] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0104] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0105] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0106] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.
[0107] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.
[0108] The above is a detailed introduction to a video conference processing method and a video conference processing system provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.
Claims
1. A method for processing a video conference, characterized in that: Applied to a first server, the method comprises: Acquire conference information of at least one first terminal, where the conference information includes a conference status of the first terminal in a video conference; Determining whether the first terminal is a target terminal according to the conference information, the target terminal representing a terminal for key participants to access the video conference; If the first terminal is the target terminal, reminder information of the first terminal is sent to the second terminal according to the conference information, so that the second terminal displays the conference status of the first terminal according to the reminder information.
2. The method according to claim 1, characterized in that: The determining, according to the conference information, whether the first terminal is a target terminal includes: Reading the terminal identification information of the first terminal from the conference information; Querying whether the terminal identification information exists in the target terminal list; If the terminal identification information exists in the target terminal list, querying whether the terminal identification information exists in the white list; If the terminal identification information does not exist in the white list, the first terminal is determined as the target terminal.
3. The method according to claim 1, characterized in that The obtaining of conference information of at least one first terminal includes: Before or during the video conference, receiving the conference information from the first terminal, or acquiring the conference information from a second server; The second server is used to monitor the heartbeat data of the first terminal.
4. The method according to claim 3, characterized in that The receiving the conference information from the first terminal includes: When the first terminal responds to the user's active leaving operation, the conference information is received from the first terminal by using the conference interface of the first server.
5. The method according to claim 3, characterized in that: The acquiring the conference information from the second server includes: When the second server fails to monitor the heartbeat data of the first terminal, the conference information is received from the second server.
6. The method according to claim 3, characterized in that The sending the reminder information of the first terminal to the second terminal according to the conference information includes: generating the reminder information according to the meeting information; The reminder information is sent to the second server by using the streaming media interface of the second server, so that the second server forwards the reminder information to the second terminal.
7. The method according to claim 2, characterized in that Before acquiring the conference information of at least one first terminal, the method further includes: Acquire terminal information of the target terminal from the second terminal; Creating and updating the target terminal list and the whitelist according to the terminal information; The conference participation information is transmitted to the target terminal according to the terminal information.
8. A video conference processing system, characterized in that: Applied to a first server, the system comprises: A conference information acquisition module, used to acquire conference information of at least one first terminal, wherein the conference information includes a conference status of the first terminal in a video conference; A target terminal determination module, configured to determine whether the first terminal is a target terminal according to the conference information, wherein the target terminal indicates a terminal for key participants to access the video conference; The target terminal reminder module is used to send reminder information of the first terminal to the second terminal according to the conference information if the first terminal is the target terminal, so that the second terminal displays the conference status of the first terminal according to the reminder information.
9. An electronic device, characterized in that: include: one or more processors; and One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, enable the electronic device to execute the video conference processing method as described in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: The computer program stored therein enables the processor to execute the video conference processing method as described in any one of claims 1 to 7.
