Alarm method and system of video conference system, medium, equipment and program product

Abstract

The invention discloses an alarm method and system of a video conference system, a medium, equipment and a program product. The alarm method applied to a server comprises the following steps: in response to receiving first alarm information sent by a first edge node, determining whether to push the first alarm information according to a global alarm rule corresponding to a video conference system, the first edge node being any one of at least one edge node, and the global alarm rule corresponding to the video conference system; the first alarm information is generated by the first edge node based on a local alarm rule and index data of the first conference terminal, and the local alarm rule comprises alarm triggering conditions corresponding to each conference terminal in the first conference terminal; and if it is determined that the first alarm information is pushed, pushing the first alarm information to an alarm analysis system. The local and global analysis combined mode not only considers the special condition of each conference terminal, but also can grasp the operation state of the conference terminal on the whole, thereby effectively avoiding the problems of false alarm and missed alarm caused by the adoption of a global alarm threshold, and improving the alarm accuracy.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to an alarm method, system, medium, device and program product for a video conferencing system. Background Art

[0002] With the popularity of remote meetings and virtual meetings, video conferencing systems play a vital role in modern communication. Video conferencing systems are usually set up on servers or integrated into building automation systems, and run independently on-site in buildings. They are designed to centrally monitor and manage conference room audio and video equipment in a single building, such as cameras, microphones, speakers, video conferencing terminals, etc. By collecting information such as equipment operating status and performance indicators in real time, equipment failures or abnormal conditions can be discovered in a timely manner, thereby improving the overall operation and maintenance efficiency and user experience of office audio and video equipment. Among them, video conferencing systems usually use global alarm thresholds to determine whether each device is abnormal. However, the alarm thresholds for different devices and different environments may be different. Using global alarm thresholds for alarms may affect the accuracy of alarms and cause false alarms and missed alarms. Summary of the invention

[0003] This summary is provided to introduce concepts in a brief form that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0004] In a first aspect, the present disclosure provides an alarm method for a video conferencing system, the video conferencing system comprising a server, at least one conference terminal and at least one edge node, wherein each edge node is connected to the server, and each edge node is connected to at least one conference terminal, the method is applied to the server, and the method comprises: in response to receiving a first alarm message sent by a first edge node, determining whether to push the first alarm message according to a global alarm rule corresponding to the video conferencing system; wherein the first edge node is any one of the at least one edge node, the first alarm message is generated by the first edge node based on a local alarm rule and indicator data of the first conference terminal, the first conference terminal comprises at least one conference terminal connected to the first edge node, the local alarm rule comprises an alarm trigger condition corresponding to each of the first conference terminals; if it is determined to push the first alarm message, the first alarm message is pushed to an alarm analysis system.

[0005] In a second aspect, the present disclosure provides an alarm method for a video conferencing system, the video conferencing system comprising a server, at least one conference terminal and at least one edge node, wherein each edge node is connected to the server, and each edge node is connected to at least one conference terminal, the method is applied to a first edge node, the first edge node is any one of the at least one edge node, the method comprises: obtaining local alarm rules and indicator data of a first conference terminal; wherein the first conference terminal comprises at least one conference terminal connected to the first edge node, the local alarm rules comprise alarm trigger conditions corresponding to each of the conference terminals in the first conference terminals; for each of the first conference terminals, if the indicator data of the conference terminal meets the alarm trigger condition corresponding to the conference terminal, a first alarm message is generated; and the first alarm message is sent to the server.

[0006] In a third aspect, the present disclosure provides a video conferencing system, comprising: at least one conferencing terminal; at least one edge node, wherein each edge node is connected to at least one conferencing terminal, and the edge node is used to execute the alarm method of the video conferencing system provided in the second aspect of the present disclosure; and a server, wherein the server is respectively connected to each of the at least one edge node, and the server is used to execute the alarm method of the video conferencing system provided in the first aspect of the present disclosure.

[0007] In a fourth aspect, the present disclosure provides a computer-readable medium having a computer program stored thereon, which, when executed by a processing device, implements the steps of the alarm method for the video conferencing system provided in the first aspect of the present disclosure, or implements the steps of the alarm method for the video conferencing system provided in the second aspect of the present disclosure.

[0008] In a fifth aspect, the present disclosure provides an electronic device, comprising: a storage device on which a computer program is stored; and a processing device for executing the computer program in the storage device to implement the steps of the alarm method for the video conferencing system provided in the first aspect of the present disclosure, or to implement the steps of the alarm method for the video conferencing system provided in the second aspect of the present disclosure.

[0009] In a sixth aspect, the present disclosure provides a computer program product, comprising a computer program, which, when executed by a processor, implements the steps of the alarm method for the video conferencing system provided in the first aspect of the present disclosure, or implements the steps of the alarm method for the video conferencing system provided in the second aspect of the present disclosure.

[0010] In the above technical solution, the video conferencing system adopts a cloud-edge collaborative architecture, which specifically includes a server, at least one conference terminal and at least one edge node. Among them, after the edge node obtains the indicator data of the first conference terminal, it can generate alarm information for the corresponding conference terminal according to the alarm trigger conditions (i.e., local alarm rules) corresponding to each conference terminal in the first conference terminal. In this way, the edge node can set personalized alarm thresholds according to the specific operating scenarios of the local conference terminal, such as load, business cycle, etc. When an abnormality occurs in the first conference terminal, the edge node can detect and produce preliminary screening alarms in time according to the local local alarm rules. For some urgent conference terminal failures, the edge node can directly trigger a local alarm without waiting for the data to be transmitted to the server and then undergoing a complex processing flow, thereby improving the timeliness of the alarm. In addition, after generating the alarm information, each edge node synchronizes it to the server, so that the server uses the global alarm rules to analyze the alarm information from a global perspective to determine whether to push it to the alarm analysis system. This combination of local and global analysis not only takes into account the special circumstances of each conference terminal, but also grasps the operating status of the conference terminal as a whole, effectively avoiding the problem of false alarms and missed alarms caused by the use of global alarm thresholds, and improving the accuracy of alarms. In addition, under the cloud-edge-end collaborative architecture, the edge node is close to the data source, and can timely collect and preprocess the indicator data of the local conference terminal, while the server can concentrate resources on in-depth analysis and mining of key data processed by the edge node. In this way, a large amount of initial data processing is completed at the edge node, reducing the amount of data that needs to be transmitted to the server, avoiding congestion and delays caused by the transmission of a large amount of data in the network, and reducing the burden of server processing, thereby improving the data processing efficiency of the entire system. In addition, each edge node can collect indicator data in parallel, effectively dispersing the pressure of indicator collection. Even if there is a temporary problem in the network connection between some edge nodes and the server, it will not affect the indicator data collection and transmission of other edge nodes, reducing the impact of network congestion on indicator data collection.

[0011] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale. In the drawings:

[0013] Figure 1 The figure is a topology diagram of a video conferencing system according to an exemplary embodiment.

[0014] Figure 2 The diagram is an architecture diagram of a video conferencing system according to an exemplary embodiment.

[0015] Figure 3 The present invention is a flowchart showing an alarm method of a video conferencing system applied to a server according to an exemplary embodiment.

[0016] Figure 4 It is a schematic diagram showing a general device data model according to an exemplary embodiment.

[0017] Figure 5 The present invention is a flowchart showing a method for acquiring dynamic indicator data of a first conference terminal according to an exemplary embodiment.

[0018] Figure 6 The figure is a schematic diagram showing an indicator collection method according to an exemplary embodiment.

[0019] Fig. 7A It is a schematic diagram showing an indicator collection method according to another exemplary embodiment.

[0020] Figure 7B is a schematic diagram showing an indicator collection method according to yet another exemplary embodiment.

[0021] Figure 8 The figure is a schematic diagram showing the flow of alarm data according to an exemplary embodiment.

[0022] Fig. 9 The diagram is a schematic diagram showing a time series data storage structure according to an exemplary embodiment.

[0023] Fig.10 The present invention is a flowchart showing an alarm method for a video conferencing system applied to a first edge node according to an exemplary embodiment.

[0024] Fig.11 The present invention is a flowchart of a device control method of a video conferencing system applied to a first edge node according to an exemplary embodiment.

[0025] Fig.12 It is a schematic diagram showing an output and an output of a function f(x, y) according to an exemplary embodiment.

[0026] Fig.13 The figure is a control logic diagram of a function f(x, y) according to an exemplary embodiment.

[0027] Fig.14 It is a schematic diagram of a cloud-edge data synchronization process according to an exemplary embodiment.

[0028] Fig.15It is a schematic diagram of a process of synchronously sending cloud-edge data according to an exemplary embodiment.

[0029] Fig.16 The invention is a block diagram showing an alarm device of a video conferencing system applied to a server according to an exemplary embodiment.

[0030] Fig.17 The present invention is a block diagram showing an alarm device of a video conferencing system applied to a first edge node according to an exemplary embodiment.

[0031] Fig.18 The diagram is a schematic structural diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0032] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0033] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0034] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0035] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0036] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0037] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0038] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0039] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0040] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0041] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0042] At the same time, it is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0043] The present disclosure provides a video conferencing system that can adopt a cloud-edge-end collaborative architecture, which is a distributed computing architecture that rationally allocates computing resources of cloud computing (cloud), edge computing (edge) and conference terminals (ends), and realizes data processing, storage and transmission through efficient communication and collaboration mechanisms to meet the needs of different application scenarios. This model aims to improve the efficiency and response speed of data processing, reduce latency, and improve data security.

[0044] Among them, cloud computing is an Internet-based computing model that provides users with remote computing, storage and software services by concentrating a large number of computing resources (including servers, storage devices, network devices, etc.) in data centers. Cloud computing is executed by servers in the cloud. Cloud computing has powerful computing power and massive storage capacity, and can handle large-scale and complex data tasks.

[0045] Edge computing is a computing mode that processes data at the edge of the network close to the data source or user end. In modern work environments, there are a large number of conference terminals (such as sensors, cameras, conference hosts, etc.), which generate a large amount of data. Edge computing deploys computing resources and capabilities to edge nodes (such as edge servers, gateways, etc.) close to these devices, so that data can be processed locally and instantly, reducing the delay of data transmission to cloud servers and alleviating the pressure on network bandwidth and server data processing.

[0046] Specifically, the video conferencing system may include a server, at least one conference terminal, and at least one edge node, wherein each edge node is connected to the server, and each edge node is connected to at least one conference terminal. The edge nodes may be arranged according to buildings, floors, etc.

[0047] The conference terminal is the part closest to the user in the cloud-edge architecture, including various audio and video devices, such as displays, cameras, video conferencing hosts, etc. The main function of the conference terminal is to collect data and send the data to the edge node or directly to the server. At the same time, it can also receive instructions from the server or edge node and perform corresponding operations.

[0048] The conference terminals of a video conferencing system usually include the following main components to ensure that the conference can proceed smoothly and provide a high-quality audio and video experience:

[0049] Video display devices, which can be large-screen monitors or projectors for displaying remote videos or presentations, or smart TVs or interactive whiteboards. For example, to increase interactivity, touch screens can be used for direct operation, facilitating meeting interactions and presentations.

[0050] Video acquisition equipment, which can be a high-definition fixed camera that supports high resolution, or an intelligent tracking PTZ camera that can automatically adjust the focus and PTZ angle according to the speaker's position;

[0051] Audio acquisition and playback equipment, including conference-specific microphones and speaker systems. Microphones usually include desktop microphones, ceiling array microphones, and wireless handheld microphones. The audio system includes speakers and amplifiers to ensure that the audience in the conference room can clearly hear the voices of remote participants.

[0052] Video conferencing host, which is a host in the conference room used to run video conferencing software and services. The above software provides video and audio communication functions, as well as some additional collaboration tools such as screen sharing and file transfer;

[0053] The control host, combined with the touch panel, is used to control all equipment used in the meeting, such as lighting, air conditioning, audio and video equipment, curtains, fresh air fans, etc.

[0054] Ancillary equipment may include a conference room reservation system and a conference room sensor system. The conference room reservation system can be integrated outside the conference room door to display the conference room reservation status to avoid conference disruptions. The conference room sensor system is used to monitor and manage the environment and usage of the conference room. Such systems usually include a variety of different types of sensors to automatically collect data and perform control to improve the efficiency of conference room use and the experience of participants. Conference room sensor systems usually include the following: temperature and humidity sensors, air quality detection sensors, light intensity sensors, occupancy sensors, etc.

[0055] The video conferencing system provided by the present disclosure can be a system across multiple sites / buildings and facing a large number of conference devices. Figure 1 As shown, the video conferencing system may include a server, an edge node a deployed in building A, an edge node b deployed in building B, an edge node c deployed in building C, and multiple conference terminals (such as Figure 1 The server may be connected to each edge node via the Internet, and each edge node may be connected to a conference terminal via a wired or wireless local area network (e.g., Bluetooth, network cable, WiFi, etc.).

[0056] Figure 2 FIG. 1 is an architecture diagram of a video conferencing system according to an exemplary embodiment. Figure 2 As shown, the video conferencing system includes an end side (i.e., a conference terminal side), an edge side (i.e., an edge node side), and a server, and has a two-way data transmission capability between adjacent layers.

[0057] like Figure 2 As shown in the figure, the end side includes conference terminals based on embedded systems and conference terminals based on advanced operating systems. Among them, conference terminals based on embedded systems such as video conference terminals, cameras, commercial displays, microphones, and network digital amplifiers are used to support audio and video communication functions and realize remote audio and video interaction through the network. Conference terminals based on embedded systems such as audio matrix processors, video switchers, lighting controllers, and indoor environment sensors are used in professional audio processing, video switching, scene linkage, and lighting control.

[0058] Conference terminals based on advanced operating systems can be, for example, dedicated conference hosts (based on advanced operating systems such as Windows, Android, Linux, etc.) for running video conferencing software, smart TVs, central control hosts, device gateways, conference control touch tablets (based on advanced operating systems such as Android, Ios, etc.), etc.

[0059] The end side usually needs to support at least one common Internet of Things (IoT) communication protocol to collect data from conference terminals according to the device type, such as Simple Network Management Protocol (SNMP), Message Queuing Telemetry Transport (MQTT), Transmission Control Protocol / Internet Protocol (TCP / IP), etc. For conference terminals with different protocols, the edge side collects data through the corresponding protocol parsing module. The collected data includes the operating status of the conference terminal (such as power on, power off), dynamic indicators, fault information, etc.

[0060] like Figure 2 As shown in FIG, the edge side is located in the middle layer between the server and the end side. Generally, edge nodes are deployed near the end side. These edge nodes can be dedicated edge servers or intelligent terminals with computing capabilities. Figure 2 As shown, the edge side is mainly composed of an edge data transmission module, an edge data processing module and an edge application module.

[0061] The edge data transmission module is used to communicate with the conference terminal, and mainly consists of two parts: receiving device status and sending device control instructions. The module can adapt to the communication protocols supported by different devices for two-way communication. Among them, the device in the present disclosure includes a conference terminal.

[0062] The edge data processing module is used for data collection, data detection, data storage, and device polling rule processing. Among them, the dynamic indicator data of each conference terminal can be collected centrally through general software tools. The configuration data that these tools rely on can be personalized on the edge side, and part of it can be sent uniformly from the server, thereby increasing the flexibility of configuration management under the cloud-edge architecture; data detection can also determine whether to generate preliminary alarm data based on the alarm configuration of the alarm analysis tool, that is, to perform initial alarm screening. Among them, dynamic indicators refer to performance parameters that change over time, which can reflect the performance changes of conference terminals at different time points, such as CPU usage, temperature, pressure, etc.

[0063] Data storage refers to the persistent storage of alarm data after initial screening in the relational database on the edge side. Device polling rule processing is the periodic automatic execution of rules for designated conference terminals. For example, regularly turning on and off smart TVs. Similarly, device polling rules can be divided into unified rules issued by the server and personalized rules configured by each edge node.

[0064] The edge application module contains the basic application data on the edge side, such as core data such as edge users, permissions, area management, device management, alarm management, and rule management. Figure 2 As shown, the edge application module is used to implement the following functions:

[0065] Real-time monitoring and control: mainly displays the status of conference terminals in the user-specified area and related alarm indicators, and receives device control instructions issued by users;

[0066] Artificial Intelligence (AI) model analysis: Analyze the collected audio and video signals through a pre-trained neural network model to make fault judgments on certain types of data. For example, collect and play the sound of microphones, speakers, and all-in-one conference machines to generate corresponding types of preliminary screening alarms. The AI ​​model can be, for example, a Deep Noise Suppression (DeepNS) model based on artificial intelligence, a recurrent neural network, etc.

[0067] Data reporting server: Initial screening alarms, changes in equipment attributes and other data are reported to the server for data synchronization;

[0068] Front-end interactive service: Human-computer interactive service on the edge side can be in various interactive presentation forms such as web pages, mobile terminals, and applications. Users can interactively change the properties, indicator configuration, alarm configuration, polling configuration and other information of the conference terminal connected to the edge node.

[0069] The server needs to provide powerful computing, storage and data analysis capabilities. As the core management and analysis center of the entire video conferencing system, it is generally built and deployed in a server room with cloud computing capabilities. The server and the edge side rely on the gateway for network communication, and store and process the data sent by the server and reported by the edge side through message queues and other methods. The server manages all edge side services and performs tasks such as configuration distribution, data collection and aggregation, and status detection.

[0070] like Figure 2 As shown, the server is mainly composed of a server data processing module and a server application module.

[0071] like Figure 2As shown, the server data processing module is used to realize edge reported data reception, data cleaning, data analysis, data storage, third-party application interface docking, data filtering and sending. Among them, edge reported data reception refers to the preliminary docking and reception of alarm data, device attribute update and other data reported by the edge side; data cleaning refers to the data format verification, data duplication removal, data logic conversion and other operations on various data; data analysis: refers to the use of alarm analysis tools to analyze alarm data, combined with alarm triggering or suppression configuration rules to generate alarm data that meets business expectations; data storage refers to the establishment of data storage infrastructure on the server, such as relational databases or non-relational databases, message queues, etc., for storage, synchronization, and processing of various types of data required.

[0072] like Figure 2 As shown, the server application module contains the basic components of the server application, such as cache, message queue, basic application code, etc., which are strongly dependent on other applications. The server application module is used to implement server area management, data and configuration synchronization edge, alarm distribution, data dashboard and front-end interactive services.

[0073] Among them, cloud edge area management: the server stores data of all management areas, such as countries, cities, sites, floors, etc., and divides the management relationship between the edge and each area according to the deployment of the edge side. According to the relationship, the area itself and its associated equipment, alarm configuration and other data are synchronously sent to the corresponding edge node.

[0074] Data and configuration are sent to the edge synchronously: In addition to the above-mentioned differentiated sending by regional association, some server data will be sent to each edge node synchronously in full, for example, unified device indicator collection rules and device polling execution rules.

[0075] Alarm distribution: The initial screening alarm information on the edge side is processed by layers of business logic rules to generate alarm data to be pushed, and the alarm data is pushed according to the configuration.

[0076] Data dashboard and front-end interactive services: The server's human-computer interaction services can be in various interactive forms such as web pages, mobile terminals, and applications. Users can interact with data such as space, equipment, alarms, rules, and configurations in the operating system.

[0077] Figure 3 FIG. 1 is a flow chart showing an alarm method for a video conferencing system applied to a server according to an exemplary embodiment. Figure 3 As shown, the alarm method of the video conferencing system applied to the server may include the following S101 and S102.

[0078] In S101, in response to receiving first alarm information sent by a first edge node, it is determined whether to push the first alarm information according to a global alarm rule corresponding to the video conferencing system.

[0079] In S102, if it is determined to push the first alarm information, the first alarm information is pushed to the alarm analysis system.

[0080] In the present disclosure, the first edge node is any one of the at least one edge node mentioned above in the video conferencing system.

[0081] The first alarm information is generated by the first edge node based on local alarm rules and indicator data of the first conference terminal, wherein the first conference terminal includes at least one conference terminal connected to the first edge node, and the local alarm rules may include alarm trigger conditions corresponding to each conference terminal in the first conference terminal, specifically including alarm thresholds corresponding to the corresponding conference terminals, wherein the alarm thresholds are configurable.

[0082] Index data may include dynamic index data and performance index data, wherein performance indicators generally refer to indicators for measuring the audio and video quality of audio and video equipment such as microphones and speakers, for example, the frequency response of microphones and speakers, total harmonic distortion, the speech intelligibility (Short-Time Objective Intelligibility, STOI) of speakers, freezes, etc.

[0083] Specifically, the first edge node can first obtain the local alarm rules and indicator data of the first conference terminal; then, for each conference terminal in the first conference terminal, if the indicator data of the conference terminal meets the alarm trigger condition corresponding to the conference terminal, a first alarm message is generated and the first alarm message is sent to the server; after receiving the first alarm message sent by the first edge node, the server can determine whether to push the first alarm message to alarm analysis systems such as big data analysis, data mining, work order service system, and office communication system according to the global alarm rules corresponding to the video conferencing system; when the server determines to push the first alarm message to the alarm analysis system, it can push the first alarm message to the alarm analysis system.

[0084] In addition, the local alarm rule may be stored in the server. In this case, the first edge node may obtain the local alarm rule corresponding to it by communicating with the server.

[0085] In the above technical solution, the video conferencing system adopts a cloud-edge collaborative architecture, which specifically includes a server, at least one conference terminal and at least one edge node. Among them, after the edge node obtains the indicator data of the first conference terminal, it can generate alarm information for the corresponding conference terminal according to the alarm trigger conditions (i.e., local alarm rules) corresponding to each conference terminal in the first conference terminal. In this way, the edge node can set personalized alarm thresholds according to the specific operating scenarios of the local conference terminal, such as load, business cycle, etc. When an abnormality occurs in the first conference terminal, the edge node can detect and produce preliminary screening alarms in time according to the local local alarm rules. For some urgent conference terminal failures, the edge node can directly trigger a local alarm without waiting for the data to be transmitted to the server and then undergoing a complex processing flow, thereby improving the timeliness of the alarm. In addition, after generating the alarm information, each edge node synchronizes it to the server, so that the server uses the global alarm rules to analyze the alarm information from a global perspective to determine whether to push it to the alarm analysis system. This combination of local and global analysis not only takes into account the special circumstances of each conference terminal, but also grasps the operating status of the conference terminal as a whole, effectively avoiding the problem of false alarms and missed alarms caused by the use of global alarm thresholds, and improving the accuracy of alarms. In addition, under the cloud-edge-end collaborative architecture, the edge node is close to the data source, and can timely collect and preprocess the indicator data of the local conference terminal, while the server can concentrate resources on in-depth analysis and mining of key data processed by the edge node. In this way, a large amount of initial data processing is completed at the edge node, reducing the amount of data that needs to be transmitted to the server, avoiding congestion and delays caused by the transmission of a large amount of data in the network, and reducing the burden of server processing, thereby improving the data processing efficiency of the entire system. In addition, each edge node can collect indicator data in parallel, effectively dispersing the pressure of indicator collection. Even if there is a temporary problem in the network connection between some edge nodes and the server, it will not affect the indicator data collection and transmission of other edge nodes, reducing the impact of network congestion on indicator data collection.

[0086] Since the communication protocols and control protocols used by devices (i.e., conference terminals) produced by different manufacturers are usually significantly different, such differences make these devices face many challenges in mutual communication, collaborative work, and unified control. The interaction between hardware devices and software will also cause problems due to protocol heterogeneity. In order to solve the problems caused by device heterogeneity, the present invention abstracts and integrates different types of devices, establishes a general device data model, summarizes abstract device attributes and strips device indicator data, and stores device communication-related information in the "communication protocol" and "configuration information" fields, thereby solving the relational database storage, query, and device object communication problems caused by device heterogeneity.

[0087] Specifically, we can design and define the device data table by sorting out the physical properties and communication methods of the device itself, such as Figure 4 As shown, device attributes can be divided into three categories, namely, basic attributes, static attributes and control attributes.

[0088] Among them, the basic attributes are used to represent the uniqueness of the device (i.e., conference terminal) and other basic attributes of the database, and are usually used as the main search and filter fields. For example, the basic attributes include terminal identification, terminal name, and space identification (i.e., space information), wherein the terminal identification can be the universally unique identifier (Universally Unique Identifier, UUID) of the conference terminal, and the terminal identification can be the identification information mainly relied on when performing any processing on the conference terminal; the space identification can be the identification of the geographical space (i.e., area, for example, building identification) where the corresponding conference terminal is located, and the space identification is used to characterize the actual physical space to which the conference terminal belongs, and the space identification is the filtering condition used by the related functions of space retrieval.

[0089] Static attributes are defined as the summary of all the unchanged or relatively small changing attributes of all devices. These fields are not only used to record device attributes, but are also usually used as auxiliary fields for device retrieval and screening. Figure 4 As shown, static attributes may include attributes such as brand, model, Media Access Control Address (MAC) address, firmware version (ie, the current software version of the device), and serial number.

[0090] The control attribute is used to distinguish devices and match dedicated communication protocols to achieve communication with devices, and is also used to save the configuration information of devices. Since there are large differences in the configuration information of different devices, all fields required for control, such as Internet Protocol Address (IP address), communication password, and other unique information related to normal communication, are uniformly configured in the configuration information field. At the same time, different configuration templates are used according to the communication protocol, so that the necessary configuration information can be prompted when the device is entered. Among them, the communication protocols supported by the device can be, for example, SNMP, KNX, etc. The video conferencing system uses the corresponding protocol to communicate with the device, and the device also has the corresponding control function under the protocol.

[0091] The device information of each conference terminal in the video conference system may be stored in the server, that is, the server stores the device information of each conference terminal in the video conference system.

[0092] In addition, in order to maintain the logical correspondence between the device and the physical space more intuitively and efficiently, the device information of the conference terminal uses the space identifier as the primary key, that is, the device information is associated and bound with the space identifier.

[0093] The following is a detailed description of the specific implementation of the first edge node obtaining the indicator data of the first conference terminal. Specifically, the first edge node can obtain the indicator data of the first conference terminal by polling according to the second preset period. For example, the polling frequency can be set to 10 seconds / time. Specifically, during each polling, the first edge node can obtain the indicator data of the first conference terminal by Figure 5 The dynamic indicator data of the first conference terminal is obtained by performing S201 to S203 shown in FIG.

[0094] In S201, conference terminals in the first conference terminals are grouped according to type to obtain at least one terminal group.

[0095] In S202, for each terminal group, a coroutine corresponding to the terminal group is created, and a collection macro corresponding to the first type is obtained.

[0096] In S203, based on the collection macro, the dynamic indicator data of each conference terminal in the terminal group is obtained through the coroutine corresponding to the terminal group.

[0097] In the present disclosure, in order to facilitate the real-time adjustment of the dynamic indicator items that need to be collected by different conference terminals, different collection macros can be configured for different terminal types. Each collection macro is used to define the dynamic indicator items that need to be collected by the corresponding terminal type. The content of the collection macro can be changed in real time. When the collection macro is changed, the dynamic indicator items collected in the next polling will change immediately. Specifically, at the beginning of each polling, each conference terminal in the first conference terminal can be grouped according to type to obtain at least one terminal group; then, for each terminal group, a coroutine corresponding to the terminal group is created, and according to the pre-established correspondence between the terminal type and the collection macro, the collection macro corresponding to the first type is obtained, wherein the collection macro corresponding to the first type is used to indicate the dynamic indicator items that need to be collected by the first type of conference terminal, and the first type is the type of conference terminal in the terminal group; then, based on the collection macro, the dynamic indicator data of each conference terminal in the terminal group is obtained through the coroutine corresponding to the terminal group. When the first conference terminal includes multiple terminal groups, the coroutines corresponding to the multiple terminal groups can be executed asynchronously and independently, thereby obtaining dynamic indicator data of each conference terminal in the first conference terminal in an asynchronous manner, thereby improving the efficiency of obtaining dynamic indicator data.

[0098] The following is a detailed description of the specific implementation method of the first edge node in S203 obtaining the dynamic indicator data of each conference terminal in the terminal group through the coroutine corresponding to the terminal group. Specifically, the first edge node can interact with each conference terminal in the terminal group through the coroutine corresponding to the terminal group to obtain the dynamic indicator data of these conference terminals.

[0099] Specifically, the conference terminals in the video conferencing system can provide multi-dimensional data collection services to obtain dynamic indicator data. Among them, the indicator collection module can choose independent deployment mode or integrated deployment mode according to the managed capabilities of the conference terminals to ensure efficient adaptation of data collection and management in different scenarios.

[0100] For conference terminals based on advanced operating systems, they have the conditions to independently deploy indicator collection modules. In this case, the indicator collection module can be independently deployed on conference terminals with advanced operating systems to collect their own dynamic indicator data (i.e., operating indicators) and static data (e.g., the above-mentioned device information) in real time. For conference terminals based on embedded systems, they do not have the conditions to independently deploy indicator collection modules. In this case, the indicator collection module can be integrated into the edge node to realize data collection of the collection target (i.e., conference terminals based on embedded systems) through specific protocols.

[0101] For different deployment modes of the indicator collection module, the above-mentioned coroutine can adopt different indicator collection methods. Specifically, for a conference terminal based on an advanced operating system, the indicator collection module is independently deployed on the conference terminal. At this time, the coroutine can send an indicator collection instruction to the conference terminal; after receiving the collection instruction, the conference terminal based on the advanced operating system, such as Figure 6 As shown, the original indicators of the conference terminal can be collected by an indicator collection module independently deployed in the conference terminal. The indicator collection module can specifically collect the initial dynamic indicator data of the conference terminal by running a script, and perform data processing (i.e., standard formatting) on ​​it to obtain the dynamic indicator data (i.e., original indicators) of the conference terminal. At this time, the conference terminal itself serves as the collection target and collects its own original indicators; afterwards, the conference terminal can send the collected original indicators to the first edge node; after receiving the original indicators, the first edge node can post-process the original indicators, specifically by associating the device information such as the terminal identification and space identification of the conference terminal with the original indicators to obtain standardized indicators. Among them, the first edge node can also collect the static data of the conference terminal through the indicator collection module in the conference terminal according to the third preset period, and synchronize it to the server to ensure the accuracy of the static data of the conference terminal stored by the server.

[0102] For conference terminals based on embedded operating systems, the indicator collection module is integrated and deployed on the first edge node. Fig. 7A As shown, the coroutine can collect the dynamic indicator data of the conference terminal through the indicator collection module integrated in the first edge node. The indicator collection module can specifically collect the initial dynamic indicator data of the conference terminal by running a script, and perform data processing on it to obtain a standardized indicator. The data processing may include standardizing the initial dynamic indicator data to obtain the dynamic indicator data (i.e., the original indicator) of the conference terminal, and then associating the original indicator with the device information of the conference terminal to obtain a standardized indicator.

[0103] In addition, the conference terminal based on the embedded operating system can also actively report its own initial dynamic indicator data to the indicator collection module on the first edge node, such as Figure 7B As shown, the indicator collection module on the first edge node can actively monitor the initial dynamic indicator data reported by the conference terminal, and then process the data to obtain the standardized indicator. The data processing may include standardizing the initial dynamic indicator data to obtain the dynamic indicator data (i.e., the original indicator) of the conference terminal, and then associating the original indicator with the device information of the conference terminal to obtain the standardized indicator.

[0104] According to the special properties of dynamic indicators, when consuming data, more attention is paid to the changes in its status and the time of occurrence. Therefore, Figure 8 As shown, the first edge node can select the time series database as the storage medium to record the acquired dynamic indicator data. In the actual historical data analysis process of the dynamic indicators of the conference terminal, the time series database can be used to query the changes of each collected indicator and the time point of its occurrence, and it can also be convenient to perform statistical operations on the historical data of the same conference terminal, and can also compare and calculate the historical data of different conference terminals.

[0105] After the first edge node obtains the dynamic indicator data of the conference terminal, Fig. 9 As shown, the space identifier of the conference terminal, the terminal identifier, the dynamic indicator data of the conference terminal, and the acquisition timestamp (timestamp) of the dynamic indicator data can be stored in the time series database as a time series data.

[0106] The dynamic indicator data may include an indicator name (filed) and an indicator value (value). The space identifier may be stored as a measurement name, and the dynamic indicator data of all conference terminals in the same geographic space may be stored in the same measurement table. In addition, the terminal identifier may be used as a data tag to distinguish different conference terminals in the measurement table and as a search condition.

[0107] In addition to dynamic indicator data, the indicator data of the conference terminal also includes performance indicator data. Figure 8 As shown, for a conference terminal based on an advanced operating system, the dynamic indicator data of the conference terminal can be collected by an indicator collection module deployed on the conference terminal. For a conference terminal based on an embedded system, the dynamic indicator data of the conference terminal can be collected by an indicator collection module integrated on the first edge node. At the same time, the audio and video data of each audio and video device in the first conference terminal can be collected by a conference room audio data collection module deployed on the conference terminal, and synchronized to the first edge node, so that the first edge node can use the AI ​​model to analyze the audio and video instructions of the audio and video devices in the first conference terminal to obtain performance indicator data of the conference terminal, and by comparing the performance indicator data with the corresponding alarm threshold, abnormal indicators are found, and the original alarm event is triggered, that is, the first alarm data is generated.

[0108] like Figure 8 As shown, after obtaining the dynamic indicator data of the first conference terminal, the first edge node can observe the indicator values ​​and change rules of the dynamic indicator data in the time series database through the alarm rule engine to identify abnormal indicators, and trigger the original alarm event in combination with the local alarm rule, that is, generate the original alarm data. Figure 8 As shown, in addition to the time series database and the alarm rule engine, the first edge node may also include an alarm management module, a local alarm data management pool, and an alarm cloud-edge synchronization module. Among them, the server can store alarm trigger rules, which can accurately define the alarm type based on the actual needs of the business and build a judgment logic that matches it. At the same time, considering the uniqueness of different edge rules, exclusive trigger logic is customized for them to ensure that the alarm trigger rules can adapt to the diverse site management requirements and ensure the accuracy of the alarm data, effectively improving the flexibility and reliability of the alarm data. The alarm trigger rules may include local alarm rules corresponding to each edge node and global alarm rules corresponding to the video conferencing system. The first edge node can obtain the local alarm rules corresponding to itself from the server.

[0109] The alarm management module is the core module of the first edge node, which is used to receive and aggregate the original alarm data, and to reshape the alarm data into a structured and labeled form in combination with the basic platform data at the moment of alarm triggering, so as to achieve efficient conversion of data semantics and improve the interpretability and application value of the data. The alarm management module stores the alarm information obtained after the semantic conversion, i.e., the first alarm information, in the local alarm data management pool, and synchronizes it to the server through the alarm cloud-edge synchronization module. Among them, the alarm cloud-edge synchronization module is used to standardize the edge data feedback mechanism and data format, ensure the consistency and compatibility of the feedback data, avoid the edge feedback data difference problem caused by the iteration of the edge node version, and ensure the reliable flow of data.

[0110] like Figure 8 As shown, the server can receive the first alarm information synchronized by the alarm cloud-edge synchronization module in the first edge node through the alarm receiving module, and store it in the alarm data pool. Among them, the alarm receiving module, as the key entry point for all edge site alarm data, will focus on the two key requirements of high concurrency and high availability, provide solid and reliable protection for the alarm data processing link of the entire system, and is a key node for cloud-edge data flow.

[0111] like Figure 8 As shown, the server stores the platform basic data, and the first edge node can obtain the platform basic data at the moment of alarm triggering from the server. Among them, the platform basic data covers the management of basic data and various configuration information, which is the key support for ensuring the normal operation of the platform and realizing various functions. The platform basic data specifically includes space and level information, equipment information, rule configuration data, etc.

[0112] The specific implementation method of determining whether to push the first alarm information according to the global alarm rule corresponding to the video conferencing system in the above S101 is described in detail below.

[0113] Specifically, the global alarm rule corresponding to the video conferencing system is an alarm suppression rule, which specifically includes at least one of the alarm type filtering conditions, time filtering conditions, space filtering conditions and user predefined filtering conditions. At this time, it can be determined whether there is a filtering condition in the global alarm rule that matches the first alarm information. If there is no filtering condition matching the first alarm information in the global alarm rule, it is determined to push the first alarm information. If there is a filtering condition in the global alarm rule that matches the first alarm information, it is determined not to push the first alarm information.

[0114] The alarm type is used to characterize the severity of the alarm, for example, severe, important, minor, and warning. The alarm type filter condition is used to filter out alarm types that users are not concerned about, for example, the alarm type filter condition is used to filter out warning and minor type alarms. The time filter condition is used to filter out alarm periods that users are not concerned about, and the space filter condition is used to filter out alarm areas that users are not concerned about.

[0115] In one implementation, the global alarm rules include alarm type filtering conditions, time filtering conditions, space filtering conditions, and user-predefined filtering conditions. Figure 8 As shown, the first alarm information can be matched with the alarm type filtering condition, the time filtering condition, the space filtering condition and the user predefined filtering condition in sequence to determine whether there is a filtering condition matching the first alarm information in the global alarm rule. Once the corresponding filtering condition is matched, the matching is stopped. At this time, it can be determined that the first alarm information is not pushed; if the user predefined filtering condition is matched, and the user predefined filtering condition still does not match the first alarm information, it is determined that there is no filtering condition matching the first alarm information in the global alarm rule. At this time, it can be determined to push the first alarm information. Alternatively, the first alarm information can be matched with the alarm type filtering condition, the time filtering condition, the space filtering condition and the user predefined filtering condition respectively. If there is a filtering condition matching the first alarm information in the alarm type filtering condition, the time filtering condition, the space filtering condition and the user predefined filtering condition, it is determined to push the first alarm information. If there is no filtering condition matching the first alarm information in the alarm type filtering condition, the time filtering condition, the space filtering condition and the user predefined filtering condition, it is determined not to push the first alarm information.

[0116] In a possible implementation manner, the alarm method of the video conferencing system applied to the server may further include the following steps:

[0117] In response to receiving the first alarm information, the first alarm information is stored in an alarm data pool of the server.

[0118] At this time, the above S102 may include the following two steps:

[0119] If it is determined to push the first alarm information, then the first state of the first alarm information in the alarm data pool is updated to be pushable;

[0120] The second alarm information is pushed to the alarm analysis system according to the first preset period.

[0121] The first state is used to indicate whether the corresponding alarm information meets the push condition, and the first state can be pushable or push-prohibited. The second alarm information includes the alarm information in the alarm data pool whose first state is pushable and whose second state is not successfully pushed. The second state is used to indicate whether the corresponding alarm information is successfully pushed, and the second state can be not successfully pushed or successfully pushed.

[0122] like Figure 8 As shown, after receiving the first alarm information, the alarm receiving module stores it in the alarm data pool, and updates the first state of the first alarm information in the alarm data pool to be pushable through the alarm data state management module. Among them, the alarm state management module is used to efficiently manage and flexibly regulate the business state of the alarm data, ensuring that the alarm information can flow in an orderly manner according to the established logic in the actual business scenario, and solving the problem that the relevant alarm tools cannot manage the alarm business state.

[0123] The server can read the status information of each alarm information in the alarm data status management module according to the first preset period through the alarm push module, and according to the read status information, push the alarm information in the alarm data pool whose first status is pushable and whose second status is unsuccessful push (i.e., second alarm information) to the alarm analysis system. The status information includes the first status and the second status.

[0124] like Figure 8 As shown, the server may further include an alarm data application programming interface (Application Programming Interface, API) module, through which each alarm data in the alarm data pool may be output.

[0125] In a possible implementation manner, the alarm method of the video conferencing system applied to the server may further include the following steps:

[0126] In response to receiving the first response message sent by the alarm analysis system, the second status of the third alarm information in the alarm data pool is updated to push success, wherein the first response message is used to indicate that the third alarm information is pushed successfully.

[0127] In the present disclosure, after receiving the third alarm information pushed by the server, the alarm analysis system can send a first response message to the server to indicate that the third alarm information has been successfully pushed; after receiving the first response message, the server can update the second state of the third alarm information to a successful push through the alarm data state management module. If the server does not receive the first response message within a preset time after the third alarm information is pushed, it indicates that the push of the third alarm information has failed. At this time, the second state of the third alarm information remains unchanged, and the third alarm information can be pushed again in the next push cycle. By maintaining the second state of the alarm information, it can be ensured that the alarm data can be successfully pushed.

[0128] In addition, the state information of the alarm information may include a third state in addition to the first state and the second state, wherein the third state is used to indicate whether the alarm corresponding to the corresponding alarm information is released, and the third state is not released or has been released. At this time, the video conferencing system applied to the server may also include the following two steps:

[0129] In response to receiving the first alarm information, updating the third state of the first alarm information in the alarm data pool to not resolved;

[0130] In response to receiving the indication information sent by the first edge node, the third state of the first alarm information is updated to be released, wherein the indication information is used to indicate that the alarm corresponding to the first alarm information has been released.

[0131] In the present disclosure, when the indicator data that triggers the first alarm information returns to normal, the first edge node can send indication information to the server to indicate that the alarm corresponding to the first alarm information has been released; after receiving the indication information, the server can update the third state of the first alarm information to released through the alarm data state management module. In this way, the user can quickly learn the alarm state of each alarm information through the third state of the alarm information.

[0132] In a possible implementation manner, the alarm method of the video conferencing system applied to the server may further include the following steps:

[0133] In response to receiving the first alarm information, the first alarm information is associated and stored with the first space identifier, wherein each conference terminal connected to the first edge node belongs to the same geographical space, and the first space identifier is the identifier of the geographical space where the conference terminal connected to the first edge node is located.

[0134] The alarm information is stored in association with the space identifier, so that all alarm information in the corresponding geographic space (i.e., area) can be quickly queried through the space identifier, so that the monitoring alarm can be divided by spatial dimension, and the association between conference terminals can be viewed from the perspective of the overall system to quickly locate the fault. For example, when a fault occurs in a certain area, it is possible to quickly focus on the device alarm or status within the space, rather than viewing a single device in isolation. In addition, the division of monitoring alarms in spatial dimensions helps to discover the area where the system's performance bottleneck is located. In the edge side environment, the space is divided according to floors or buildings. If the edge side feedback response corresponding to a certain area is slow, it can be quickly determined whether it is a problem with a certain device or a performance bottleneck caused by insufficient resource allocation in the overall area. This method can analyze performance problems from a macro perspective and take optimization measures in advance.

[0135] Fig.10 FIG. 1 is a flow chart showing an alarm method for a video conferencing system applied to a first edge node according to an exemplary embodiment. Fig.10 As shown, the alarm method of the video conferencing system applied to the first edge node may include the following S401 to S403.

[0136] In S401, local alarm rules and indicator data of the first conference terminal are obtained.

[0137] The local alarm rule includes the alarm triggering conditions corresponding to each conference terminal in the first conference terminal.

[0138] In S402, for each conference terminal in the first conference terminals, if the indicator data of the conference terminal meets the alarm triggering condition corresponding to the conference terminal, first alarm information is generated.

[0139] In S403, the first alarm information is sent to the server.

[0140] The first alarm information is sent to the server, so that the server determines whether to push the first alarm information to the alarm analysis system according to the global alarm rule corresponding to the video conferencing system.

[0141] In the above technical solution, the video conferencing system adopts a cloud-edge collaborative architecture, which specifically includes a server, at least one conference terminal and at least one edge node. Among them, after the edge node obtains the indicator data of the first conference terminal, it can generate alarm information for the corresponding conference terminal according to the alarm trigger conditions (i.e., local alarm rules) corresponding to each conference terminal in the first conference terminal. In this way, the edge node can set personalized alarm thresholds according to the specific operating scenarios of the local conference terminal, such as load, business cycle, etc. When an abnormality occurs in the first conference terminal, the edge node can detect and produce preliminary screening alarms in time according to the local local alarm rules. For some urgent conference terminal failures, the edge node can directly trigger a local alarm without waiting for the data to be transmitted to the server and then undergoing a complex processing flow, thereby improving the timeliness of the alarm. In addition, after generating the alarm information, each edge node synchronizes it to the server, so that the server uses the global alarm rules to analyze the alarm information from a global perspective to determine whether to push it to the alarm analysis system. This combination of local and global analysis not only takes into account the special circumstances of each conference terminal, but also grasps the operating status of the conference terminal as a whole, effectively avoiding the problem of false alarms and missed alarms caused by the use of global alarm thresholds, and improving the accuracy of alarms. In addition, under the cloud-edge-end collaborative architecture, the edge node is close to the data source, and can timely collect and preprocess the indicator data of the local conference terminal, while the server can concentrate resources on in-depth analysis and mining of key data processed by the edge node. In this way, a large amount of initial data processing is completed at the edge node, reducing the amount of data that needs to be transmitted to the server, avoiding congestion and delays caused by the transmission of a large amount of data in the network, and reducing the burden of server processing, thereby improving the data processing efficiency of the entire system. In addition, each edge node can collect indicator data in parallel, effectively dispersing the pressure of indicator collection. Even if there is a temporary problem in the network connection between some edge nodes and the server, it will not affect the indicator data collection and transmission of other edge nodes, reducing the impact of network congestion on indicator data collection.

[0142] Optionally, the indicator data includes dynamic indicator data;

[0143] Obtain the indicator data of the first conference terminal, including:

[0144] Grouping the conference terminals in the first conference terminal according to type to obtain at least one terminal group;

[0145] For each terminal group, a coroutine corresponding to the terminal group is created, and a collection macro corresponding to the first type is obtained, wherein the collection macro is used to indicate the dynamic indicator items that need to be collected by the first type of conference terminals, and the first type is the type of conference terminals in the terminal group; based on the collection macro, the dynamic indicator data of each conference terminal in the terminal group is obtained through the coroutine corresponding to the terminal group.

[0146] Optionally, the indicator data includes dynamic indicator data, and the method further includes:

[0147] For each conference terminal in the first conference terminals, obtaining a space identifier and a terminal identifier of the conference terminal, wherein the space identifier is an identifier of a geographical space where the corresponding conference terminal is located;

[0148] The space identifier, the terminal identifier, the dynamic indicator data of the conference terminal, and the acquisition timestamp of the dynamic indicator data are stored as a time series data in a time series database.

[0149] In a possible implementation manner, the first edge node may also be used to control the conference terminal connected thereto. Fig.11 The conference terminal is controlled by S301 to S307 shown in FIG.

[0150] S301, receiving a first general instruction for a first device.

[0151] S302: Determine whether the first device has a parent device according to configuration information of the first device.

[0152] In the present disclosure, the video conferencing system further includes an extension device and a virtual device, wherein the extension device is used to extend the control function of the corresponding conference terminal, the control function of the corresponding conference terminal is indirectly realized by operating the extension device, and the virtual device is a controlled device that does not really exist in the video conferencing system. The first device is any one of at least one conference terminal, the extension device, and the virtual device. The configuration information of the first device may include the parent device information of the first device and related interface parameters.

[0153] In order to solve the problem of inconsistent communication protocols between different conference terminals, a universal device control method can be defined for the above-mentioned universal device data model, thereby providing a highly unified interface calling method. Specifically, the operations of all devices in the video conferencing system (including at least one conference terminal, expansion devices, and virtual devices) can be abstracted into a consistent format, and no longer distinguish between different device brands, models, and protocols, that is, the dedicated instructions of the device are converted into unified general instructions (i.e., instruction standardization). For example, dedicated instructions such as "power on" and "turn on the light" are all converted into a unified general instruction "ON", and a corresponding relationship between general instructions and dedicated instructions is established.

[0154] Some conference terminals (physical devices) or virtual devices (for example, lighting systems) in the video conferencing system cannot be directly controlled. In this case, the physical devices or virtual devices that originally do not have control capabilities can be defined as "sub-devices". Through the "parent device" capabilities of the sub-device, the "sub-device" is given control capabilities and status indicators, so as to achieve the management and control of physical "sub-devices" and virtual "sub-devices" that do not have control capabilities, meet the requirements of "virtual device control" and "extended device control functions", and enable users to supervise related devices and indicators in the physical space. Among them, the design concept of "sub-devices" and "parent devices" is to simulate and restore the hierarchy of the system design level, and compare the communication and operation logic of "sub-devices" and "parent devices" to similar signal transmission streams, recursively transmit signals layer by layer, and finally achieve control of the "source" device.

[0155] For example, a conference room has built an overall lighting system based on the KNX system. According to the basic principles of the KNX control system, the lights in the conference room are controlled by switching on and off through the KNX bus coupler A1. This is achieved by switching on and off the loop C1 of the KNX actuator B1. In this logic, there is no actual controlled device, lamp D, that is, lamp D is a virtual device. In the actual conference room equipment management and control logic, the status and control of lamp D is an important supervision object. Therefore, by designing the "virtual device" lamp D and correctly associating it with its "parent device", the control of the virtual device can be achieved.

[0156] As another example, some industrial-level conference room audio and video equipment A2 does not have the control function of power off and restart, but its power supply is plugged into a certain interface (for example, the 5th interface C2) of a controllable and manageable sequential power supply B2. Therefore, the conference room audio and video equipment A2 can be understood as being endowed with the "power off and restart" function. The sequential power supply B2 is an extension device used to extend the power off and restart function of the conference room audio and video equipment A2. The power off and restart function of the conference room audio and video equipment A2 is indirectly realized through the 5th interface C2 of the switch sequential power supply B2. This scenario can be defined as the parent device of the conference room audio and video equipment A2 is the sequential power supply B2. At this time, the "parent device" can be added as the sequential power supply B2 in the configuration information of the conference room audio and video equipment A2, and the parameters of the interface position can be added.

[0157] If the first device does not have a parent device, the following S303 to S305 are executed; if the first device has a parent device, S306 and S307 are executed.

[0158] S303: Determine a special instruction corresponding to the first general instruction according to a pre-established correspondence relationship between general instructions and special instructions.

[0159] S304, establishing a connection with the first device, and sending a dedicated instruction to the first device to control the first device according to the dedicated instruction.

[0160] S305: In response to receiving a second response message for the dedicated instruction sent by the first device, standardize the second response message and disconnect from the first device.

[0161] like Fig.12 As shown, the terminal identifier x and the general instruction y of the first device are transmitted as parameters to the predefined function f(x, y) to perform the corresponding operation, and the execution result is standardized, that is, the execution result is converted into a standard output format.

[0162] Among them, Fig.13 As shown in the figure, when processing the f(x,y) logic of different devices, the underlying logic of all device controls is summarized and abstracted into the basic process of "login (establishing connection) - request (sending translation instructions and receiving response) - logout (disconnecting)", a device control base class is created, and three basic methods of login, request, and logout are provided. The external logic controls the device by calling these three common methods.

[0163] When the first device does not have a parent device, it indicates that the first device is a directly controllable device. Fig.13 As shown, the first general instruction can be translated, that is, the first edge node can determine the special instruction corresponding to the first general instruction according to the pre-established correspondence between the general instruction and the special instruction; then, as Fig.13 As shown, the first edge node can log in to the first device and maintain a communication connection, and send a translation instruction, that is, the first edge node establishes a connection with the first device, and sends a dedicated instruction corresponding to the first general instruction to the first device; after receiving the dedicated instruction sent by the first edge node, the first device controls itself according to the dedicated instruction, and after the control is completed, sends a second response message (that is, a dedicated execution result) used to characterize the completion of the control to the first device, and the first device receives the second response message, and then, as shown in FIG. Fig.13 As shown, the first edge node can standardize the execution result and log out of the device. Specifically, it can determine the target general execution result corresponding to the special execution result received from the first device based on the pre-established correspondence between the special execution result and the general execution result, so as to achieve standardization of the special execution result. After that, it can log out of the device, that is, disconnect from the first device. At this time, the control operation corresponding to the first general instruction received by the first edge device has been completed.

[0164] S306: Determine a second general instruction corresponding to the first general instruction according to a pre-established correspondence relationship between general instructions of the device and general instructions of the parent device of the device.

[0165] S307, taking the parent device of the first device as the first device, and taking the second general instruction as the first general instruction, and returning to S302.

[0166] When the first device has a parent device, such as Fig.13 As shown, the first general instruction can be translated, specifically, based on the correspondence between the pre-established general instruction and the general instruction of the parent device of the device, the second general instruction corresponding to the first general instruction is determined; thereafter, the parent device of the first device is used as the first device, and the second general instruction is used as the first general instruction, and the step of determining whether the first device has a parent device (i.e., returning to S302) is returned until the first device has no parent device, at which time the above S303 to S305 can be executed.

[0167] For example, in the above-mentioned example of the overall lighting system based on the KNX system, the control of the lamp D is actually converted into the switch of the loop C1 of its "parent device" KNX actuator B1, and then converted into the communication control of its "parent device" KNX bus coupler A1.

[0168] As another example, in the control example of the conference room audio and video device A2, the power off and restart of the conference room audio and video device A2 is actually converted into a switch operation on the fifth interface C2 of its "parent device" sequential power supply B2.

[0169] Regarding the method in the above embodiment applied to the first edge node, the specific manner of performing the operation in each step has been described in detail in the embodiment of the method related to the server, and will not be elaborated here.

[0170] In addition, if Fig.14 As shown, the above-mentioned alarm triggering rules, platform basic data and other information can be uniformly configured by the server through manual entry or batch import, and for each edge node in the video conferencing system, the global configuration information and data, as well as the local configuration information and data of the edge node are synchronously sent to the edge node.

[0171] Among them, based on the configuration sent by the server, some configurations of the edge nodes, such as device control, collection, alarm, etc., can still be added with the local personalized configuration data of the edge nodes, making the configuration data on the edge side more flexible and complete.

[0172] Edge nodes can flexibly configure various communication protocols and tools to adapt to different types of equipment. For old or special equipment, edge nodes can complete protocol conversion locally, convert their data into a standard format, and then upload it to the server. In this way, no matter what protocol the device uses, it can be included in the monitoring and alarm system, greatly expanding the scope of monitoring equipment and reducing monitoring blind spots.

[0173] In addition, the indicator data of the conference terminal can be reported through the corresponding protocol and the collection configuration of the edge node. The edge node generates a preliminary screening alarm of the edge node based on the indicator data and local alarm rules, and stores the preliminary screening alarm in the time series database, and reports the preliminary screening alarm to the server at the same time; the server can centrally process the preliminary screening alarms reported by each edge node according to the global alarm rules, generate the final alarm data of the server, and send the server alarm data according to the data consumption configuration.

[0174] Among them, Fig.15 As shown in the figure, the technical implementation of synchronous delivery is mainly through the data synchronization replication mechanism of the database and the message broadcast consumption mode of the message queue. When the server database specifies a data table and generates an event of addition, deletion, or modification, the logical replication mechanism is triggered to enter the detailed data of the relevant changes as the producer into the topic specified by the message queue. The topic adopts the broadcast mode to ensure that each edge node can consume the same message when consuming it in the subsequent edge nodes (for example, Fig.15 The message 1) shown is updated to the database of the edge node after being filtered and processed by each edge node. Fig.15 Take three edge nodes as an example for explanation, where the three edge nodes respectively act as consumer f1 (Consumer f1), consumer f2 (Consumer f2), and consumer f3 (Consumer f3) to consume message 1. Consumer f1 performs personalized filtering and processing on message 1 and updates it to edge database e1. Consumer f2 performs personalized filtering and processing on message 1 and updates it to edge database e2. Consumer f3 performs personalized filtering and processing on message 1 and updates it to edge database e3.

[0175] For example, the database synchronization table of the server and the edge node is shown in Table 1 below.

[0176] Table 1 Database synchronization table

[0177]

[0178] Fig.16The present invention is a block diagram of an alarm device for a video conferencing system applied to a server according to an exemplary embodiment. The video conferencing system includes at least one conferencing terminal of the server and at least one edge node, wherein each edge node is connected to the server, and each edge node is connected to at least one conferencing terminal. Fig.16 As shown, the alarm device 50 of the video conferencing system applied to the server includes: a first determination module 51, which is used to determine whether to push the first alarm information in response to receiving the first alarm information sent by the first edge node according to the global alarm rule corresponding to the video conferencing system; wherein, the first edge node is any one of the at least one edge node, and the first alarm information is generated by the first edge node based on the local alarm rule and the indicator data of the first conference terminal, the first conference terminal includes at least one conference terminal connected to the first edge node, and the local alarm rule includes the alarm trigger conditions corresponding to each of the conference terminals in the first conference terminal; a push module 52, which is used to push the first alarm information to the alarm analysis system if it is determined to push the first alarm information.

[0179] In the above technical solution, the video conferencing system adopts a cloud-edge collaborative architecture, which specifically includes a server, at least one conference terminal and at least one edge node. Among them, after the edge node obtains the indicator data of the first conference terminal, it can generate alarm information for the corresponding conference terminal according to the alarm trigger conditions (i.e., local alarm rules) corresponding to each conference terminal in the first conference terminal. In this way, the edge node can set personalized alarm thresholds according to the specific operating scenarios of the local conference terminal, such as load, business cycle, etc. When an abnormality occurs in the first conference terminal, the edge node can detect and produce preliminary screening alarms in time according to the local local alarm rules. For some urgent conference terminal failures, the edge node can directly trigger a local alarm without waiting for the data to be transmitted to the server and then undergoing a complex processing flow, thereby improving the timeliness of the alarm. In addition, after generating the alarm information, each edge node synchronizes it to the server, so that the server uses the global alarm rules to analyze the alarm information from a global perspective to determine whether to push it to the alarm analysis system. This combination of local and global analysis not only takes into account the special circumstances of each conference terminal, but also grasps the operating status of the conference terminal as a whole, effectively avoiding the problem of false alarms and missed alarms caused by the use of global alarm thresholds, and improving the accuracy of alarms. In addition, under the cloud-edge-end collaborative architecture, the edge node is close to the data source, and can timely collect and preprocess the indicator data of the local conference terminal, while the server can concentrate resources on in-depth analysis and mining of key data processed by the edge node. In this way, a large amount of initial data processing is completed at the edge node, reducing the amount of data that needs to be transmitted to the server, avoiding congestion and delays caused by the transmission of a large amount of data in the network, and reducing the burden of server processing, thereby improving the data processing efficiency of the entire system. In addition, each edge node can collect indicator data in parallel, effectively dispersing the pressure of indicator collection. Even if there is a temporary problem in the network connection between some edge nodes and the server, it will not affect the indicator data collection and transmission of other edge nodes, reducing the impact of network congestion on indicator data collection.

[0180] Optionally, the global alarm rules include at least one of alarm type filtering conditions, time filtering conditions, spatial filtering conditions and user predefined filtering conditions; the first determination module 51 is used to determine to push the first alarm information if there is no filtering condition in the global alarm rules that matches the first alarm information.

[0181] Optionally, the alarm device 50 of the video conferencing system applied to the server also includes: a first storage module, which is used to store the first alarm information in the alarm data pool of the server in response to receiving the first alarm information; the push module 52 includes: an update submodule, which is used to update the first state of the first alarm information in the alarm data pool to pushable if it is determined to push the first alarm information, wherein the first state is used to characterize whether the corresponding alarm information meets the push conditions; a push submodule, which is used to push the second alarm information to the alarm analysis system according to a first preset period, wherein the second alarm information includes the alarm information in the alarm data pool whose first state is pushable and the second state is not successfully pushed, and the second state is used to characterize whether the corresponding alarm information is successfully pushed.

[0182] Optionally, the alarm device 50 of the video conferencing system applied to the server also includes: a first update module, used to update the second status of the third alarm information in the alarm data pool to a successful push in response to receiving a first response message sent by the alarm analysis system, wherein the first response message is used to indicate that the third alarm information is successfully pushed.

[0183] Optionally, the alarm device 50 of the video conferencing system applied to the server also includes: a second update module, which is used to update the third status of the first alarm information in the alarm data pool to not released in response to receiving the first alarm information, wherein the third status is used to indicate whether the alarm corresponding to the corresponding alarm information is released; the second update module is also used to update the third status of the first alarm information to released in response to receiving the indication information sent by the first edge node, wherein the indication information is used to indicate that the alarm corresponding to the first alarm information has been released.

[0184] Optionally, the server stores device information of each of the at least one conference terminal, wherein the device information includes basic attributes, static attributes and control attributes, and the control attributes include communication protocols and configuration information.

[0185] Optionally, the basic attributes include a terminal identifier, a space identifier and a terminal name, wherein the space identifier is an identifier of a geographical space where a corresponding conference terminal is located, and the device information uses the space identifier as a primary key.

[0186] Optionally, the alarm device 50 of the video conferencing system applied to the server also includes: a second storage module, used to store the first alarm information in association with a first space identifier in response to receiving the first alarm information, wherein each of the conference terminals connected to the first edge node belongs to the same geographic space, and the first space identifier is an identifier of the geographic space where the conference terminals connected to the first edge node are located.

[0187] Fig.17 The present invention is a block diagram of an alarm device for a video conferencing system applied to a first edge node according to an exemplary embodiment. The video conferencing system includes a server, at least one conference terminal, and at least one edge node, wherein each edge node is connected to the server, and each edge node is connected to at least one conference terminal, and the first edge node is any one of the at least one edge node. Fig.17 As shown, the alarm device 60 of the video conferencing system applied to the first edge node includes: a first acquisition module 61, used to obtain local alarm rules and indicator data of the first conference terminal; wherein, the first conference terminal includes at least one conference terminal connected to the first edge node, and the local alarm rules include alarm trigger conditions corresponding to each of the conference terminals in the first conference terminals; a generation module 62, used to generate a first alarm message for each of the conference terminals in the first conference terminals if the indicator data of the conference terminal meets the alarm trigger condition corresponding to the conference terminal; a sending module 63, used to send the first alarm message to the server.

[0188] In the above technical solution, the video conferencing system adopts a cloud-edge collaborative architecture, which specifically includes a server, at least one conference terminal and at least one edge node. Among them, after the edge node obtains the indicator data of the first conference terminal, it can generate alarm information for the corresponding conference terminal according to the alarm trigger conditions (i.e., local alarm rules) corresponding to each conference terminal in the first conference terminal. In this way, the edge node can set personalized alarm thresholds according to the specific operating scenarios of the local conference terminal, such as load, business cycle, etc. When an abnormality occurs in the first conference terminal, the edge node can detect and produce preliminary screening alarms in time according to the local local alarm rules. For some urgent conference terminal failures, the edge node can directly trigger a local alarm without waiting for the data to be transmitted to the server and then undergoing a complex processing flow, thereby improving the timeliness of the alarm. In addition, after generating the alarm information, each edge node synchronizes it to the server, so that the server uses the global alarm rules to analyze the alarm information from a global perspective to determine whether to push it to the alarm analysis system. This combination of local and global analysis not only takes into account the special circumstances of each conference terminal, but also grasps the operating status of the conference terminal as a whole, effectively avoiding the problem of false alarms and missed alarms caused by the use of global alarm thresholds, and improving the accuracy of alarms. In addition, under the cloud-edge-end collaborative architecture, the edge node is close to the data source, and can timely collect and preprocess the indicator data of the local conference terminal, while the server can concentrate resources on in-depth analysis and mining of key data processed by the edge node. In this way, a large amount of initial data processing is completed at the edge node, reducing the amount of data that needs to be transmitted to the server, avoiding congestion and delays caused by the transmission of a large amount of data in the network, and reducing the burden of server processing, thereby improving the data processing efficiency of the entire system. In addition, each edge node can collect indicator data in parallel, effectively dispersing the pressure of indicator collection. Even if there is a temporary problem in the network connection between some edge nodes and the server, it will not affect the indicator data collection and transmission of other edge nodes, reducing the impact of network congestion on indicator data collection.

[0189] Optionally, the indicator data includes dynamic indicator data; the first acquisition module 61 includes: a grouping submodule, used to group each of the conference terminals in the first conference terminal according to type to obtain at least one terminal group; a creation submodule, used to create a coroutine corresponding to the terminal group for each terminal group, and obtain a collection macro corresponding to the first type, wherein the collection macro is used to indicate the dynamic indicator items that need to be collected by the conference terminal of the first type, and the first type is the type of conference terminal in the terminal group; an acquisition submodule, used to obtain the dynamic indicator data of each of the conference terminals in the terminal group through the coroutine corresponding to the terminal group based on the collection macro.

[0190] Optionally, the indicator data includes dynamic indicator data, and the alarm device 60 of the video conferencing system applied to the first edge node also includes: a second acquisition module, used to obtain the space identifier and terminal identifier of the conference terminal for each of the first conference terminals, wherein the space identifier is the identifier of the geographical space where the corresponding conference terminal is located; a third storage module, used to store the space identifier, the terminal identifier, the dynamic indicator data of the conference terminal and the collection timestamp of the dynamic indicator data as a time series data in a time series database.

[0191] Optionally, the alarm device 60 of the video conferencing system applied to the first edge node also includes: a receiving module, which is used to receive a first general instruction for the first device, wherein the video conferencing system also includes an expansion device and a virtual device, the expansion device is used to expand the control function of the corresponding conference terminal, and the control function of the corresponding conference terminal is indirectly realized by operating the expansion device, and the first device is any one of the at least one conference terminal, the expansion device and the virtual device; a second determination module, which is used to determine whether the first device has a parent device according to the configuration information of the first device; a first trigger module, which is used to trigger the third determination module to determine the special instruction corresponding to the first general instruction according to the pre-established correspondence between the general instruction and the special instruction if the first device does not have a parent device; and a second trigger module, which is used to trigger the fourth determination module to determine the pre-established correspondence between the general instruction of the device and the general instruction of the parent device of the device if the first device does not have a parent device. Determine a second general instruction corresponding to the first general instruction; a third determination module, used to determine the special instruction corresponding to the first general instruction according to a pre-established correspondence between general instructions and special instructions; a login module, used to establish a connection with the first device and send the special instruction to the first device to control the first device according to the special instruction; a logout module, used to respond to receiving a second response message for the special instruction sent by the first device, standardize the second response message and disconnect from the first device; a fourth determination module, used to determine the second general instruction corresponding to the first general instruction according to a pre-established correspondence between the general instructions of the device and the general instructions of the parent device of the device; a third trigger module, used to take the parent device of the first device as the first device, and take the second general instruction as the first general instruction, triggering the second determination module to determine whether the first device has a parent device according to the configuration information of the first device.

[0192] The present disclosure also provides a video conferencing system, which includes: at least one conferencing terminal; at least one edge node, wherein each edge node is connected to at least one conferencing terminal, and the edge node is used to execute the alarm method of the video conferencing system applied to the first edge node provided by the present disclosure; and a server, wherein the server is respectively connected to each of the at least one edge node, and the server is used to execute the alarm method of the video conferencing system applied to the server provided by the present disclosure.

[0193] The present disclosure also provides a computer-readable medium having a computer program stored thereon, which, when executed by a processing device, implements the steps of the alarm method for the video conferencing system applied to the server provided by the present disclosure, or the steps of the alarm method for the video conferencing system applied to the first edge node provided by the present disclosure.

[0194] The present disclosure also provides an electronic device, comprising: a storage device on which a computer program is stored; and a processing device for executing the computer program in the storage device to implement the steps of the alarm method for the video conferencing system applied to the server provided in the present disclosure, or the steps of the alarm method for the video conferencing system applied to the first edge node provided in the present disclosure.

[0195] The present disclosure also provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the alarm method for the video conferencing system applied to the server provided by the present disclosure, or the steps of the alarm method for the video conferencing system applied to the first edge node provided by the present disclosure.

[0196] Reference below Fig.18 , which shows an electronic device (eg, Figure 1 The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.18 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0197] like Fig.18As shown, the electronic device 600 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic device 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0198] Typically, the following devices may be connected to the I / O interface 605: an input device 606 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 608 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 609. The communication device 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. Although Fig.18 The electronic device 600 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0199] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 609, or installed from a storage device 608, or installed from a ROM 602. When the computer program is executed by the processing device 601, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0200] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0201] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0202] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0203] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: in response to receiving the first alarm information sent by the first edge node, according to the global alarm rule corresponding to the video conferencing system, determines whether to push the first alarm information, wherein the video conferencing system includes a server, at least one conference terminal and at least one edge node, each of the edge nodes is connected to the server, and each of the edge nodes is connected to at least one of the conference terminals, the first edge node is any one of the at least one edge nodes, the first alarm information is generated by the first edge node based on the local alarm rule and the indicator data of the first conference terminal, the first conference terminal includes at least one of the conference terminals connected to the first edge node, and the local alarm rule includes the alarm trigger conditions corresponding to each of the first conference terminals in the first conference terminals; if it is determined to push the first alarm information, the first alarm information is pushed to the alarm analysis system.

[0204] Alternatively, the computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device: obtains local alarm rules and indicator data of the first conference terminal; wherein the video conferencing system includes a server, at least one conference terminal and at least one edge node, wherein each edge node is connected to the server, and each edge node is connected to at least one conference terminal, the first conference terminal includes at least one conference terminal connected to the first edge node, and the local alarm rules include alarm trigger conditions corresponding to each of the conference terminals in the first conference terminals; for each of the conference terminals in the first conference terminals, if the indicator data of the conference terminal meets the alarm trigger condition corresponding to the conference terminal, a first alarm message is generated; and the first alarm message is sent to the server.

[0205] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0206] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0207] The modules involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of the module does not limit the module itself in some cases. For example, the first acquisition module may also be described as a "module for acquiring local alarm rules and indicator data of the first conference terminal."

[0208] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0209] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0210] According to one or more embodiments of the present disclosure, Example 1 provides an alarm method for a video conferencing system, wherein the video conferencing system includes a server, at least one conference terminal and at least one edge node, wherein each of the edge nodes is connected to the server, and each of the edge nodes is connected to at least one of the conference terminals, and the method is applied to the server, and the method includes: in response to receiving a first alarm message sent by a first edge node, determining whether to push the first alarm message according to a global alarm rule corresponding to the video conferencing system; wherein the first edge node is any one of the at least one edge node, the first alarm message is generated by the first edge node based on a local alarm rule and indicator data of the first conference terminal, the first conference terminal includes at least one of the conference terminals connected to the first edge node, and the local alarm rule includes alarm trigger conditions corresponding to each of the first conference terminals; if it is determined to push the first alarm message, the first alarm message is pushed to the alarm analysis system.

[0211] According to one or more embodiments of the present disclosure, Example 2 provides the method of Example 1, wherein the global alarm rules include at least one of alarm type filtering conditions, time filtering conditions, spatial filtering conditions, and user predefined filtering conditions; determining whether to push the first alarm information according to the global alarm rules corresponding to the video conferencing system includes: if there is no filtering condition matching the first alarm information in the global alarm rules, determining to push the first alarm information.

[0212] According to one or more embodiments of the present disclosure, Example 3 provides the method of Example 1, which further includes: in response to receiving the first alarm information, storing the first alarm information in the alarm data pool of the server; if it is determined to push the first alarm information, pushing the first alarm information to the alarm analysis system, including: if it is determined to push the first alarm information, updating the first state of the first alarm information in the alarm data pool to pushable, wherein the first state is used to characterize whether the corresponding alarm information meets the push conditions; pushing the second alarm information to the alarm analysis system according to a first preset period, wherein the second alarm information includes the alarm information in the alarm data pool whose first state is pushable and whose second state is not successfully pushed, and the second state is used to characterize whether the corresponding alarm information is successfully pushed.

[0213] According to one or more embodiments of the present disclosure, Example 4 provides the method of Example 3, which further includes: in response to receiving a first response message sent by the alarm analysis system, updating the second status of the third alarm information in the alarm data pool to a successful push, wherein the first response message is used to characterize that the third alarm information is successfully pushed.

[0214] According to one or more embodiments of the present disclosure, Example 5 provides the method of Example 3 or Example 4, which further includes: in response to receiving the first alarm information, updating the third state of the first alarm information in the alarm data pool to not resolved, wherein the third state is used to characterize whether the alarm corresponding to the corresponding alarm information is resolved; in response to receiving the indication information sent by the first edge node, updating the third state of the first alarm information to resolved, wherein the indication information is used to characterize that the alarm corresponding to the first alarm information has been resolved.

[0215] According to one or more embodiments of the present disclosure, Example 6 provides the method described in any one of Examples 1 to 4, wherein the server stores device information of each of the at least one conference terminal, wherein the device information includes basic attributes, static attributes, and control attributes, and the control attributes include communication protocols and configuration information.

[0216] According to one or more embodiments of the present disclosure, Example 7 provides the method of Example 6, wherein the basic attributes include a terminal identifier, a space identifier, and a terminal name, wherein the space identifier is an identifier of a geographical space where the corresponding conference terminal is located, and the device information uses the space identifier as a primary key.

[0217] According to one or more embodiments of the present disclosure, Example 8 provides a method of any one of Examples 1 to 4, the method further comprising: in response to receiving the first alarm information, storing the first alarm information in association with a first space identifier, wherein each of the conference terminals connected to the first edge node belongs to the same geographic space, and the first space identifier is an identifier of the geographic space where the conference terminals connected to the first edge node are located.

[0218] According to one or more embodiments of the present disclosure, Example 9 provides an alarm method for a video conferencing system, wherein the video conferencing system includes a server, at least one conference terminal and at least one edge node, wherein each edge node is connected to the server, and each edge node is connected to at least one conference terminal, and the method is applied to a first edge node, and the first edge node is any one of the at least one edge node, and the method includes: obtaining local alarm rules and indicator data of a first conference terminal; wherein the first conference terminal includes at least one conference terminal connected to the first edge node, and the local alarm rules include alarm trigger conditions corresponding to each of the conference terminals in the first conference terminals; for each of the first conference terminals, if the indicator data of the conference terminal meets the alarm trigger condition corresponding to the conference terminal, a first alarm message is generated; and the first alarm message is sent to the server.

[0219] According to one or more embodiments of the present disclosure, Example 10 provides the method of Example 9, wherein the indicator data includes dynamic indicator data; obtaining the indicator data of the first conference terminal includes: grouping each of the first conference terminals according to type to obtain at least one terminal group; for each terminal group, creating a coroutine corresponding to the terminal group, and obtaining a collection macro corresponding to the first type, wherein the collection macro is used to indicate the dynamic indicator items that need to be collected by the conference terminals of the first type, and the first type is the type of conference terminals in the terminal group; based on the collection macro, obtaining the dynamic indicator data of each of the conference terminals in the terminal group through the coroutine corresponding to the terminal group.

[0220] According to one or more embodiments of the present disclosure, Example 11 provides the method of Example 9, wherein the indicator data includes dynamic indicator data, and the method further includes: for each of the first conference terminals, obtaining the space identifier and the terminal identifier of the conference terminal, wherein the space identifier is the identifier of the geographical space where the corresponding conference terminal is located; storing the space identifier, the terminal identifier, the dynamic indicator data of the conference terminal, and the collection timestamp of the dynamic indicator data as a time series data in a time series database.

[0221] According to one or more embodiments of the present disclosure, Example 12 provides a method of any one of Examples 9-11, the method further comprising: S301, receiving a first general instruction for a first device, wherein the video conferencing system further comprises an expansion device and a virtual device, the expansion device being used to expand the control function of a corresponding conference terminal, the control function of the corresponding conference terminal being indirectly implemented by operating the expansion device, the first device being any one of the at least one conference terminal, the expansion device and the virtual device; S302, determining whether the first device has a parent device according to configuration information of the first device, if not, executing S303 to S305, and if so, executing S306 and S307; S303, determining whether the first device has a parent device according to a pre-established general instruction and S304, establish a connection with the first device and send the special instruction to the first device to control the first device according to the special instruction; S305, in response to receiving a second response message for the special instruction sent by the first device, standardize the second response message and disconnect from the first device; S306, determine the second general instruction corresponding to the first general instruction according to the pre-established correspondence between the general instructions of the device and the general instructions of the parent device of the device; S307, take the parent device of the first device as the first device, and take the second general instruction as the first general instruction, and return to S302.

[0222] According to one or more embodiments of the present disclosure, Example 13 provides a video conferencing system, which includes: at least one conferencing terminal; at least one edge node, wherein each edge node is connected to at least one conferencing terminal, and the edge node is used to execute the method described in any one of Examples 9-12; and a server, wherein the server is respectively connected to each of the at least one edge node, and the server is used to execute the method described in any one of Examples 1-8.

[0223] According to one or more embodiments of the present disclosure, Example 14 provides a computer-readable medium having a computer program stored thereon, which implements the steps of any of the methods described in Examples 1-12 when executed by a processing device.

[0224] According to one or more embodiments of the present disclosure, Example 15 provides an electronic device, comprising: a storage device on which a computer program is stored; and a processing device for executing the computer program in the storage device to implement the steps of any one of the methods described in Examples 1-12.

[0225] According to one or more embodiments of the present disclosure, Example 16 provides a computer program product, including a computer program, which implements the steps of any one of the methods of Examples 1-12 when executed by a processor.

[0226] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0227] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0228] Although the subject matter has been described in language specific to structural features and / or method logic actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims. Regarding the device in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Claims

1. An alarm method for a video conferencing system, characterized in that: The video conferencing system includes a server, at least one conference terminal and at least one edge node, wherein each edge node is connected to the server, and each edge node is connected to at least one conference terminal, and the method is applied to the server, and the method includes: In response to receiving first alarm information sent by a first edge node, determining whether to push the first alarm information according to a global alarm rule corresponding to the video conferencing system; wherein the first edge node is any one of the at least one edge node, the first alarm information is generated by the first edge node based on a local alarm rule and indicator data of a first conference terminal, the first conference terminal includes at least one conference terminal connected to the first edge node, and the local alarm rule includes an alarm trigger condition corresponding to each of the conference terminals in the first conference terminals; If it is determined to push the first alarm information, the first alarm information is pushed to the alarm analysis system.

2. The method according to claim 1, characterized in that The global alarm rule includes at least one of an alarm type filtering condition, a time filtering condition, a space filtering condition, and a user predefined filtering condition; The determining whether to push the first alarm information according to the global alarm rule corresponding to the video conferencing system includes: If there is no filtering condition matching the first alarm information in the global alarm rule, it is determined to push the first alarm information.

3. The method according to claim 1, characterized in that The method further comprises: In response to receiving the first alarm information, storing the first alarm information in an alarm data pool of the server; If it is determined to push the first alarm information, pushing the first alarm information to the alarm analysis system includes: If it is determined to push the first alarm information, then updating the first state of the first alarm information in the alarm data pool to be pushable, wherein the first state is used to indicate whether the corresponding alarm information meets the push condition; Pushing the second alarm information to the alarm analysis system according to the first preset period, wherein the second alarm information includes the alarm information in the alarm data pool whose first state is pushable and whose second state is not successfully pushed, and the second state is used to indicate whether the corresponding alarm information is successfully pushed.

4. The method according to claim 3, characterized in that The method further comprises: In response to receiving a first response message sent by the alarm analysis system, the second status of the third alarm information in the alarm data pool is updated to push success, wherein the first response message is used to indicate that the third alarm information is pushed successfully.

5. The method according to claim 3 or 4, characterized in that: The method further comprises: In response to receiving the first alarm information, updating the third state of the first alarm information in the alarm data pool to not resolved, wherein the third state is used to indicate whether the alarm corresponding to the corresponding alarm information is resolved; In response to receiving the indication information sent by the first edge node, the third state of the first alarm information is updated to be released, wherein the indication information is used to indicate that the alarm corresponding to the first alarm information has been released.

6. The method according to any one of claims 1 to 4, characterized in that The server stores device information of each of the at least one conference terminal, wherein the device information includes basic attributes, static attributes, and control attributes, and the control attributes include communication protocols and configuration information.

7. The method according to claim 6, characterized in that The basic attributes include a terminal identifier, a space identifier, and a terminal name, wherein the space identifier is an identifier of a geographical space where a corresponding conference terminal is located, and the device information uses the space identifier as a primary key.

8. The method according to any one of claims 1 to 4, characterized in that The method further comprises: In response to receiving the first alarm information, the first alarm information is associated with a first space identifier and stored, wherein the conference terminals connected to the first edge node belong to the same geographic space, and the first space identifier is the identifier of the geographic space where the conference terminals connected to the first edge node are located.

9. An alarm method for a video conferencing system, characterized in that: The video conferencing system includes a server, at least one conference terminal, and at least one edge node, wherein each edge node is connected to the server, and each edge node is connected to at least one conference terminal, the method is applied to a first edge node, the first edge node is any one of the at least one edge node, and the method includes: Acquire local alarm rules and indicator data of the first conference terminal; wherein the first conference terminal includes at least one conference terminal connected to the first edge node, and the local alarm rules include alarm triggering conditions corresponding to each of the conference terminals in the first conference terminal; For each of the first conference terminals, if the indicator data of the conference terminal meets the alarm triggering condition corresponding to the conference terminal, generating first alarm information; The first alarm information is sent to the server.

10. The method according to claim 9, characterized in that The indicator data includes dynamic indicator data; Obtain the indicator data of the first conference terminal, including: Grouping the conference terminals in the first conference terminals according to type to obtain at least one terminal group; For each of the terminal groups, a coroutine corresponding to the terminal group is created, and a collection macro corresponding to the first type is obtained, wherein the collection macro is used to indicate the dynamic indicator items that need to be collected by the conference terminals of the first type, and the first type is the type of conference terminals in the terminal group; based on the collection macro, the dynamic indicator data of each of the conference terminals in the terminal group is obtained through the coroutine corresponding to the terminal group.

11. The method according to claim 9, characterized in that The indicator data includes dynamic indicator data, and the method further includes: For each of the first conference terminals, acquiring a space identifier and a terminal identifier of the conference terminal, wherein the space identifier is an identifier of a geographical space where the corresponding conference terminal is located; The space identifier, the terminal identifier, the dynamic indicator data of the conference terminal, and a collection timestamp of the dynamic indicator data are stored as a time series data in a time series database.

12. The method according to any one of claims 9 to 11, characterized in that: The method further comprises: S301, receiving a first general instruction for a first device, wherein the video conferencing system further includes an extension device and a virtual device, the extension device is used to extend the control function of a corresponding conference terminal, the control function of the corresponding conference terminal is indirectly implemented by operating the extension device, and the first device is any one of the at least one conference terminal, the extension device, and the virtual device; S302, determining whether the first device has a parent device according to the configuration information of the first device, if not, executing S303 to S305, if yes, executing S306 and S307; S303, determining a special instruction corresponding to the first general instruction according to a pre-established correspondence relationship between general instructions and special instructions; S304, establishing a connection with the first device, and sending the dedicated instruction to the first device, so as to control the first device according to the dedicated instruction; S305, in response to receiving a second response message sent by the first device to the dedicated instruction, standardizing the second response message and disconnecting from the first device; S306, determining a second general instruction corresponding to the first general instruction according to a pre-established correspondence relationship between a general instruction of a device and a general instruction of a parent device of the device; S307 , taking the parent device of the first device as the first device, and taking the second general instruction as the first general instruction, and returning to S302 .

13. A video conferencing system, characterized in that: The video conferencing system comprises: At least one conference terminal; at least one edge node, wherein each of the edge nodes is connected to at least one of the conference terminals, and the edge node is used to execute the method according to any one of claims 9 to 12; and A server, wherein the server is connected to each of the at least one edge node respectively, and the server is used to execute the method according to any one of claims 1 to 8.

14. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processing device, the steps of the method according to any one of claims 1 to 12 are implemented.

15. An electronic device, characterized in that: include: a storage device having a computer program stored thereon; A processing device, configured to execute the computer program in the storage device to implement the steps of the method according to any one of claims 1 to 12.

16. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 12 are implemented.

Images