Audio and video signal monitoring and analyzing method and system based on video conference terminal

Abstract

The invention discloses an audio and video signal monitoring and analyzing method and system based on a video conference terminal, and the method comprises the steps: collecting the access state of each video signal source from a video mixed matrix, building an initialization mapping table of video signals, and recording the switching state of each signal source; analyzing the audio and video input signal state of the video conference terminal according to the initialization mapping table of the video signals, diagnosing the volume, signal integrity and matching degree of a signal source, and marking abnormal audio and video signals; according to the marked abnormal signals, audio and video signal flow direction information of participants is extracted through a multi-node control unit, a dynamic signal flow direction model is constructed, and real-time tracking analysis is carried out on the signal transmission state of each node; and according to a signal flow direction model analysis result, carrying out classification and attribution on the abnormal nodes, extracting characteristic parameters of the abnormal nodes, visually displaying positions of the abnormal nodes in a primitive form, generating an alarm notification, prompting operation and maintenance personnel to process, and carrying out remote monitoring and control.

Description

Technical Field

[0001] The present invention belongs to the field of communication technologies, and more particularly, relates to an audio - video signal monitoring and analysis method and system based on a video conferencing terminal. Background Art

[0002] In modern power systems and enterprise communications, video conferencing terminals have become core tools for daily management and important decision - making. Especially under the requirements of multi - location and multi - scenario video conferencing, the quality of audio - video signals directly affects the effectiveness of the conference. However, existing video conferencing systems usually rely on the independent operation and manual configuration of individual devices (such as video mixing matrices, multi - point control units MCU, conference terminals, etc.), lacking the ability of centralized management and monitoring of audio - video signals. This decentralized management method is prone to signal access errors, switching delays, or transmission interruptions, increasing the complexity and error risk of operation and maintenance.

[0003] In addition, during a video conference, the transmission of audio - video signals involves multiple layers of devices and network links. Existing technologies usually only focus on the status monitoring of a single device, lacking dynamic monitoring of the entire signal flow direction, and it is difficult to detect and locate problems causing signal anomalies in a timely manner. For example, when problems such as audio muting, video blackout, or signal jamming occur during a conference, operation and maintenance personnel need to check each device one by one, which is time - consuming and laborious, and it is impossible to quickly locate the specific fault node, seriously affecting the conference efficiency and experience. This method relying on manual troubleshooting is not only inefficient but also prone to problems not being resolved in a timely manner due to misjudgment.

[0004] Therefore, in view of the problems in the prior art such as decentralized signal monitoring, inaccurate anomaly location, and low fault handling efficiency, there is an urgent need for an audio - video signal monitoring and analysis system based on a video conferencing terminal, which can centrally manage the access, status analysis, and flow monitoring of audio - video signals, detect anomalies in real - time, and provide automated alarm and processing functions, thereby effectively improving the stability of the conference and the operation and maintenance efficiency. Summary of the Invention

[0005] To solve the deficiencies in the prior art, the present invention provides an audio - video signal monitoring and analysis system based on a video conferencing terminal.

[0006] The present invention adopts the following technical solutions.

[0007] A first aspect of the present invention provides an audio - video signal monitoring and analysis method based on a video conferencing terminal. The video conferencing terminal is connected to an audio - video signal source and a video matrix target device, and is characterized by including the following steps:

[0008] Step 1, the video conferencing terminal obtains the access parameters of the audio-visual signal source and the port configuration parameters of the video matrix target device. When the access parameters of the audio-visual signal source match the port configuration parameters of the video matrix target device, an initial mapping table is generated based on the signal transmission paths of the matching audio-visual signal source and the video matrix target device; detect and mark the abnormal signals in the input signals of the audio-visual signal source, and determine the transmission paths of the abnormal signals based on the initialized mapping table.

[0009] Step 2, construct a signal transmission flow model based on the directed graph model architecture; the signal transmission flow model takes the abnormal signals and the transmission paths of the abnormal signals as input data, and outputs the state parameters of the abnormal signals at each node in the transmission path, including delay, packet loss rate, and signal jitter; the nodes with abnormal state parameters form an abnormal path.

[0010] Step 3, generate an alarm notification based on the abnormal signals and the abnormal path, and notify the operation and maintenance personnel to handle it.

[0011] Preferably, the access parameters of the audio-visual signal source include: device name, IP address, port number, signal format, resolution, frame rate, communication protocol, access status, and timestamp.

[0012] The port configuration parameters of the video matrix target device include: port number, the audio-visual signal source connected to the port, signal format, resolution, frame rate, communication protocol, port occupancy status, and free port number.

[0013] When the signal format, resolution, frame rate, and communication protocol of the access parameters of the audio-visual signal source match those of the port configuration parameters of the video matrix target device, an initial mapping table is generated based on the signal transmission paths of the matching audio-visual signal source and the video matrix target device; when at least one of the signal format, resolution, frame rate, and communication protocol of the access parameters of the audio-visual signal source does not match those of the port configuration parameters of the video matrix target device, the audio-visual signal source is marked as an abnormal state.

[0014] Preferably, when the access parameters and the port configuration parameters match, the matching is performed in the following priority order:

[0015] The communication protocol takes precedence over the signal format, the signal format takes precedence over the resolution, and the resolution takes precedence over the frame rate; the abnormal determination criterion for the resolution is that the actual value deviates from the standard value by ±10%, and the abnormal range of the frame rate is below 30fps; when some of the matching items meet the requirements, the signal source is marked as "partially supported" and the specific non-matching items are recorded.

[0016] Preferably, the initial mapping table is stored in JSON format, and the fields include signal source device name, IP address, port number, target device number, transmission path, and matching status.

[0017] The matching status includes successful matching, partial support, and non-matching; the non-matched signal sources are recorded in the log, indicating the non-matching parameter items and reasons.

[0018] Preferably, the abnormal signals are transmitted to the signal transmission flow model through the marked items in the initial mapping table. The path data of the abnormal signals is obtained by parsing the routing tables and device logs of routers and switches and stored in a structured format, including fields such as signal source devices, target devices, a list of path nodes, and the status information of each node.

[0019] Preferably, the status parameters of the output abnormal signals at each node in the transmission path include:

[0020] The delay is determined by measuring the transmission time of signal packets at each node, the packet loss rate is calculated by comparing the number of sent and received signal packets, and the jitter is determined by calculating the difference in arrival times of adjacent signal packets; the abnormal criteria for the status parameters are that the delay exceeds 50 ms, the packet loss rate exceeds 2%, and the jitter exceeds 10 ms.

[0021] Preferably, the abnormal path is generated by screening the nodes in the transmission path whose status parameters exceed the abnormal criteria. The nodes that exceed the abnormal criteria and the connected directed edges are marked as abnormal status, and the path is dynamically updated according to the node status data collected in real time;

[0022] After the abnormal path is generated, it is visually presented in a graphical way, where the abnormal nodes are marked in red, the normal nodes are marked in green, and the path status is represented by different colored lines.

[0023] Preferably, the operation and maintenance personnel perform processing operations through the remote operation interface, and the interface supports switching to standby signal sources, remotely restarting abnormal devices, adjusting bandwidth allocation, and modifying port configurations;

[0024] Each operation will generate a detailed log, including the operation time, operator, operation content, and execution result. The log is stored in a time series for subsequent auditing;

[0025] After the processing is completed, the interface updates the status of abnormal nodes and paths in real time, displaying the processing progress and result feedback.

[0026] Preferably, the alarm notifications are prioritized according to the type and scope of influence of the abnormality, where link interruption and multi-node abnormality are marked as the first priority, and a single abnormality with a resolution mismatch is marked as the second priority;

[0027] The abnormal classification rules include signal type classification and fault location classification, and each type of abnormality corresponds to different processing suggestions;

[0028] The signal type classification includes audio anomalies and video anomalies; the fault location classification includes source device faults, target device port faults, and link faults.

[0029] The second aspect of the present invention provides an audio - video signal monitoring and analysis system based on a video conferencing terminal, including: a signal acquisition module, a signal analysis module, a dynamic monitoring module, and an exception handling module;

[0030] The signal acquisition module is used to collect the access status and input status of the audio - video signal source device through a video matrix and a video conferencing terminal, and establish an initial mapping table of the audio - video signal flow direction;

[0031] The signal analysis module is used to detect the input status of the audio - video signal source and the receiving status of the target device of the video matrix, extract the volume, level value, format, resolution, and frame rate of the signal, determine whether it exceeds the preset range, and mark the abnormal signal;

[0032] The dynamic monitoring module is used to construct an audio - video signal flow model based on a directed graph model architecture, perform real - time monitoring on each device node and link in the signal transmission path, track the transmission status of the audio - video signal, identify anomalies such as delays, packet losses, and link interruptions, and locate the abnormal device nodes and transmission paths;

[0033] The exception handling module is used to classify and attribute the marked abnormal audio - video signals, extract abnormal feature parameters, visually display the location and status of the abnormal audio - video signals through a graphical interface, generate an alarm notification to prompt the operation and maintenance personnel, and provide a remote operation interface to restore signal transmission and adjust the system configuration.

[0034] Compared with the prior art, the beneficial effects of the present invention at least include:

[0035] (1) Realize centralized monitoring of video conferencing terminal devices.

[0036] Carry out unified centralized management and control of all video conferencing terminal devices, monitor the running status of each branch venue terminal and the input and output status of audio - video signals in real time, monitor the opening of sound and the volume size, prevent misoperation from affecting the meeting, and simplify configuration management to avoid repeated logging in to the terminal IP.

[0037] (2) Realize audio - video monitoring of video conferencing venues

[0038] Video conferencing terminal devices mainly transmit audio - video signals through the network. The system realizes pre - monitoring of signals through network mirroring, providing strong support for quickly and accurately locating audio - video signals.

[0039] (3) Realize the analysis and processing of audio - video faults in video conferencing venues

[0040] The transmission of audio and video in the venue goes through many links. Once faults such as a black screen for the picture, image mosaic, no sound for listening, or audio jamming occur, it is necessary to immediately troubleshoot the fault points and restore the signal as soon as possible. The system will obtain the signal status of important nodes and display it in the form of graphic elements, which provides important reference significance for troubleshooting the fault points and restoring the signal as soon as possible. Description of the Drawings

[0041] Figure 1 is a scatter diagram of a videophone conference device provided according to an embodiment of the present invention;

[0042] Figure 2 is a sequence diagram of an audio and video signal monitoring and analysis system based on a video conference terminal provided according to an embodiment of the present invention;

[0043] Figure 3 is a system architecture diagram of an audio and video signal monitoring and analysis system for a video conference terminal based on an IP network provided according to an embodiment of the present invention;

[0044] Figure 4 is a module structure diagram of an audio and video signal monitoring and analysis system based on a video conference terminal provided according to an embodiment of the present invention. Detailed Embodiments

[0045] To make the objectives, technical solutions, and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. The embodiments described in this application are only a part of the embodiments of the present invention, rather than all embodiments. Based on the spirit of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0046] As Figure 1 shown, a scatter diagram of a videophone conference device is provided. The main devices in the system of the present invention are shown, including a video mixing matrix, a multi-point control unit (MCU), and a video conference terminal. The relative positions of these devices and the connection methods between them are published in the figure, and the devices are interconnected through multiple communication links and transmit audio and video signals.

[0047] As Figure 2 shown, a sequence diagram of an audio and video signal monitoring and analysis system based on a video conference terminal is provided. The processing steps of the audio and video signals are described in detail, including the acquisition of the signal access status, signal diagnosis and analysis, construction of a dynamic signal flow model, and processing and alarm feedback of abnormal signals. The signal starts from acquisition, goes through analysis and modeling, and finally the abnormal signals are identified and processed through a processing and feedback mechanism. Figure 2 The process in shows the execution logic of each step in sequence, clearly reflecting how each module works together.

[0048] As Figure 3 shown, an architecture diagram of an audio - video signal monitoring and analysis system for a video conferencing terminal based on an IP network is provided. It shows how signals are transmitted through the IP network and the connection methods of various devices in the system, including video matrices, MCUs, and video conferencing terminals. These devices form a complete signal transmission path through network connections. The diagram clearly shows each link of signal acquisition, transmission, processing, and feedback, indicating how signals flow between different nodes and ultimately reach the target device.

[0049] As Figure 4 shown, a module structure diagram of an audio - video signal monitoring and analysis system based on a video conferencing terminal is provided. The diagram shows the core modules of the system, including a signal acquisition module, a signal analysis module, a dynamic monitoring module, and an exception handling module. The functions and roles of each module are clearly marked, and the signal flow path between the modules is also shown. The signal acquisition module is responsible for collecting signal data, the signal analysis module processes and analyzes the data, the dynamic monitoring module monitors the signal flow direction, and the exception handling module processes the detected abnormal signals.

[0050] Example 1 of the present invention provides an audio - video signal monitoring and analysis method based on a video conferencing terminal, including the following steps:

[0051] Step 1, obtain the access parameters of the audio - video signal source and the port configuration parameters of the target device of the video matrix. When the access parameters of the audio - video signal source match the port configuration parameters of the target device of the video matrix, an initialization mapping table is established;

[0052] Preferably, Step 1 includes:

[0053] Send a request to the audio - video signal source device through the network interface to obtain access parameters, including device name, IP address, port number, signal format, resolution, and frame rate, and record the access status and timestamp;

[0054] Query the port configuration parameters of the target device of the video matrix through the communication protocol, including port number, current connected device information, and supported signal formats and protocols, and record the port occupancy status and free port numbers;

[0055] Match the collected access parameters of the audio - video signal source with the port configuration parameters of the target device of the video matrix one by one according to signal format, resolution, frame rate, and protocol compatibility, and record the corresponding relationship between the signal source and the target device port with successful matching;

[0056] Generate an initial mapping table based on the matching results, record the signal source device name, IP address, port number, target device number and the corresponding connection relationship, and mark the signal sources that fail to match as having an abnormal status and record the reasons;

[0057] Verify the generated initial mapping table by switching the audio and video signal source to the corresponding port of the target device to check whether the transmission path is normal and update the status field of the mapping table.

[0058] Preferably, querying the port configuration parameters of the video matrix target device through the communication protocol includes the port number, current connected device information, supported signal formats and protocols, and record the port occupancy status and free port numbers; including:

[0059] Establish a communication connection with the control interface of the video matrix target device, send query instructions to obtain the port number of the target device, the connected device information of the current port, the signal input / output mode supported by the port, the range of acceptable audio and video formats, and the supported protocol types one by one, and identify the corresponding devices of the current free ports and occupied ports according to the status data returned by the device, and at the same time record the dynamic bandwidth limit and available bandwidth information of each port.

[0060] Step 2, according to the established initialization mapping table, detect the input status of the audio and video signal source and the receiving status of the video matrix target device, extract the volume, level value, format, resolution and frame rate of the signal, determine whether it exceeds the preset range, and mark abnormal signals;

[0061] Preferably, step 2 includes:

[0062] According to the corresponding relationship between the signal source device and the target device port recorded in the initial mapping table, obtain the volume, level value, audio format, video format, resolution and frame rate of the current input signal by querying the input interface status of the signal source device, and store the audio and video signal status data in the input audio and video signal status table in time series;

[0063] Send status query requests to the receiving ports of the video matrix target device one by one through the network communication interface, extract the parameters of the audio and video signals received by each port, including volume, level value, resolution and frame rate, and store the receiving port status data in the target device status table to make the data structure consistent with the input signal status table;

[0064] Compare the input and reception status of the audio - video signal item by item according to the preset range. The audio parameters include the volume range, sampling rate, and encoding format, and the video parameters include the resolution, frame rate, and encoding format. If the comparison result shows that any parameter deviates from the preset range, mark the audio - video signal as an abnormal signal, and record the specific abnormal parameter and deviation value. The preset range includes a volume range of 50 dB to 70 dB, the video resolution includes 1920×1080, and the frame rate requirement is greater than or equal to 30 fps.

[0065] For the signal marked as abnormal, analyze whether the abnormal signal comes from the input problem of the signal source or the reception problem of the target port by tracing the mapping relationship between the source device and the target port in the initial mapping table, and store the analysis result in the abnormal signal record table.

[0066] Add an abnormal marking field to the input and reception status of all signals recorded as abnormal signals. The marking content includes the signal source device, the target device port, the abnormal parameter name, and the deviation value. At the same time, generate an abnormal signal log file.

[0067] Preferably, for the signal marked as abnormal, analyze whether the abnormal signal comes from the input problem of the signal source or the reception problem of the target port by tracing the mapping relationship between the source device and the target port in the initial mapping table, and store the analysis result in the abnormal signal record table, including:

[0068] According to the source device and target port number in the abnormal signal record table, trace the transmission path of the abnormal signal backward through the initial mapping table, locate the source device port or target device reception port of the abnormal signal, and analyze the abnormal reason in combination with the audio - video parameters to determine whether it is a signal source input format mismatch, insufficient level, or target port bandwidth overload.

[0069] Store the abnormal analysis result in the abnormal signal record table. The fields include the abnormal source device name, port number, specific abnormal reason, and relevant signal parameters.

[0070] Step 3: According to the marked abnormal signal, trace the transmission path of the abnormal signal, construct a signal transmission flow model based on the directed graph model architecture, analyze the state parameters of the signal in the transmission path, including delay, packet loss rate, and signal jitter, locate the abnormal nodes and link problems, and generate an abnormal path analysis report.

[0071] Preferably, step 3 includes:

[0072] According to the marked abnormal audio - video signal, trace the transmission path of the abnormal signal through the corresponding relationship between the signal source device and the target device port recorded in the initial mapping table, query and record each transmission node and connection status one by one, generate a complete transmission link diagram from the signal source to the target device, and mark the status of each node and link.

[0073] Based on the directed graph model, the signal source device, the target device, and each intermediate transmission node are defined as nodes in the graph, the signal flow path is defined as a directed edge, and the state parameters of each node and edge are used as the attributes of the edge to construct a complete signal transmission flow model, and the transmission states of each node and link in the model are updated in real time; the state parameters of the edge include delay, packet loss rate, and jitter;

[0074] Analyze the state parameters of each node and link that the signal passes through in the transmission path, measure and record the delay, packet loss rate, and signal jitter, determine whether there are any abnormalities beyond the preset range for each node and link, and dynamically adjust and mark the signal transmission state according to the real-time data monitoring results;

[0075] According to the analysis of the state parameters of each node and link that the signal passes through in the transmission path, locate the nodes and links with abnormal delay, packet loss rate, or jitter, identify the causes of the faults, including hardware faults, insufficient bandwidth, and incorrect device configuration, and generate an analysis report for each abnormal node and link, recording the fault type, cause, and scope of influence;

[0076] Summarize the analysis results of all abnormal nodes and links to generate an abnormal path analysis report. The report content includes a detailed description of the abnormal nodes and links, statistical data on delay, packet loss rate, and jitter parameters, problem diagnosis, and recommended solutions. The report is stored in a structured format.

[0077] Preferably, the analysis of the state parameters of each node and link that the signal passes through in the transmission path includes:

[0078] By real-time monitoring and collecting the delay, packet loss rate, and jitter parameters of each node in the signal transmission path, using network diagnostic tools to measure the path delay, calculating the packet loss rate by comparing the number of sent and received data packets, and analyzing the time difference between adjacent signal packets for jitter, determine whether the transmission quality of each node and link exceeds the preset abnormal range. The abnormal criteria include a delay exceeding 50 ms, a packet loss rate exceeding 2%, and a jitter fluctuation exceeding 10 ms.

[0079] Step 4, according to the abnormal path analysis report, classify the abnormal signals, generate an alarm notification including the abnormal type, occurrence location, and processing suggestions, display the abnormal node and path status through a graphical interface, and notify the operation and maintenance personnel to process the abnormal nodes through the remote operation interface.

[0080] Preferably, step 4 includes:

[0081] According to the abnormal nodes and link analysis results in the abnormal path analysis report, classify the abnormal signals according to the types of audio signal abnormalities, video signal abnormalities, and transmission link abnormalities, mark the occurrence locations of each abnormal signal including the signal source device and the target device port, the affected scope including single nodes or the entire link, and the corresponding handling suggestions, and store the classification results in the alarm data table;

[0082] Based on the classified abnormal signals, generate an alarm notification including the abnormal type, occurrence location, abnormal description, and handling suggestions. The alarm notification displays the status of abnormal nodes and paths in real time through a graphical interface;

[0083] Send the generated alarm notification to the operation and maintenance personnel through multiple methods including interface pop-up windows, text messages, and emails. The notification content includes the abnormal signal type, location, and recommended handling steps, and provides a remote operation interface that allows the operation and maintenance personnel to execute handling operations through the remote operation interface, including switching to the standby signal source, restarting the faulty device, adjusting the network configuration, and changing the bandwidth allocation to restore normal signal transmission.

[0084] Preferably, the alarm notification displays the status of abnormal nodes and paths in real time through a graphical interface, including:

[0085] The abnormal nodes are marked in red, the abnormal paths are marked with red lines, and the description of the abnormal problem is attached. The operation and maintenance personnel can view the status information, transmission paths, and handling progress of all abnormal nodes through the graphical interface.

[0086] Example 2 of the present invention provides an audio and video signal monitoring and analysis system based on a video conferencing terminal, including: a signal acquisition module, a signal analysis module, a dynamic monitoring module, and an abnormal handling module;

[0087] The signal acquisition module is used to collect the access status and input status of audio and video signals from the video mixing matrix and the video conferencing terminal, and establish an initial mapping table of the signal flow direction to provide information on the signal switching status and connection integrity;

[0088] The signal analysis module is used to diagnose and analyze audio and video signals, mark abnormal signals by comparing signal parameters with pre-designed planned parameters, and generate a signal status update table;

[0089] The dynamic monitoring module is used to construct a dynamic signal flow model, monitor each node and link in the signal transmission path in real time, track the signal transmission status, identify abnormalities such as delays, packet losses, and link interruptions, and locate abnormal nodes and paths;

[0090] An exception handling module is used to classify and attribute marked abnormal signals, extract characteristic parameters, visually display the location and status of abnormal signals in the form of graphic elements, generate alarm notifications to prompt operation and maintenance personnel, and at the same time support remote operations to restore signal transmission or adjust system configurations.

[0091] The audio and video signal monitoring and analysis system based on video conferencing terminals of the present invention mainly connects devices through the network. The device deployment is not restricted by geography, and all devices can be remotely monitored and controlled through the network. This system can be used in the scenario of a single upper-level venue and multiple lower-level venues in small and medium-sized enterprises. This technology can be applied to the upper-level venue to achieve centralized monitoring and control of all lower-level unit venues, etc.

[0092] For example, in the scenario of multi-venue meetings of upper-level units to lower-level units within a power supply company, such as provincial and city meetings, city and county meetings, applying this technology to the provincial company venue and the city company venue respectively can achieve the functions of remote monitoring and control of the city company and county company venues.

[0093] The audio and video signal monitoring and analysis system based on video conferencing terminals will centrally monitor TV and telephone conferencing devices of different brands, different interfaces, and different types, and obtain the real-time status of key projects (images, sounds). Once an abnormality is detected, the system will display it through predefined graphic elements to ensure that personnel can obtain the device operation status in the first time. To ensure the safety and reliability of the conference, for the main and backup conference deployment architectures, the system can automatically execute according to the preset alarm handling plan, improve efficiency, and reduce the adverse impact on the conference system caused by equipment failures; this system will provide strong support for the successful guarantee of the conference.

[0094] The overall framework of the audio and video signal monitoring and analysis system based on video conferencing terminals is divided into analysis and query, intelligent control, and data processing. Through the data acquisition module, data of devices of different types and different interfaces are fed back to the corresponding device control modules and displayed to users in the form of the human-computer interaction interface of the analysis and query module. Control instructions are sent to devices such as SMC, matrix, monitoring servers, and terminals through the power dedicated network. At the same time, the system can realize the automatic switching between the main and backup of video conferencing terminals according to the feedback network transmission quality to ensure that the venue receives high-quality signals.

[0095] The audio and video signal monitoring and analysis system based on video conferencing terminals of the present invention provides the distribution structure of each device in the TV and telephone conferencing system, including the locations and connection methods of core devices such as video hybrid matrices, multi-point control units (MCUs), and video conferencing terminals. This diagram clearly reflects the distribution characteristics of the devices, such as problems of a large number of devices, complex types, and wide distribution, etc., providing basic information on device dispersion for the subsequent design of the centralized monitoring and analysis system.

[0096] The audio - video signal monitoring and analysis system based on the video conferencing terminal of the present invention provides the process of audio - video signal from input to analysis and processing, including signal access status acquisition, signal diagnosis and analysis, construction of dynamic flow models, and processing and alarm feedback of abnormal signals. This figure clearly shows the core functional modules of the system and the logic of signal processing

[0097] The audio - video signal monitoring and analysis system based on the video conferencing terminal of the present invention provides the overall architecture of the system in an IP network environment, focusing on describing the signal transmission path and the network connection methods of the main devices, including links such as signal acquisition, transmission, processing, and feedback. This figure also highlights the transfer relationship of signals between each node (such as hybrid matrix, MCU, conference terminal), providing an intuitive view for understanding the network topology structure and signal transmission logic of the system

[0098] The audio - video signal monitoring and analysis system based on the video conferencing terminal of the present invention provides a modular form to show the main components of the system, including a signal acquisition module, a signal analysis module, a dynamic monitoring module, and an abnormal processing module. The connection relationship between each module and the signal transfer path between each module are also clear at a glance. This figure highlights the function division of the system and the interaction logic between modules, providing a clear function framework for realizing the centralized monitoring and analysis of audio - video signals

[0099] Specifically, the audio - video signal monitoring and analysis system based on the video conferencing terminal of the present invention uniformly and centrally manages all video - telephone conference terminals, timely monitors the operating status of each branch - venue terminal and the input - output status of audio - video signals, and simplifies configuration management, avoiding repeated logging in to the terminal IP; to ensure the synchronization of the system and device data status, the system will regularly update key parameters to ensure that the device is always in an online state

[0100] Real - time monitor the transmission status of audio - video signals, reduce the repeated operations of operation and maintenance personnel, and improve the user's audio - visual experience; early warning of the signal degradation trend, reducing the common failure rate to less than 70%

[0101] The system will set the alarm type and level according to the requirements of conference guarantee, and give timely alarms for parameters exceeding the preset values, providing a basis for guarantee personnel to handle problems in time. When a fault occurs, it can narrow the possible fault range according to the information flow, and the average predicted fault handling time is shortened by more than 60%, achieving a 100% conference guarantee rate

[0102] Develop a software for centralized monitoring and alarming system of video - telephone conference terminals

[0103] The beneficial effects of the present invention at least include:

[0104] The core devices of the video conferencing system mainly include video matrices, video conferencing terminals, and MCUs; audio and video signals flow among the matrices, video conferencing terminals, and MCUs; the devices have the characteristics of wide distribution, large quantity, and many brand models, so it is particularly important to conduct multi-dimensional and comprehensive centralized monitoring of the core devices; the audio and video signal monitoring and analysis method and system based on the video conferencing terminal realize centralized monitoring of the above devices, refine and analyze the meeting requirement parameters, and the analysis results will be centrally displayed through graphic elements, providing strong support for successfully ensuring the meeting.

[0105] The present disclosure may be a system, a method, and / or a computer program product. The computer program product may include a computer-readable storage medium having thereon computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0106] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the above embodiments, those of ordinary skill in the art should understand that: modifications or equivalent replacements can still be made to the specific embodiments of the present invention, and any modifications or equivalent replacements that do not depart from the spirit and scope of the present invention should be covered by the protection scope of the claims of the present invention.

Claims

1. A method for monitoring and analyzing audio and video signals based on a video conferencing terminal, wherein the video conferencing terminal is connected to an audio and video signal source and a video matrix target device, characterized in that: The following steps are involved: Step 1, the video conferencing terminal obtains the access parameters of the audio and video signal source and the port configuration parameters of the video matrix target device. When the access parameters of the audio and video signal source match the port configuration parameters of the video matrix target device, an initial mapping table is generated with the signal transmission paths of the matched audio and video signal source and the video matrix target device; Detect and mark abnormal signals in the input signals of the audio and video signal source, and determine the transmission path of the abnormal signals based on the initialization mapping table; Step 2: construct a signal transmission flow model based on the directed graph model architecture; the signal transmission flow model takes the abnormal signal and the transmission path of the abnormal signal as input data, and outputs the state parameters of the abnormal signal at each node in the transmission path, including delay, packet loss rate and signal jitter; the nodes with abnormal state parameters constitute the abnormal path; Step 3: Generate an alarm notification based on the abnormal signal and abnormal path, and notify the operation and maintenance personnel to handle it.

2. According to claim 1, a method for monitoring and analyzing audio and video signals based on a video conferencing terminal is characterized in that: The access parameters of the audio and video signal source, including: device name, IP address, port number, signal format, resolution, frame rate, communication protocol, access status and timestamp; Port configuration parameters of the video matrix target device, including: port number, audio and video signal source connected to the port, signal format, resolution, frame rate, communication protocol, port occupancy status and idle port number; When the access parameters of the audio and video signal source match the signal format, resolution, frame rate and communication protocol of the port configuration parameters of the video matrix target device, an initial mapping table is generated with the matching audio and video signal source and the signal transmission path of the video matrix target device; when the access parameters of the audio and video signal source do not match at least one of the signal format, resolution, frame rate and communication protocol of the port configuration parameters of the video matrix target device, the audio and video signal source is marked as an abnormal state.

3. The method for monitoring and analyzing audio and video signals based on a video conferencing terminal according to claim 2, characterized in that: When access parameters and port configuration parameters match, they are matched in the following order of priority: The communication protocol takes precedence over the signal format, the signal format takes precedence over the resolution, and the resolution takes precedence over the frame rate. The abnormality judgment standard for resolution is that the actual value deviates from the standard value by ±10%, and the abnormal range for frame rate is lower than 30fps. When some parameters in the matching items meet the requirements, the signal source is marked as "partially supported" and the specific mismatch items are recorded.

4. The method for monitoring and analyzing audio and video signals based on a video conferencing terminal according to claim 1, characterized in that: The initial mapping table is stored in JSON format, and contains fields including signal source device name, IP address, port number, target device number, transmission path and matching status; The matching status includes successful matching, partial support and unmatched; unmatched signal sources are recorded in logs, indicating the unmatched parameter items and reasons.

5. The method for monitoring and analyzing audio and video signals based on a video conferencing terminal according to claim 1, characterized in that: The abnormal signal is passed to the signal transmission flow model through the marking item in the initial mapping table. The path data of the abnormal signal is obtained by parsing the routing table and device log of the router and switch, and stored in a structured format, containing fields including the signal source device, target device, path node list and status information of each node.

6. The method for monitoring and analyzing audio and video signals based on a video conferencing terminal according to claim 1, characterized in that: The state parameters of the output abnormal signal at each node in the transmission path include: The delay is determined by measuring the transmission time of the signal packet at each node, the packet loss rate is calculated by comparing the number of signal packets sent and received, and the jitter is determined by calculating the difference in arrival time of adjacent signal packets; the abnormal standards for status parameters are delay exceeding 50ms, packet loss rate exceeding 2%, and jitter exceeding 10ms.

7. The method for monitoring and analyzing audio and video signals based on a video conferencing terminal according to claim 1, characterized in that: The abnormal path is generated by screening the nodes whose status parameters exceed the abnormal standard in the transmission path, marking the nodes and the connected directed edges that exceed the abnormal standard as abnormal status, and the path is dynamically updated according to the node status data collected in real time; After the abnormal path is generated, it is visualized in a graphical way, where abnormal nodes are marked in red, normal nodes are marked in green, and the path status is represented by lines of different colors.

8. The method for monitoring and analyzing audio and video signals based on a video conferencing terminal according to claim 1, characterized in that: Operation and maintenance personnel perform processing operations through the remote operation interface, which supports switching backup signal sources, remotely restarting abnormal devices, adjusting bandwidth allocation, and modifying port configurations; A detailed log is generated for each operation, including the operation time, operator, operation content and execution results. The log is stored in time series for subsequent auditing; After the processing is completed, the interface updates the abnormal node and path status in real time, and displays the processing progress and result feedback.

9. The method for monitoring and analyzing audio and video signals based on a video conferencing terminal according to claim 1, characterized in that: Alarm notifications are prioritized according to the type of anomaly and the scope of impact, with link interruption and multi-node anomalies marked as the first priority, and single anomalies with resolution mismatch marked as the second priority; The exception classification rules include signal type classification and fault location classification, and each type of exception corresponds to different processing suggestions; Signal type classification includes audio anomalies and video anomalies; Fault location classification includes source device failure, target device port failure, and link failure.

10. An audio and video signal monitoring and analysis system based on a video conferencing terminal, comprising: Signal acquisition module, signal analysis module, dynamic monitoring module and abnormality processing module; characterized by: The signal acquisition module is used to collect the access status and input status of the audio and video signal source equipment through the video matrix and the video conferencing terminal, and establish an initialization mapping table of the audio and video signal flow direction; The signal analysis module is used to extract the volume, level, format, resolution and frame rate of the signal, determine whether it exceeds the preset range, and mark abnormal signals; Dynamic monitoring module, which is used to build an audio and video signal flow model based on a directed graph model architecture, monitor each device node and link in the signal transmission path in real time, track the transmission status of audio and video signals, identify abnormalities such as delay, packet loss, and link interruption, and locate abnormal device nodes and transmission paths; The exception handling module is used to classify and attribute the marked abnormal audio and video signals, extract abnormal feature parameters, intuitively display the location and status of abnormal audio and video signals through a graphical interface, and generate alarm notifications to prompt operation and maintenance personnel, and perform remote operation interfaces to restore signal transmission and adjust system configuration.

Images