Video conference communication quality monitoring method and system

The monitoring device obtains audio and video data and communication data to generate and analyze monitoring data, which solves the problem that the communication quality of multiple video conferencing terminals cannot be judged at the same time in the prior art, real-time monitoring and quantitative evaluation are realized, and communication quality hazards are discovered in a timely manner.

CN115412723BActive Publication Date: 2025-08-29BEIJING BOHUI DATA TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202110586608.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-05-27
Publication Date
2025-08-29
Estimated Expiration
2041-05-27

AI Technical Summary

Technical Problem

The existing video conferencing communication quality monitoring methods cannot judge the communication quality of multiple video conferencing terminals at the same time, cannot quantify the communication quality, cannot quickly locate the cause of the problem after discovering the problem, and cannot promptly discover hidden dangers of communication quality.

Method used

Through the monitoring device, audio and video data and communication data are obtained from the video conferencing terminal, analytical monitoring data is generated and analyzed, and sent to the display device for display, real-time monitoring and quantitative evaluation of communication quality of multiple video conferencing terminals.

Benefits of technology

The communication quality of multiple video conferencing terminals is realized simultaneously, and the audio and video interaction status is objectively evaluated, and the problems and causes can be discovered in a timely manner, and the communication quality hazards can be discovered in a timely manner.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115412723B_ABST
    Figure CN115412723B_ABST
Patent Text Reader

Abstract

The present invention discloses a method and system for monitoring the communication quality of a video conference. The method includes: obtaining audio and video data and communication data from a video conference terminal through a monitoring device, and generating analysis monitoring data based on the audio and video data and communication data of the video conference terminal. The analysis monitoring data of all video conference terminals are displayed to monitoring personnel through a display device. Compared with the existing technology, the present application can achieve the following beneficial effects: the monitoring data of multiple video conference terminals are displayed on a screen wall at the same time, and the communication quality of multiple video conference terminals is judged at the same time based on the real-time performance of the audio and video data of multiple video conference terminals; the communication quality is quantitatively evaluated, thereby achieving an objective evaluation of the audio and video interaction status; based on the analysis of the audio and video data and the communication data, the cause of the problem can be located in time after the problem is discovered; the communication instructions of the video conference communication system can be monitored in real time, and hidden dangers in communication quality can be discovered in time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a method and system for monitoring the communication quality of a video conference. Background Art

[0002] Since video conferencing is the primary method of coordination and dispatch in some emergency management industries, the quality of video conferencing communication systems affects the daily operations of these industries. Therefore, monitoring the quality of video conferencing communication is particularly important.

[0003] Currently, monitoring video conferencing communication quality is mostly done manually. Specifically, video conferencing terminals from various locations in the video conferencing communication system are regularly organized to participate in meetings. Monitoring personnel conduct audio and video conversation tests with each participant individually. The stability and reliability of video conferencing communication quality is determined based on subjective perceptions such as smooth voice communication, clear and uninterrupted video images, and audio and video synchronization.

[0004] However, the above monitoring methods have the following defects:

[0005] 1) The video signals of multiple video conferencing terminals cannot be displayed on the screen wall at the same time, and the communication quality with multiple video conferencing terminals cannot be judged simultaneously based on the real-time performance of multiple video conferencing terminals;

[0006] 2) The audio and video interaction status can only be evaluated through subjective feelings, and cannot be quantitatively evaluated;

[0007] 3) After the monitoring personnel discovered the problem, they were unable to quickly locate the cause of the problem. The specific causes may include failure of the video conferencing terminal itself, network failure, and screen wall display failure;

[0008] 4) The frequency of manual monitoring is low, and communication quality risks of the video conferencing communication system cannot be discovered in a timely manner. Summary of the Invention

[0009] The embodiments of the present invention provide a method and system for monitoring the communication quality of video conferences to address the problems of existing video conference communication quality monitoring methods, which are unable to simultaneously judge the communication quality of multiple video conference terminals, unable to quantitatively evaluate the communication quality, unable to quickly locate the cause of the problem after it is discovered, and unable to timely discover potential communication quality risks.

[0010] According to a first aspect of the present disclosure, a video conference communication quality monitoring system is provided, including:

[0011] At least one video conferencing terminal;

[0012] a monitoring device configured to establish a communication connection with at least one of the video conferencing terminals, obtain audio and video data and communication data from the at least one video conferencing terminal, and generate analysis monitoring data of the at least one video conferencing terminal based on the audio and video data and communication data of the at least one video conferencing terminal, wherein the audio and video data is collected by the video conferencing terminal, and the communication data is data related to communication quality monitored when the video conferencing terminal transmits the audio and video data to the monitoring device;

[0013] The display device is configured to obtain the analysis and monitoring data of at least one video conferencing terminal from the monitoring device, and simultaneously display the analysis and monitoring data of at least one video conferencing terminal.

[0014] A second aspect of the embodiments of the present disclosure provides a method for monitoring the communication quality of a video conference, the method being applied to a monitoring device and comprising:

[0015] Acquire audio and video data and communication data from at least one video conferencing terminal, generate analysis and monitoring data of at least one video conferencing terminal based on the audio and video data and communication data of at least one video conferencing terminal, and send the analysis and monitoring data of at least one video conferencing terminal to a display device so that the display device displays the analysis and monitoring data of at least one video conferencing terminal, wherein the audio and video data are collected by the video conferencing terminal, and the communication data are data related to communication quality monitored by the monitoring device when the video conferencing terminal transmits the audio and video data to the monitoring device.

[0016] As can be seen from the above embodiments, the embodiments of the present application obtain audio, video, and communication data from at least one video conferencing terminal through a monitoring device, and generate analysis and monitoring data based on the audio, video, and communication data of the at least one video conferencing terminal. Simultaneously, the generated analysis and monitoring data is sent to a display device, so that the analysis and monitoring data of the at least one video conferencing terminal can be displayed to monitoring personnel through the display device. Compared with the prior art, the embodiments of the present application can achieve the following beneficial effects:

[0017] 1) Display the monitoring data of multiple video conferencing terminals on the screen wall at the same time, and judge the communication quality of multiple video conferencing terminals based on the real-time performance of the audio and video data of multiple video conferencing terminals;

[0018] 2) Quantitatively evaluate communication quality, thereby objectively evaluating the state of audio and video interaction;

[0019] 3) Analyze audio, video and communication data to promptly locate the cause of any problem after it is discovered;

[0020] 4) Ability to monitor the communication instructions of the video conferencing communication system in real time and promptly discover potential communication quality problems. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without inventive work. The above and other objects, features and advantages of the present invention will become more apparent through the accompanying drawings. The same reference numerals indicate the same parts throughout the drawings. The drawings are not intentionally scaled to their actual sizes, and the focus is on illustrating the main purpose of the present invention.

[0022] Figure 1 A framework diagram of a video conference communication quality monitoring system provided by an embodiment of the present invention;

[0023] Figure 2 A framework diagram of another video conference communication quality monitoring system provided by an embodiment of the present invention;

[0024] Figure 3 A logical block diagram of the acquisition and monitoring module provided in an embodiment of the present invention;

[0025] Figure 4 A logical block diagram of the service platform module provided in an embodiment of the present invention;

[0026] Figure 5 A schematic diagram of the user interface of the visual terminal module provided in an embodiment of the present invention;

[0027] Figure 6 This is a logic block diagram of the large-screen display and control module provided by an embodiment of the present invention;

[0028] Figure 7 A signaling diagram of a method for monitoring video conference communication quality provided by an embodiment of the present invention;

[0029] Figure 8 A signaling diagram of another method for monitoring video conference communication quality provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0030] The following will provide a clear and complete description of the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0031] See also Figure 1 , a video conference communication quality monitoring system provided by the present invention, comprising:

[0032] At least one video conferencing terminal X1…Xn, where the video conferencing terminal is a multimedia communication terminal device and can be a software video conferencing terminal or a hardware video conferencing terminal, which is not limited in this application.

[0033] Monitoring device 10 establishes a communication connection with all video conferencing terminals, acquires audio, video, and communication data from these terminals, and generates analysis and monitoring data based on the acquired audio, video, and communication data. Audio and video data refers to data collected by video conferencing terminals, such as video image data captured by a camera or audio data captured by a microphone. Communication data refers to data related to communication quality monitored by the monitoring device when a video conferencing terminal transmits audio and video data to the monitoring device. This communication quality data can be used to determine the network environment quality of the current communication link.

[0034] The monitoring device obtains audio and video data and communication data from at least one video conferencing terminal X1...Xn respectively, and generates analysis and monitoring data corresponding to each video conference.

[0035] The display device 20 obtains the analysis and monitoring data of at least one video conferencing terminal from the monitoring device, and displays the analysis and monitoring data of all video conferencing terminals to the monitoring personnel at the same time.

[0036] As can be seen from the above embodiments, the embodiments of the present application obtain audio, video, and communication data from at least one video conferencing terminal through a monitoring device, and generate analysis and monitoring data based on the audio, video, and communication data of the at least one video conferencing terminal. Simultaneously, the generated analysis and monitoring data is sent to a display device, so that the analysis and monitoring data of the at least one video conferencing terminal can be displayed to monitoring personnel through the display device. Compared with the prior art, the embodiments of the present application can achieve the following beneficial effects:

[0037] 1) Display the monitoring data of multiple video conferencing terminals on the screen wall at the same time, and judge the communication quality of multiple video conferencing terminals based on the real-time performance of the audio and video data of multiple video conferencing terminals;

[0038] 2) Quantitatively evaluate communication quality, thereby objectively evaluating the state of audio and video interaction;

[0039] 3) Analyze audio, video and communication data to promptly locate the cause of any problem after it is discovered;

[0040] 4) Ability to monitor the communication instructions of the video conferencing communication system in real time and promptly discover potential communication quality problems.

[0041] In some embodiments see Figure 2 In another video conferencing communication quality monitoring system provided by the present invention, a video conferencing terminal establishes a communication connection with the monitoring device via a video conferencing MCU (Multi Control Unit). The video conferencing MCU synchronously separates the information streams from each conference site (video conferencing terminal), extracts audio, video, data, and other information and signaling, and then feeds the information and signaling from each conference site into a common processing module to perform corresponding processes such as audio mixing or switching, data broadcasting and routing, and timing and conference control. Finally, the various information required by each conference site is reassembled and sent to the corresponding terminal system devices.

[0042] In some embodiments, the monitoring device 10 includes at least a collection and monitoring module 101, a service platform module 102, and a visualization terminal module 103. The collection and monitoring module mainly collects multimedia data in real time through a network mirroring port. The display device 20 includes a large-screen display and control module 201 and a screen wall 202.

[0043] Figure 3 Shown is a logic block diagram of an acquisition and monitoring module.

[0044] In the embodiment of the present application, a network mirror port is configured for the network port connected to the switch of the video conferencing MCU, and a monitoring device is connected to the network mirror port. When a multi-party conference is held through the video conferencing MCU, all H.323 / SIP (Session Initiation Protocol) session protocol and RTP (Real-time Transport Protocol) multimedia data of the video conferencing MCU network interaction can be collected in real time by the monitoring device through the network mirror port.

[0045] The acquisition and monitoring module 101 is preconfigured with the video conferencing MCU address and the serial numbers and IP addresses of all video conferencing terminals to be monitored. The acquisition and detection module collects the source and destination addresses of TCP (Transmission Control Protocol) / UDP (User Datagram Protocol) communications from the network mirror port (mirror stream input port) via the IP packet acquisition layer. It then filters and retains the communication data between each video conferencing terminal and the video conferencing MCU, and parses the data packets (through the session protocol parsing layer and the streaming media parsing layer, respectively).

[0046] The collection and monitoring module 101 determines the result information of the video conference terminal joining or leaving the conference by parsing the specific fields in the H.323 / SIP session protocol through the indicator analysis layer, and reports the result information to the service platform module 102 through the result reporting layer.

[0047] The acquisition and monitoring module 101 further collects the RTP streaming data of the video conferencing terminal according to the streaming information description in the H.323 / SIP session protocol, and parses it to obtain ES stream data, extracts and calculates indicators such as video resolution, bandwidth, frame rate, packet loss, video loss, audio loss, etc. per unit time, and analyzes the quality problems or hidden dangers of the current video conferencing system by monitoring the changes of various indicators during the video conferencing process, and finally reports the quantitative result information of the video conferencing communication quality to the service platform module 102.

[0048] In some embodiments, the analyzed monitoring data includes at least one of the online status of the video conferencing terminal, video resolution, real-time bandwidth and frame rate of the stream, number of packet losses, video loss, and audio loss.

[0049] Based on the above embodiment, a specific algorithm for generating analysis and monitoring data based on audio and video data and communication data may include:

[0050] When the frame rate is greater than or equal to 25, the video is considered normal. When the frame rate is less than 25, the video is considered stuck, which is caused by a poor network environment.

[0051] When the bandwidth is 2-4 Mbps, it is considered normal. When the bandwidth is less than 1.5 Mbps, the image clarity is reduced, which is due to a poor network environment.

[0052] If the packet loss count is 0, it is normal. If the packet loss count is greater than 5, the video is judged to be distorted or mosaic, which is caused by a poor network environment.

[0053] Normally, both video and audio are not lost. If video or audio is lost, the cause is a terminal device failure.

[0054] The acquisition monitoring module 101 also performs real-time transcoding of streaming media data through the audio and video transcoding layer, and outputs the data to the network through the TS OVERUDP (network IP stream) output port. The output TS stream address will also be reported to the service platform module.

[0055] Figure 4 A logic block diagram of a service platform module is shown.

[0056] The logic of the service platform module 102 includes collection and monitoring module management, large-screen display and control module management, visualization terminal module management, layout and display and control instruction management, and monitoring indicator data management.

[0057] The service platform module 102 is configured to receive the video conference communication quality monitoring results from the collection and monitoring module 101, ie, analyze the monitoring data, and permanently save the video conference communication instruction monitoring results, and provide them to the visualization terminal module in real time for display.

[0058] The service platform module 102 can also realize the unified management of the acquisition and detection module 101, the large-screen display and control module 201, the visualization terminal module 103 and the video conferencing terminal, as well as realize the unified management of the screen wall layout.

[0059] The service platform module 102 also receives display and control instructions from the visualization terminal module 103 (control instructions input by the user through the visualization terminal module 103 ), and distributes them to the large-screen display and control module 201 .

[0060] Figure 5 A user interface diagram of a visual terminal module is shown.

[0061] The visual terminal module 103 may be a terminal device with a display screen, which may provide the user with a visual touch window operation. The visual terminal module 103 provides a user interface including a large-screen echo area and a video conference signal preview area.

[0062] The large screen echo area displays multiple images of all video conferencing terminals in the current video conference. The visual terminal module 103 sends a display control instruction to the service platform module to synchronously display the display content on the large screen.

[0063] Users can also dynamically set the number of screens that can be displayed on the visual terminal module 103. If the number of screens that can be displayed on the screen is less than the total number of participating video conferencing terminals (i.e., the number of participants), the user can also switch between multiple screens with one click. After the user performs relevant operations on the visual terminal module 103, relevant control instructions are generated. The service platform module 102 forwards the control instructions to the large-screen display control module 201, which then switches the relevant display on the video wall.

[0064] The video conference signal preview area is used to display the real-time indicators of each video conference terminal signal reported by the acquisition and detection module 101, possible problems with the current video, and the causes of the video problems.

[0065] Figure 6 Shown is a logic block diagram of a large-screen display and control module.

[0066] The large-screen display and control module 201 is configured to receive display and control instructions from the service platform module 102 through the management control port and parse the layout information through the display and control protocol parsing layer. Simultaneously, the TS OVER UDP video conferencing stream is received through the stream input port. After receiving the video conferencing stream, the stream receiving layer sends the stream to the stream decoding layer for decoding and displays it in a designated area through the display control layer, enabling multi-screen simultaneous display of signals from all video conferencing terminals. In addition, when a problem occurs with the signal from a specific video conferencing terminal, an OSD (on screen display, picture-in-picture) is superimposed on its video screen to display a description of the video problem, such as being offline or having a signal interruption.

[0067] Based on the above embodiments, Figure 7 A signaling diagram of a method for monitoring video conference communication quality is shown, the method comprising:

[0068] The monitoring device acquires audio and video data and communication data from at least one video conferencing terminal, generates analysis and monitoring data based on the audio and video data and communication data of the at least one video conferencing terminal, and transmits the analysis and monitoring data of the at least one video conferencing terminal to a display device so that the analysis and monitoring data of the at least one video conferencing terminal is displayed on the display device. The audio and video data is collected by the video conferencing terminal, and the communication data is data related to communication quality monitored by the monitoring device when the video conferencing terminal transmits audio and video data to the monitoring device.

[0069] Figure 8 A signaling diagram of another method for monitoring the communication quality of a video conference is shown. The method of this embodiment is described using 16 video conference terminals as an example, wherein the 16 video conference terminals and one video conference MCU are connected to a video conference switch to form a multi-party video conference environment. The acquisition and monitoring module, the service platform module, the large-screen display and control module, and the visualization terminal module are connected to the video conference switch. The video conference switch serves as a mirrored network port for the network access port of the video conference MCU. The acquisition and monitoring module is connected to the mirrored network port of the video conference switch, and network configuration (acquisition and monitoring module IP address and service platform module IP address), video conference MCU configuration (video conference MCU name and video conference IP address), and video conference terminal configuration (terminal serial number, terminal name, terminal IP address, and stream address) are implemented through the web management page.

[0070] Based on the above configuration, the monitoring method of this embodiment includes the following steps:

[0071] Step 1: Automatically report the video conferencing terminal configuration to the service platform module, initiating analysis and monitoring. The acquisition and monitoring module analyzes and monitors the video conferencing communication command indicator data, generates analysis and monitoring data (problem description and cause), and automatically reports it to the service platform module. Audio and video data is also collected from the video conferencing terminal, parsed and transcoded to obtain the bitstream data, and sent to the service platform module.

[0072] Step 2: Receive the video conferencing terminal configuration information and analyze the monitoring data reported by the acquisition and monitoring module, and save it locally. At the same time, manage the large-screen display control module and configure the 16-screen display layout to form a multi-screen display environment for video conferencing.

[0073] Step 3: The visual terminal module obtains the large-screen layout information from the service platform module and displays a 16-screen layout window on the visual terminal module interface. It also obtains stream information (information about each video conferencing terminal) from the service platform and previews the stream information in real time on the 16-screen layout window. Furthermore, it automatically sends video conferencing multi-screen display control commands to the service platform module (alternatively, the user can enter keystrokes in response to keystrokes).

[0074] Step 4: After receiving the display and control instructions from the visualization terminal, the display and control instructions are distributed to the large-screen display and control module. After receiving the display and control instructions, the large-screen display and control module parses the layout information and simultaneously receives the TS OVER UDP video conferencing stream (analyzing the monitoring data), then decodes it and displays it in the designated area, achieving the 16-party video conferencing screen.

[0075] In some embodiments, when a problem occurs on the video conferencing screen of a certain video conferencing terminal, the service platform module generates an alarm OSD instruction based on the analysis and monitoring data reported by the acquisition and monitoring module (including a description of the problem on the video conferencing screen of the video conferencing terminal), and distributes it to the large-screen display and control module. After receiving the alarm OSD instruction, the large-screen display and control module superimposes and displays the OSD alarm information (corresponding problem description) on the corresponding video conferencing terminal. At the same time, the visualization terminal module also obtains the video conferencing analysis and monitoring data, problem description, i.e., cause analysis, from the service platform module and displays them in real time. In this way, users can not only view all video conferencing screens and analysis and monitoring data on the screen wall, but also view all video conferencing screens and analysis and monitoring data in real time on the visualization terminal module.

[0076] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The above-described embodiments of the present invention do not constitute a limitation on the scope of protection of the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A video conference communication quality monitoring system, characterized in that: include: At least one video conferencing terminal; a monitoring device configured to establish a communication connection with at least one of the video conferencing terminals, obtain audio and video data and communication data from the at least one video conferencing terminal, and generate analysis and monitoring data of the at least one video conferencing terminal based on the audio and video data and communication data of the at least one video conferencing terminal; and when a failure occurs in the video conferencing screen of the video conferencing terminal, generate an alarm instruction based on the analysis and monitoring data of the failed video conferencing terminal, wherein the alarm instruction includes a description of the failure and a cause of the failure, the audio and video data being collected by the video conferencing terminal, and the communication data being data related to communication quality monitored when the video conferencing terminal transmits the audio and video data to the monitoring device; The monitoring device includes a visual terminal module, which is used to display a user interface to provide a user with a visual touch window operation. The user interface includes a large-screen echo area and a video conference signal preview area. The large-screen echo area is used to display the video screen of at least one of the video conference terminals in the current video conference. If the number of video screens is less than the number of video conference terminals, the video screens of the video conference terminals are switched in a round-robin manner. The video conference signal preview area is used to display the analysis and monitoring data and the fault description and fault cause of the faulty video conference terminal. A display device includes a screen wall, and the display device is configured to obtain the analysis and monitoring data of at least one video conferencing terminal from the monitoring device, and simultaneously display the analysis and monitoring data of each video conferencing terminal in the form of an independent window on the screen wall. When an alarm instruction sent by the monitoring device is received, the alarm information is superimposed and displayed on the video conferencing screen of the faulty video conferencing terminal, wherein the number of windows is dynamically matched with the number of the video conferencing terminals, and the alarm information includes a fault description and a cause of the fault.

2. The video conference communication quality monitoring system according to claim 1, characterized in that: The video conferencing terminal establishes a communication connection with the monitoring device via the video conferencing MCU.

3. The video conference communication quality monitoring system according to claim 2, characterized in that: The network port accessed by the video conferencing MCU on the network switch is configured with a network mirror port, and the monitoring device is connected to the network mirror port.

4. The video conference communication quality monitoring system according to claim 1, characterized in that: The monitoring device further comprises: a collection and monitoring module configured to establish a communication connection with at least one of the video conferencing terminals, obtain the audio and video data and the communication data from the at least one of the video conferencing terminals, and analyze the audio and video data and the communication data to obtain the analysis and monitoring data; The service platform module is configured to obtain the analysis and monitoring data from the collection and monitoring module, and send the analysis and monitoring data to the display device, so that the display device displays according to the analysis and monitoring data.

5. The video conference communication quality monitoring system according to claim 4, characterized in that: described The visualization terminal module is configured to obtain the analysis and monitoring data from the service platform module and display it, and to obtain the control instructions input by the user through the visualization terminal module and send the control instructions to the service platform module.

6. The video conference communication quality monitoring system according to claim 5, characterized in that: The service platform module is further configured to configure an interface layout of a display interface according to the number of the video conferencing terminals, and the display device includes: The large-screen display and control module is configured to obtain the control instructions and the analysis and monitoring data from the service platform module, so as to display the analysis and monitoring data on the screen wall according to the control instructions using the interface layout.

7. The video conference communication quality monitoring system according to claim 1, characterized in that: The analysis and monitoring data includes at least one of the online status, video resolution, real-time bandwidth and frame rate of the code stream, number of packet losses, video loss, and audio loss of the video conferencing terminal.

8. A method for monitoring the communication quality of a video conference, characterized in that: The method is applied to a monitoring device, which includes a visualization terminal module, and the visualization terminal module is used to display a user interface to provide a user with a visualization touch window operation, wherein the user interface includes a large-screen echo area and a video conference signal preview area; the method includes: Acquiring audio and video data and communication data from at least one video conferencing terminal, generating analysis and monitoring data of at least one video conferencing terminal based on the audio and video data and communication data of at least one video conferencing terminal, and sending the analysis and monitoring data of at least one video conferencing terminal to a display device, so that the display device displays the analysis and monitoring data of each video conferencing terminal in the form of an independent window on a screen wall, wherein the audio and video data are collected by the video conferencing terminal; the communication data are data related to communication quality monitored by the monitoring device when the video conferencing terminal transmits the audio and video data to the monitoring device; and the number of windows on the screen wall is dynamically matched with the number of the video conferencing terminals; When a fault occurs on the video conferencing screen of the video conferencing terminal, an alarm instruction is generated based on the analysis and monitoring data of the faulty video conferencing terminal and sent to the display device, so that the display device, upon receiving the alarm instruction, overlays and displays an alarm message on the video conferencing screen of the faulty video conferencing terminal, wherein both the alarm instruction and the alarm message include a description of the fault and a cause of the fault; The analysis and monitoring data are sent to the visualization terminal module to display the analysis and monitoring data on the visualization terminal module; wherein, the large-screen echo area is used to display the video screen of at least one of the video conferencing terminals in the current video conference. If the number of video screens is less than the number of the video conferencing terminals, the video screens of the video conferencing terminals are switched in a round-robin manner; the video conferencing signal preview area is used to display the analysis and monitoring data as well as the fault description and fault cause of the faulty video conferencing terminal.

9. The method according to claim 8, characterized in that The method further includes: acquiring a control instruction input by a user from the visualization terminal module, and controlling the display of the analysis and monitoring data on the display device according to the control instruction.

10. The method according to claim 8, characterized in that The analysis and monitoring data includes at least one of the online status, video resolution, real-time bandwidth and frame rate of the code stream, number of packet losses, video loss, and audio loss of the video conferencing terminal.

Citation Information

Patent Citations

  • Video conference recording control method and system

    CN102970512A