Video conference system automatic loopback diagnosis method and device

Abstract

The application discloses a kind of video conference system automatic line test diagnostic method and device, comprising, by multipoint control unit, video conference terminal automatic line test message is sent to video conference terminal, and video conference terminal is responded to after waiting;After video conference terminal response, generate line test conference audio and video signal, obtain audio and video diagnostic code stream after coding line test conference audio and video signal and send to multipoint control unit;Multipoint control unit sends the audio and video diagnostic code stream received to video conference terminal, and start recording and store line test conference audio and video code stream;Video conference terminal receives video diagnostic code stream and obtains audio and video signal after decoding, and the audio and video signal obtained after decoding are analyzed and compared with line test conference audio and video signal and generate diagnostic data;Diagnostic data is sent to multipoint control unit, and multipoint control unit receives diagnostic data and records, and draws meeting room line test state view;Stop diagnosis.The application can realize video conference system automatic line test diagnosis.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of automatic test line diagnosis of video conference systems, in particular to an automatic test line diagnosis method and device of a video conference system. BACKGROUND

[0002] Unlike other applications, the video conference system has high requirements for the continuity and smoothness of the transmission of audio and video signals, the stability of system operation, the ease of use of system auxiliary functions, and the practicability. In order to ensure the stability of the conference system equipment and line transmission, the equipment administrator organizes a meeting test line for each meeting site before the meeting. The test line method only judges the stability of the conference system by the actual audio and video effect of the external audio and video acquisition, display equipment and other output devices of the video conference system of each meeting site. The shortcomings of the traditional test line method are:

[0003] Multi-party cooperation and low automation degree;

[0004] In order to ensure the stability and reliability of the conference system, the main meeting site polls each meeting site in turn before the meeting. The main meeting site and the polling meeting site operation and maintenance test personnel consult and cooperate to complete the corresponding operation of audio and video to determine the stability of the meeting site equipment and line. The test efficiency is low through manual operation, and a large amount of manpower and material resources will be consumed to complete large-scale conference system diagnosis. The conference system test line exception cannot be automatically identified, diagnosed and displayed by the system, and the meeting site operation and maintenance personnel also need to master the basic diagnosis, operation and maintenance method diagnosis and identification of the conference system to diagnose and identify the abnormal problems of the conference system.

[0005] The judgment standard is inconsistent, and the stability of the system cannot be accurately judged;

[0006] The stability of the conference system is mainly determined by subjective factors. The operation and maintenance test personnel observe and distinguish whether the stability of the conference system meets the use requirements through the audio and video input and output devices of the meeting site. It is difficult to ensure the consistency and effectiveness of the conference system through human factors due to the differences of input and output devices in actual use environment and various complex factors such as network transmission.

[0007] The system cannot guarantee long stability;

[0008] The administrator polls each meeting site to view the audio and video quality of the meeting site to judge the stability of the conference system at the current time or for a short time. The long-time stability and system integrity of the conference system cannot be effectively judged. SUMMARY

[0009] The purpose of the present application is to provide an automatic test line diagnosis method and device of a video conference system, which aims to solve the automatic test line diagnosis of a video conference system.

[0010] The present application provides an automatic test line diagnosis method of a video conference system, comprising:

[0011] S1, sending a video conference terminal automatic line test message to the video conference terminal by a multipoint control unit, and waiting for a response of the video conference terminal;

[0012] S2, after the video conference terminal responds, generating a line test conference audio and video code stream with a diagnostic attribute, encoding the line test conference audio and video code stream with the diagnostic attribute to obtain a video diagnostic code stream, and sending the video diagnostic code stream to the multipoint control unit;

[0013] S3, the multipoint control unit sends the encoded audio and video diagnostic code stream to the video conference terminal, and starts recording and storing the line test conference audio and video;

[0014] S4, the video conference terminal receives the video diagnostic code stream to obtain audio and video signals, analyzes and compares the audio and video signals with the line test conference audio and video code stream signals, and generates diagnostic data;

[0015] S5, sending the diagnostic data to the multipoint control unit, and the multipoint control unit receives the diagnostic data and records, and draws a conference site line test state view;

[0016] S6, stopping the diagnosis.

[0017] The embodiment of the application also provides a video conference system automatic line test diagnosis device, which comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the computer program implements the steps of the above method when executed by the processor.

[0018] The embodiment of the application also provides a computer readable storage medium, which stores an implementation program of information transmission, and the program implements the steps of the above method when executed by a processor.

[0019] The embodiment of the application can realize high automation, unified judgment standard and long stability of the video conference system.

[0020] The above description is only a summary of the technical scheme of the application, in order to more clearly understand the technical means of the application, implement according to the content of the specification, and in order to make the above and other purposes, features and advantages of the application more obvious and easy to understand, the following specific embodiments of the application are described. BRIEF DESCRIPTION OF DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the specific embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the specific embodiments or prior art description. Obviously, the drawings described below are some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.

[0022] Figure 1 is a flow chart of the video conference system automatic test line diagnosis method of the embodiment of the present application;

[0023] Figure 2 is a schematic diagram of the video conference system automatic test line diagnosis device of the embodiment of the present application. DETAILED DESCRIPTION

[0024] The technical solutions of the present application will be described clearly and completely below in conjunction with embodiments. Obviously, the described embodiments are some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0025] Method embodiment

[0026] According to the embodiment of the present application, a video conference system automatic test line diagnosis method is provided, Figure 1 is a flow chart of the video conference system automatic test line diagnosis method of the embodiment of the present application, as Figure 1 shown, specifically comprising:

[0027] S1, sending a video conference terminal automatic test line message to a video conference terminal through a multipoint control unit, and waiting for a response from the video conference terminal;

[0028] S1 specifically comprises: sending a video conference terminal automatic test line message to a video conference terminal through a multipoint control unit, marking a conference test line state, waiting for a response from the video conference terminal, and sending a test line diagnosis message to an audio encoding module, an audio decoding module, a video encoding module, a video decoding module and a coded data transmission module to enter a test line diagnosis mode.

[0029] S2, after the video conference terminal responds, generating a test line conference audio and video signal with a diagnosis attribute, encoding the test line conference audio and video signal with the diagnosis attribute to obtain an audio and video diagnosis code stream, and sending the audio and video diagnosis code stream to the multipoint control unit;

[0030] S2 specifically comprises: after the video conference terminal responds, the video coding module generates a color bar diagnostic image video source with special color properties and encodes the color bar diagnostic image video source to obtain a video diagnostic code stream, and the coded data transmission module transmits the video diagnostic code stream to the multipoint control unit.

[0031] After the video conference terminal responds, the audio coding module generates a diagnostic PCM audio signal with special audio properties; the audio coding module encodes the diagnostic multi-frequency PCM audio signal with special audio properties as an input audio source to obtain an audio diagnostic code stream, and the coded data transmission module transmits the audio diagnostic code stream to the multipoint control unit.

[0032] S3, after the multipoint control unit receives the audio and video diagnostic code streams, the multipoint control unit sends the audio and video diagnostic code streams to the video conference terminal and starts recording and storing the trial line conference audio and video code streams.

[0033] S4, the video conference terminal receives the video diagnostic code stream and decodes the video diagnostic code stream to obtain an audio and video signal, analyzes and compares the decoded audio and video signal with the trial line conference audio and video signal, and generates diagnostic data.

[0034] S4 specifically comprises:

[0035] S41, the video decoding module decodes the video diagnostic code stream to obtain a video signal,

[0036] S42, periodically compare the video signal with the video diagnostic code stream pixel difference;

[0037] S43, take the pixel difference threshold as the judgment criterion to count the image quality, receive the multipoint control unit video test result indication message, and the indication message contains the current code stream loopback mode and error information;

[0038] S44, if the test result of step S43 is abnormal, further notify the video transmission module to loopback the local encoded code stream to the video decoding module, repeat steps S42 to S43 until the test statistical data is correct;

[0039] S45, repeat steps S41 to S44 until the diagnosis is completed;

[0040] S411, the audio decoding module decodes the audio diagnostic code stream;

[0041] S422, periodically compare the audio decoding PCM audio signal with the encoded diagnostic audio PCM signal difference;

[0042] S433, take the PCM signal difference threshold as the judgment criterion to count the audio quality, report the multipoint control unit audio test result indication message, and the indication message contains the current code stream loopback mode and error information;

[0043] S444, if the step S433 test result is abnormal, the transmission module is notified to loop back the local audio encoding stream to the audio decoding module, and the steps S422 to S433 are repeated until the test statistics are correct;

[0044] S455, repeating the steps S411 to S444 until the diagnosis is completed;

[0045] S5, sending the diagnosis data to the multipoint control unit, the multipoint control unit receiving the diagnosis data and recording, and drawing a conference test line state view;

[0046] S6, stopping the diagnosis.

[0047] S6 specifically includes:

[0048] The multipoint control unit initiates the conference test line, sends a stop conference test line diagnosis message to the video conference terminal, cancels the conference test line state, stops the test line conference audio and video stream loopback, switches the conference configuration stream, archives the conference test line data and test line abnormal conference stream, generates a conference test line report, and provides test line abnormal conference stream download for system diagnosis and trace analysis.

[0049] Receiving the stop conference test line diagnosis message, notifying the audio encoding module, the audio decoding module, the video encoding module, the video decoding module, and the data transmission module to stop the test line diagnosis mode;

[0050] The video encoding module and the video decoding module resume normal video input source encoding and decoding, and stop the video data diagnosis;

[0051] The audio encoding module and the audio decoding module resume normal audio input source encoding and decoding, and stop the audio data diagnosis;

[0052] The data transmission module stops storing the diagnosis data, and archives the audio and video diagnosis stream.

[0053] The specific implementation method is as follows:

[0054] The multipoint control unit initiates the conference test line diagnosis mode, sends a conference test line diagnosis command message to the conference participant;

[0055] The multipoint control unit waits for a test line response respond message from the conference participant terminal, and marks the conference test line state;

[0056] If the multipoint control unit receives a test line respond message from the conference participant terminal, the conference participant terminal is marked as a test line state;

[0057] The multipoint control unit forwards the test line conference audio and video stream loopback to the conference participant;

[0058] The multipoint control unit records and stores the test line conference audio and video stream;

[0059] The conference site that does not receive the conference site test line respond message still retains the conference configuration code stream;

[0060] The multipoint control unit receives the test line conference site test result indication message, and records the data reported by the conference site test line;

[0061] The multipoint control unit collects the data reported by each conference site test line to display a conference site test line state view;

[0062] The conference site test line duration depends on the conference administrator or the test line duration configuration;

[0063] The multipoint control unit initiates the stop of the conference site test line, sends a stop conference site test line diagnosis command message to the test line conference site, and cancels the conference site test line state;

[0064] The multipoint control unit stops the audio and video code stream loopback of the test line conference site, and switches to send the conference configuration code stream;

[0065] The multipoint control unit archives the conference site test line data and the test line abnormal conference site code stream;

[0066] The multipoint control unit generates a conference site test line report, and provides the test line abnormal conference site code stream for download for system diagnosis and trace analysis;

[0067] The specific implementation method is as follows:

[0001] The video conference terminal waits to receive the test line diagnosis command message, and responds to the conference site test line respond message;

[0002] The audio and video codec and data transmission module are notified to enter the test line diagnosis mode;

[0002] The video codec module receives the test line diagnosis message to enter the test line diagnosis mode;

[0003] The video encoding module generates a color bar diagnostic image video source with special color attributes;

[0004] The video encoding module encodes the diagnostic image video source;

[0005] The data transmission module transmits the video diagnostic code stream to the multipoint control unit;

[0006] The data transmission module receives and stores the video diagnostic code stream looped back by the multipoint control unit;

[0007] The video decoding module decodes the video diagnostic code stream;

[0008] Periodically compare the pixel differences between the video decoding diagnostic image and the encoding diagnostic image;

[0009] Statistical image quality with pixel difference threshold as the criterion, report the video test result indication message to the multipoint control unit, the indication message contains the current code stream loopback mode and error information;

[0010] If the test result of step

[0009] is abnormal, further inform the video transmission module to loopback the local video encoding code stream to the video decoder module, repeat steps

[0008] -

[0009] until the test statistical data is correct;

[0011] Repeat steps

[0008] -

[0010] until the diagnosis is completed;

[0012] The audio codec module receives the commissioning diagnosis message to enter the commissioning diagnosis mode;

[0013] The audio codec module generates a diagnostic PCM audio signal with special audio properties;

[0014] The audio codec module encodes the diagnostic multi-frequency PCM audio signal with special audio properties as the input audio source;

[0015] The transmission module transmits the diagnostic code stream to the multipoint control unit;

[0016] The transmission module receives and stores the diagnostic code stream looped back by the multipoint control unit;

[0017] The audio decoding module decodes the audio diagnostic code stream;

[0018] Periodically compare the difference between the audio decoding PCM audio signal and the encoded diagnostic audio PCM signal;

[0019] Statistical audio quality with PCM signal difference threshold as the criterion, report the audio test result indication message to the multipoint control unit, the indication message contains the current code stream loopback mode and error information;

[0020] If the test result of step

[0009] is abnormal, further inform the transmission module to loopback the local audio encoding code stream to the audio decoder module, repeat steps

[0008] -

[0009] until the test statistical data is correct;

[0021] Repeat steps

[0008] -

[0010] until the diagnosis is completed;

[0022] Receive the command message to stop the conference commissioning diagnosis, inform the audio, video codec, and data transmission modules to stop the commissioning diagnosis mode;

[0023] The video codec module resumes normal video input source encoding and decoding, and stops video data diagnosis;

[0024] The audio codec module resumes normal audio input source encoding and decoding, and stops audio data diagnosis;

[0025] The data transmission module stops diagnosing data storage, and archives audio and video diagnostic code streams. In view of the problems of low efficiency, inconsistent judgment standard and low automation degree of traditional trial line, the application proposes a conference system automatic trial line diagnosis method through cooperation of conference system multipoint control unit and conference terminal equipment, and by means of signaling negotiation, encoding and decoding, data transmission, automatic fault diagnosis and other means to solve the pain point problem of traditional conference system trial line. The conference system multipoint control unit provides automatic trial line start and stop operation, is responsible for automatic trial line diagnosis signaling interaction initiation, media stream forwarding, trial line result collection and display and trial line code stream storage, and produces a conference site diagnosis report. The video conference terminal responds to the automatic trial line response of the multipoint control unit, realizes automatic trial line diagnosis and trial line state, diagnosis data reporting and trial line code stream storage. The application can realize high automation, unified judgment standard and long stability of the video conference system The embodiment of the application is a system embodiment corresponding to the above-mentioned method embodiment, and the specific operation of each module can be understood with reference to the description of the method embodiment, which will not be repeated here. Device embodiment one The embodiment of the application provides a video conference system automatic trial line diagnosis device, as shown in the figure, which comprises a memory 20, a processor 22 and a computer program stored in the memory 20 and executable on the processor 22. Figure 2 The computer program realizes the steps in the above-mentioned method embodiment when executed by the processor. Device embodiment two The embodiment of the application provides a computer readable storage medium, and the computer readable storage medium stores an information transmission implementation program, and the program realizes the steps in the above-mentioned method embodiment when executed by the processor 22. Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the application, and not to limit them; although the application has been described in detail with reference to the above embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the above embodiments, or make equivalent replacement for part or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solution deviate from the scope of the application.

Claims

1. A method for automatically diagnosing a video conference system test line, characterized in that, The application relates to a video conference terminal automatic line testing method and device. S1, a video conference terminal automatic line testing message is sent to a video conference terminal by a multipoint control unit, a conference line testing state is marked, and the video conference terminal is waited for response; the video conference terminal sends a line testing diagnosis message to an audio encoding module, an audio decoding module, a video encoding module, a video decoding module and a coded data transmission module to enter a line testing diagnosis mode; S2, after the video conference terminal responds, line testing conference audio and video signals with a diagnosis attribute are generated, the line testing conference audio and video signals with the diagnosis attribute are encoded to obtain audio and video diagnosis code streams, and the audio and video diagnosis code streams are sent to the multipoint control unit, specifically comprising the following steps: After the video conference terminal responds, a special color attribute color bar diagnosis image video source is generated by the video encoding module, and the color bar diagnosis image video source is encoded to obtain a video diagnosis code stream; the coded data transmission module transmits the video diagnosis code stream to the multipoint control unit; After the video conference terminal responds, a special audio attribute diagnosis PCM audio signal is generated by the audio encoding module; the audio encoding module encodes the diagnosis PCM audio signal with the special audio attribute as an input audio source to obtain an audio diagnosis code stream, and the coded data transmission module transmits the audio diagnosis code stream to the multipoint control unit; S3, after the multipoint control unit receives the audio and video diagnosis code streams, the audio and video diagnosis code streams are sent to the video conference terminal, and line testing conference audio and video code streams are started to be recorded and stored; S4, the video conference terminal receives the audio and video diagnosis code streams to decode the audio and video signals, analyzes and compares the decoded audio and video signals with the line testing conference audio and video signals, and generates diagnosis data; S5, the diagnosis data are sent to the multipoint control unit, the multipoint control unit receives the diagnosis data and records the diagnosis data, and a conference line testing state view is drawn; S6, diagnosis is stopped.

2. The method of claim 1, wherein, The S4 specifically comprises the following steps: S41, a video decoding module decodes the video diagnosis code stream to obtain a video signal, S42, pixel difference between the video signal and the color bar diagnosis image video source is periodically compared; S43, a pixel difference threshold is used as a judgment criterion to count image quality, a video test result indication message is received from the multipoint control unit, and the indication message contains a current code stream loopback mode and error information; S44, if the test result of step S43 is abnormal, a coded data transmission module is informed to loopback the local video diagnosis code stream to the video decoding module, and steps S42 to S43 are repeated until the test statistical data are correct; S45, steps S41 to S44 are repeated until diagnosis is finished.

3. The method of claim 2, wherein, The S4 specifically comprises the following steps: S411, an audio decoding module decodes the audio diagnosis code stream; S422, difference between the decoded PCM audio signal and the diagnosis PCM audio signal is periodically compared; S433, a PCM signal difference threshold is used as a judgment criterion to count audio quality, an audio test result indication message is reported to the multipoint control unit, and the indication message contains a current code stream loopback mode and error information; S444, if the test result of step S433 is abnormal, the coded data transmission module is informed to loopback the local audio diagnosis code stream to the audio decoding module, and steps S422 to S433 are repeated until the test statistical data are correct; S455, steps S411 to S444 are repeated until diagnosis is finished.

4. The method of claim 3, wherein, The S6 specifically includes: The multi-point control unit initiates the stop of the conference trial line, sends a stop conference trial line diagnosis message to the video conference terminal, cancels the conference trial line state, stops the trial line conference audio and video stream loopback, switches the conference configuration code stream, archives the conference trial line data and the trial line abnormal conference code stream, generates a conference trial line report, and provides the trial line abnormal conference code stream download for system diagnosis and trace analysis.

5. The method of claim 4, wherein, The S6 specifically includes: The video conference terminal receives the stop conference trial line diagnosis message, notifies the audio encoding module, the audio decoding module, the video encoding module, the video decoding module, and the encoded data transmission module to stop the trial line diagnosis mode; The video encoding module and the video decoding module resume the normal video input source encoding and decoding, and stop the video data diagnosis; The audio encoding module and the audio decoding module resume the normal audio input source encoding and decoding, and stop the audio data diagnosis; The data transmission module stops the diagnosis data storage, and archives the audio and video diagnosis code stream.

6. A video conference terminal automatic loopback diagnosis apparatus characterized by comprising: The video conference system comprises: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is executed by the processor to implement the steps of the video conference system automatic trial line diagnosis method according to any one of claims 1 to 5.

7. A computer-readable storage medium, characterized in that, The computer readable storage medium stores an information transmission implementation program, and the program is executed by the processor to implement the steps of the video conference system automatic trial line diagnosis method according to any one of claims 1 to 5.

Images