Video conference test method and device
By decoding, identifying code assignment, encoding and identification processing of the real-time video data of the video conferencing system, an automated testing process is formed, which solves the problem of incomplete and accurate traditional testing methods and improves the accuracy and efficiency of the test.
Patent Information
- Application Number
- CN202510016524.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-06
- Publication Date
- 2025-04-25
AI Technical Summary
Traditional video conferencing testing methods are not comprehensive and accurate enough when evaluating the synchronous display of multi-person pictures. They often rely on manual observation, are inefficient and are easily affected by subjective factors.
By obtaining the real-time video raw data generated by multiple virtual terminals, decoding process, giving video frame identification code, encoding process generates video data to be transmitted, and decoding and identification is performed on the virtual terminal, and finally conducting consistency test verification, and outputting the video conference test results.
The automated process of video conference testing is realized, the accuracy and efficiency of test results are improved, and the manual intervention and error rate is reduced, especially in multi-person conference scenarios, which can quickly complete the test.
Smart Images
Figure CN119893078A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and in particular to a video conferencing testing method and device. Background Art
[0002] With the continuous advancement of information technology, video conferencing systems have been widely used around the world. They provide a convenient way for people in multiple locations to communicate "face to face", greatly improving communication efficiency, saving time and costs, and playing an important role in many fields such as enterprise remote collaboration, online education, and telemedicine.
[0003] Traditional video conferencing testing methods mostly focus on the evaluation of video quality, audio quality, network performance, etc., while the test of multi-person screen synchronization is often not comprehensive and accurate. For example, some methods may simply judge whether the screen is synchronized through manual observation, which is not only inefficient but also easily affected by subjective factors.
[0004] It can be seen that how to optimize the video conferencing test method has become a technical problem that needs to be solved urgently by technical personnel in this field. Summary of the invention
[0005] The present application provides a video conference testing method and device to solve the technical problem of how to optimize the video conference testing method.
[0006] In order to solve the above technical problems, the embodiment of the present application provides a video conference testing method, which is characterized by comprising:
[0007] In response to a multi-person screen synchronous display instruction, obtaining real-time video raw data generated by multiple virtual terminals;
[0008] Decoding each of the real-time video original data to obtain a decoded frame sequence corresponding to each of the real-time video original data;
[0009] Assigning a selected identification code to each video frame in the decoded frame sequence to obtain each target video frame;
[0010] Performing encoding processing on each of the target video frames matching the same virtual terminal to obtain each of the real-time video data to be transmitted corresponding to each of the virtual terminals;
[0011] Controlling each of the virtual terminals to decode all the received real-time video data to be transmitted, and controlling each of the virtual terminals to identify each selected target video frame in the decoding result;
[0012] All recognition results are verified by consistency testing, and video conferencing test results with synchronous display of multiple screens are output based on the test verification results.
[0013] As one preferred solution, the step of assigning a selected identification code to each video frame in the decoded frame sequence to obtain each target video frame includes:
[0014] Generate a corresponding identification code according to the sequence number information, timestamp information and virtual terminal identification information of the video frame;
[0015] Based on image processing technology, the identification code is superimposed on the target area of the video frame to obtain a target video frame.
[0016] As one preferred solution, after controlling each of the virtual terminals to identify each of the selected target video frames in the decoding result, the method further includes:
[0017] Generate an image display result of the real-time video data to be transmitted according to the identification code of each of the target video frames;
[0018] And the image layout result of the real-time video data to be transmitted is generated according to the display ratio information and display position information of each video frame.
[0019] As one of the preferred solutions, all recognition results are verified by consistency testing, including:
[0020] Parsing the identification code of the real-time video data to be transmitted to obtain sequence number information, timestamp information and virtual terminal identification information corresponding to each identification code;
[0021] According to the sequence number information, the timestamp information and the virtual terminal identification information, each of the selected target video frames is laid out according to the image layout result to generate a recognition result of the virtual terminal;
[0022] The positions, sizes and arrangements of the virtual terminals are compared according to the recognition results to complete the test of the video conference.
[0023] As one of the preferred solutions, after consistency testing and verification of all recognition results, it also includes:
[0024] According to a preset time interval, the operations of identifying each selected target video frame in the decoding result and performing consistency test verification on all the identification results are iteratively executed to continuously verify whether the effect of the multi-person screen synchronous display is always in line with expectations.
[0025] Another embodiment of the present application provides a video conference testing device, including:
[0026] An acquisition module, used for acquiring real-time video raw data generated by multiple virtual terminals in response to a multi-person screen synchronous display instruction;
[0027] A decoding module, used to decode each of the real-time video original data to obtain a decoded frame sequence corresponding to each of the real-time video original data;
[0028] an identification module, used to assign a selected identification code to each video frame in the decoded frame sequence to obtain each target video frame;
[0029] An encoding module, used for encoding each of the target video frames matching the same virtual terminal to obtain each of the real-time video data to be transmitted corresponding to each of the virtual terminals;
[0030] An identification module, used to control each of the virtual terminals to decode all the received real-time video data to be transmitted, and to control each of the virtual terminals to identify each selected target video frame in the decoding result;
[0031] The verification module is used to perform consistency test verification on all recognition results, and output the video conferencing test results with synchronous display of multiple screens based on the test verification results.
[0032] As one preferred solution, the identification module is specifically used for:
[0033] Generate a corresponding identification code according to the sequence number information, timestamp information and virtual terminal identification information of the video frame;
[0034] Based on image processing technology, the identification code is superimposed on the target area of the video frame to obtain a target video frame.
[0035] As one preferred solution, the identification module is further used for:
[0036] Generate an image display result of the real-time video data to be transmitted according to the identification code of each of the target video frames;
[0037] And the image layout result of the real-time video data to be transmitted is generated according to the display ratio information and display position information of each video frame.
[0038] As one preferred solution, the verification module is specifically used for:
[0039] Parsing the identification code of the real-time video data to be transmitted to obtain sequence number information, timestamp information and virtual terminal identification information corresponding to each identification code;
[0040] According to the sequence number information, the timestamp information and the virtual terminal identification information, each of the selected target video frames is laid out according to the image layout result to generate a recognition result of the virtual terminal;
[0041] The positions, sizes and arrangements of the virtual terminals are compared according to the recognition results to complete the test of the video conference.
[0042] As one preferred solution, the verification module is further used for:
[0043] According to a preset time interval, the operations of identifying each selected target video frame in the decoding result and performing consistency test verification on all the identification results are iteratively executed to continuously verify whether the effect of the multi-person screen synchronous display is always in line with expectations.
[0044] Compared with the prior art, the beneficial effects of the embodiments of the present application are at least one of the following:
[0045] 1) By assigning a selected identification code to each video frame in the decoded frame sequence, the present application can accurately identify and distinguish each frame of video, thereby avoiding confusion and misidentification of video frames, so that in subsequent consistency test verification, each target video frame can be compared and analyzed more accurately, thereby improving the accuracy of the test results.
[0046] 2) The entire test process of this application, from acquiring real-time video raw data, decoding, encoding, decoding recognition to consistency test verification, forms a complete automated process, which reduces the time cost and error rate of manual intervention and manual operation, and improves test efficiency. Especially in multi-person conference scenarios, it can quickly complete the test of multiple virtual terminals, saving a lot of testing time. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Figure 1 It is a flowchart of a video conference testing method in one embodiment of the present application;
[0048] Figure 2 is a schematic diagram of a video conferencing test system in one embodiment of the present application;
[0049] Figure 3 It is a schematic diagram of a virtual video terminal framework in one embodiment of the present application;
[0050] Figure 4 It is a schematic diagram of the encoding server framework in one embodiment of the present application;
[0051] Figure 5 This is a schematic diagram of a decoding server framework in one embodiment of the present application;
[0052] Figure 6 This is a schematic diagram of a control module framework in one embodiment of the present application;
[0053] Figure 7 It is a structural schematic diagram of a video conferencing test device in one embodiment of the present application. DETAILED DESCRIPTION
[0054] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. The purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0055] In the description of this application, the terms "first", "second", "third", etc. are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first", "second", "third", etc. may explicitly or implicitly include one or more of the feature. In the description of this application, unless otherwise specified, "plurality" means two or more.
[0056] In the description of the present application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be a connection between the two elements. The terms "vertical", "horizontal", "left", "right", "upper", "lower" and similar expressions used in this article are only for illustrative purposes, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on this application. The term "and / or" used in this article includes any and all combinations of one or more related listed items. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to specific circumstances.
[0057] In the description of this application, it should be noted that, unless otherwise defined, all technical and scientific terms used in this application have the same meaning as those commonly understood by those skilled in the art. The terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood by specific circumstances.
[0058] This application provides a video conference test method. For details, see Figure 1 , Figure 1 The flowchart of the video conference test method in one embodiment of the present application is shown, which includes steps S1-S6:
[0059] S1: Responding to a multi-person screen synchronous display instruction, obtaining real-time video raw data generated by multiple virtual terminals;
[0060] When receiving a multi-person screen synchronous display instruction, the instruction must first be parsed to clarify the specific synchronization requirements, the number and identification of participating virtual terminals, video resolution, frame rate and other related parameters. Each virtual terminal has a corresponding video acquisition module or interface for acquiring local real-time video raw data. After receiving the acquisition instruction, the virtual terminal will transmit the real-time video raw data to the control terminal through the established network connection.
[0061] Specifically, during the transmission process, in order to ensure the integrity and accuracy of the data, some data verification and error correction mechanisms can be used, such as CRC verification, parity verification, etc. The system continuously monitors the network port at the receiving end, receives the original video data from each virtual terminal, and temporarily stores it in the buffer.
[0062] S2: Decode each real-time video original data to obtain a decoded frame sequence corresponding to each real-time video original data;
[0063] The raw video data is usually organized in a specific video stream structure, such as the hierarchical structure of MPEG-2, which includes picture sequence layer, picture group, picture, macroblock strip, macroblock, block, etc. During the decoding process, it is necessary to parse the structure of the video stream according to the corresponding video coding standard and extract key information, such as the type of video frame, coding parameters, etc.
[0064] Specifically, each frame of video is decoded according to the parsed video stream structure and encoding parameters. Each decoded frame of video is arranged in chronological order to form a decoded frame sequence. When constructing a decoded frame sequence, it is necessary to ensure that the order of the frames is correct, and to take into account information such as the frame rate and timestamp of the video for subsequent processing and synchronization.
[0065] S3: assigning a selected identification code to each video frame in the decoded frame sequence to obtain each target video frame;
[0066] Preferably, in one embodiment of the present application, a selected identification code is assigned to each video frame in the decoded frame sequence to obtain each target video frame, including:
[0067] Generate a corresponding identification code according to the sequence number information, timestamp information and virtual terminal identification information of the video frame;
[0068] Based on image processing technology, the identification code is superimposed on the target area of the video frame to obtain the target video frame.
[0069] Specifically, the corresponding identification code is generated according to the sequence number information, timestamp information and virtual terminal identification information of the video frame. The sequence number information of the video frame can uniquely identify the position of each frame in the decoded frame sequence; the timestamp information records the acquisition time or playback time of the video frame, which is very important for video synchronization and timing control; the virtual terminal identification information can distinguish the video frames of different virtual terminals. By combining these three information together, a unique identification code can be generated to identify and track each frame of video.
[0070] In one embodiment of the present application, the identification code is usually generated based on various key information of the video frame. In addition to the aforementioned sequence information, timestamp information and virtual terminal identification information, the video resolution, frame rate, encoding format and other information may also be considered to ensure the uniqueness and accuracy of the identification code.
[0071] The identification code may be a two-dimensional code, which is also called a two-dimensional barcode. It is a very popular encoding method on mobile devices and can store more information and represent more data types than a traditional bar code.
[0072] Specifically, based on image processing technology, the generated identification code is superimposed on the target area of the video frame. This can be achieved by drawing text, graphics or adding watermarks on the video frame. When selecting the target area, the edge of the video frame or the area that does not affect the viewing of the video content is usually selected, such as the upper left corner or lower right corner of the video frame. In the process of superimposing the identification code, it is necessary to ensure the clarity and readability of the identification code for subsequent recognition and processing.
[0073] S4: encoding each target video frame matching the same virtual terminal to obtain each real-time video data to be transmitted corresponding to each virtual terminal;
[0074] Specifically, each target video frame matching the same virtual terminal is encoded, with the main purpose of compressing the video frame data for efficient transmission in the network while ensuring the quality and real-time performance of the video. Through encoding, the redundancy of video data can be reduced, the demand for transmission bandwidth can be reduced, and the performance and efficiency of the video conferencing system can be improved.
[0075] After encoding the target video frame, the real-time video data to be transmitted corresponding to each virtual terminal is generated. These real-time video data to be transmitted are organized in a specific video stream format, which contains the encoded video frame data, timestamp, sequence number and other information for decoding and playback at the receiving end.
[0076] S5: Control each virtual terminal to decode all received real-time video data to be transmitted, and control each virtual terminal to identify each selected target video frame in the decoding result;
[0077] Specifically, after receiving the real-time video data to be transmitted, the virtual terminal needs to use the corresponding decoding algorithm and software for decoding processing. Common decoding methods include hardware decoding and software decoding. Hardware decoding uses a graphics processing unit (GPU) or a dedicated video decoding chip, which has the advantages of fast decoding speed and high efficiency, and can reduce the burden on the CPU, such as NVIDIA's CUDA decoding technology; software decoding uses a general-purpose CPU for calculation and decoding, which has the characteristics of good compatibility, but may occupy more CPU resources.
[0078] After decoding is completed, the virtual terminal needs to identify the selected target video frames from the decoding results. This is usually achieved by detecting and identifying the identification code in the video frame. Image recognition technology, such as deep learning-based target detection algorithms such as YOLO and Faster R-CNN, can be used to locate and identify the identification code area in the video frame and extract the key information in the identification code.
[0079] First, the identification code of the target video frame is parsed to extract the sequence number information, timestamp information, virtual terminal identification information and other possible key information, such as video resolution, frame rate, etc. Based on the parsed information, the virtual terminal can determine the display order, time synchronization information and virtual terminal to which the video frame belongs. Then, the video frame is displayed in the correct order and time to ensure smooth playback and synchronization of the video. At the same time, the video frames of different virtual terminals can also be distinguished and managed according to the virtual terminal identification information. For example, when displaying multiple images, the video frames of different virtual terminals are displayed in corresponding positions.
[0080] The display ratio information and display position information of each video frame can be preset, or dynamically adjusted according to the user's operation or the default setting of the system. Such information can be transmitted together with the identification code, or configured and managed locally in the virtual terminal.
[0081] The virtual terminal performs layout processing on each decoded target video frame according to the acquired display ratio information and display position information. Graphics rendering technology can be used to draw the video frame on a virtual two-dimensional plane according to the specified ratio and position to generate the final image layout result.
[0082] Preferably, in one embodiment of the present application, after controlling each virtual terminal to identify each selected target video frame in the decoding result, the method further includes:
[0083] Generate an image display result of the real-time video data to be transmitted according to the identification code of each target video frame;
[0084] And an image layout result of the real-time video data to be transmitted is generated according to the display ratio information and display position information of each video frame.
[0085] S6: Perform consistency test verification on all recognition results, and output video conferencing test results with synchronous display of multiple screens based on the test verification results.
[0086] Preferably, in one embodiment of the present application, a consistency test is performed on all recognition results, including:
[0087] Parse the identification code of the real-time video data to be transmitted to obtain the serial number information, timestamp information and virtual terminal identification information corresponding to each identification code;
[0088] According to the sequence number information, the timestamp information and the virtual terminal identification information, the selected target video frames are laid out according to the image layout result to generate the recognition result of the virtual terminal;
[0089] According to the recognition results, the positions, sizes and arrangements of the virtual terminals are compared to complete the video conference test.
[0090] Specifically, the sequence number information, timestamp information and virtual terminal identification information are extracted from the identification code of the real-time video data to be transmitted. The sequence number information is usually used to determine the order of video frames to ensure the continuity of video playback; the timestamp information can accurately reflect the time sequence and synchronization relationship of the video frames, which helps to determine whether different video frames are correctly displayed at the same time point; the virtual terminal identification information can clearly indicate which virtual terminal the video frame comes from, which is convenient for distinction and management in a multi-terminal environment.
[0091] According to the parsed sequence number information, timestamp information and virtual terminal identification information, the selected target video frames are laid out according to the predetermined image layout result. This means that each video frame will be placed in the correct position and together with other video frames form a complete multi-person screen. For example, in a video conference with a four-screen layout, according to the virtual terminal identification and sequence number information, the video frames from different virtual terminals are placed in the corresponding positions to form a complete multi-person screen recognition result.
[0092] Compare the position, size and arrangement of each virtual terminal. The consistency of the video conference is determined by comparing whether the video frames of different virtual terminals are accurately positioned in the picture, whether the sizes are consistent, and whether the arrangement is as expected.
[0093] For example, if the position of a virtual terminal's video frame in the picture is offset, or its size is inconsistent with the video frames of other terminals, it may cause problems in the synchronous display of multiple screens, affecting the quality of the conference video.
[0094] Preferably, in one embodiment of the present application, after performing consistency test verification on all recognition results, the following is further included:
[0095] According to the preset time interval, the operations of iteratively performing recognition of each selected target video frame in the decoding result and performing consistency test verification on all recognition results are performed to continuously verify whether the effect of synchronous display of multi-person screens always meets expectations.
[0096] According to the specific needs and performance requirements of the video conference, a suitable time interval is pre-set. This time interval can be fixed, such as every 5 seconds, 10 seconds, etc., or it can be dynamically adjusted according to the actual situation. During the video conference, at every preset time interval, the operation of identifying each selected target video frame in the decoding result and performing consistency test verification on all recognition results is repeated. By constantly repeating the verification, it is possible to monitor in real time whether the effect of the synchronous display of multiple screens is always in line with expectations. If problems are found during the verification process, timely measures can be taken to adjust and repair them to ensure the quality and stability of the video conference.
[0097] Another embodiment of the present application proposes a video conference test system, which is applied to the above video conference test method. Figure 2 , Figure 2 The figure shows a schematic diagram of a video conference test system provided in an embodiment of the present application, which includes:
[0098] Virtual video terminal: can initiate or answer calls, forward media streams, etc. through command control;
[0099] Encoding server: responsible for extracting image data from video files, or using cameras to capture image data in real time, superimposing QR code information on the data in real time, and then compressing and packaging it into a network media stream according to configuration parameters;
[0100] Decoding server: parses the network video stream and extracts the identification information (QR code information) of the specified area;
[0101] Main control (control module): A test process control module that integrates a script interpreter and uses corresponding scripts to manage the entire test process.
[0102] The following is a scheme for implementing each module of the SIP protocol video conference test in combination with this application. Specifically, the virtual video terminal implements the basic SIP session management module based on the SIP protocol stack implemented by Exos IP+OS IP, encapsulates the LUA interface required for the test, and the front end uses the LUA interpreter to implement test management. Figure 3 , Figure 3 The figure shows a schematic diagram of a virtual video terminal framework provided by an embodiment of the present application. Among them, Exos IP is an open source SIP protocol stack written in C language, which aims to provide a lightweight, high-performance and high-reliability way to implement the client and server functions of the SIP protocol. SIP (Session Initiation Protocol) is a multimedia communication protocol developed by IETF (Internet Engineering Task Force).
[0103] The encoding server is implemented based on Python, using the opencv module to extract the data of the video source file, using qrcode to generate a QR code as needed, then using opencv to overlay the QR code and the video, and finally encoding it into the required video stream data through ffmpeg. Figure 4 , Figure 4 The figure shows a schematic diagram of an encoding server framework provided by an embodiment of the present application. Among them, FFmpeg is a set of open source computer programs that can be used to record, convert digital audio and video, and convert them into streams. It provides a complete solution for recording, converting and streaming audio and video. qrcode is a Python library for generating QR codes. It supports the generation of standard QR Code symbols and is highly configurable. The size, color, border style, etc. of the QR code can be adjusted.
[0104] The decoding server is implemented based on Python. First, ffmpeg is used to decode and compress the video stream into a specific media file, then opencv is used to read the video frame data, and finally the QR code parsing interface integrated in opencv is used to parse the QR code information and coordinate area in the image. Figure 5 , Figure 5 The figure shows a schematic diagram of a decoding server framework provided by an embodiment of the present application. Among them, opencv (Open Source Computer Vision Library) is an open source computer vision library that aims to provide a series of rich image processing and computer vision algorithms for building real-time image processing and machine vision applications.
[0105] The main control (control module) is implemented based on the LUA interpreter, which encapsulates the communication and test methods into LUA interfaces, and uses scripts in combination with Lua syntax to implement the entire test process. Figure 6 , Figure 6 The figure shows a control module framework schematic diagram provided by the embodiment of the present application. Among them, Lua is a compact scripting language. Lua is written in standard C and can be compiled and run on almost all operating systems and platforms.
[0106] Another embodiment of the present application provides a video conference test device. For details, see Figure 7 , Figure 7 The figure is a schematic diagram of the structure of a video conferencing test device provided in an embodiment of the present application, which includes:
[0107] An acquisition module 11 is used to acquire real-time video raw data generated by multiple virtual terminals in response to a multi-person screen synchronous display instruction;
[0108] The decoding module 12 is used to decode each real-time video original data to obtain a decoded frame sequence corresponding to each real-time video original data;
[0109] The identification module 13 is used to assign a selected identification code to each video frame in the decoded frame sequence to obtain each target video frame;
[0110] The encoding module 14 is used to encode each target video frame matching the same virtual terminal to obtain each real-time video data to be transmitted corresponding to each virtual terminal;
[0111] The identification module 15 is used to control each virtual terminal to decode all received real-time video data to be transmitted, and control each virtual terminal to identify each selected target video frame in the decoding result;
[0112] The verification module 16 is used to perform consistency test verification on all recognition results, and output a video conference test result with synchronous display of multiple screens based on the test verification result.
[0113] Preferably, in one embodiment of the present application, the identification module is specifically used for:
[0114] Generate a corresponding identification code according to the sequence number information, timestamp information and virtual terminal identification information of the video frame;
[0115] Based on image processing technology, the identification code is superimposed on the target area of the video frame to obtain the target video frame.
[0116] Preferably, in one embodiment of the present application, the identification module is further used to:
[0117] Generate an image display result of the real-time video data to be transmitted according to the identification code of each target video frame;
[0118] And an image layout result of the real-time video data to be transmitted is generated according to the display ratio information and display position information of each video frame.
[0119] Preferably, in one embodiment of the present application, the verification module is specifically used to:
[0120] Parse the identification code of the real-time video data to be transmitted to obtain the serial number information, timestamp information and virtual terminal identification information corresponding to each identification code;
[0121] According to the sequence number information, the timestamp information and the virtual terminal identification information, the selected target video frames are laid out according to the image layout result to generate the recognition result of the virtual terminal;
[0122] According to the recognition results, the positions, sizes and arrangements of the virtual terminals are compared to complete the test of the conference video.
[0123] Preferably, in one embodiment of the present application, the verification module is further used to:
[0124] According to the preset time interval, the operations of iteratively performing recognition of each selected target video frame in the decoding result and performing consistency test verification on all recognition results are performed to continuously verify whether the effect of synchronous display of multi-person screens always meets expectations.
[0125] Compared with the prior art, the beneficial effects of the embodiments of the present application are at least one of the following:
[0126] 1) By assigning a selected identification code to each video frame in the decoded frame sequence, the present application can accurately identify and distinguish each frame of video, thereby avoiding confusion and misidentification of video frames, so that in subsequent consistency test verification, each target video frame can be compared and analyzed more accurately, thereby improving the accuracy of the test results.
[0127] 2) The entire test process of this application, from acquiring real-time video raw data, decoding, encoding, decoding recognition to consistency test verification, forms a complete automated process, which reduces the time cost and error rate of manual intervention and manual operation, and improves test efficiency. Especially in multi-person conference scenarios, it can quickly complete the test of multiple virtual terminals, saving a lot of testing time.
[0128] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A video conference testing method, characterized in that: include: In response to a multi-person screen synchronous display instruction, obtaining real-time video raw data generated by multiple virtual terminals; Decoding each of the real-time video original data to obtain a decoded frame sequence corresponding to each of the real-time video original data; Assigning a selected identification code to each video frame in the decoded frame sequence to obtain each target video frame; Performing encoding processing on each of the target video frames matching the same virtual terminal to obtain each of the real-time video data to be transmitted corresponding to each of the virtual terminals; Controlling each of the virtual terminals to decode all the received real-time video data to be transmitted, and controlling each of the virtual terminals to identify each selected target video frame in the decoding result; All recognition results are verified by consistency testing, and video conferencing test results with synchronous display of multiple screens are output based on the test verification results.
2. The video conference testing method according to claim 1, characterized in that: The step of assigning a selected identification code to each video frame in the decoded frame sequence to obtain each target video frame comprises: Generate a corresponding identification code according to the sequence number information, timestamp information and virtual terminal identification information of the video frame; Based on image processing technology, the identification code is superimposed on the target area of the video frame to obtain a target video frame.
3. The video conference testing method according to claim 1, characterized in that: After controlling each of the virtual terminals to identify each of the selected target video frames in the decoding result, the method further includes: Generate an image display result of the real-time video data to be transmitted according to the identification code of each of the target video frames; And the image layout result of the real-time video data to be transmitted is generated according to the display ratio information and display position information of each video frame.
4. The video conference testing method according to claim 3, characterized in that: All recognition results are verified by consistency testing, including: Parsing the identification code of the real-time video data to be transmitted to obtain sequence number information, timestamp information and virtual terminal identification information corresponding to each identification code; According to the sequence number information, the timestamp information and the virtual terminal identification information, each of the selected target video frames is laid out according to the image layout result to generate a recognition result of the virtual terminal; The positions, sizes and arrangements of the virtual terminals are compared according to the recognition results to complete the test of the video conference.
5. The video conference testing method according to claim 1, characterized in that: After consistency testing of all recognition results, it also includes: According to a preset time interval, the operations of identifying each selected target video frame in the decoding result and performing consistency test verification on all the identification results are iteratively executed to continuously verify whether the effect of the multi-person screen synchronous display is always in line with expectations.
6. A video conference testing device, characterized in that: include: An acquisition module, used for acquiring real-time video raw data generated by multiple virtual terminals in response to a multi-person screen synchronous display instruction; A decoding module, used to decode each of the real-time video original data to obtain a decoded frame sequence corresponding to each of the real-time video original data; an identification module, used to assign a selected identification code to each video frame in the decoded frame sequence to obtain each target video frame; An encoding module, used for encoding each of the target video frames matching the same virtual terminal to obtain each of the real-time video data to be transmitted corresponding to each of the virtual terminals; An identification module, used to control each of the virtual terminals to decode all the received real-time video data to be transmitted, and control each of the virtual terminals to identify each selected target video frame in the decoding result; The verification module is used to perform consistency test verification on all recognition results, and output the video conferencing test results with synchronous display of multiple screens based on the test verification results.
7. The video conference testing device according to claim 6, characterized in that: The identification module is specifically used for: Generate a corresponding identification code according to the sequence number information, timestamp information and virtual terminal identification information of the video frame; Based on image processing technology, the identification code is superimposed on the target area of the video frame to obtain a target video frame.
8. The video conference testing device according to claim 6, characterized in that: The identification module is further used for: Generate an image display result of the real-time video data to be transmitted according to the identification code of each of the target video frames; And the image layout result of the real-time video data to be transmitted is generated according to the display ratio information and display position information of each video frame.
9. The video conference testing device according to claim 8, characterized in that: The verification module is specifically used for: Parsing the identification code of the real-time video data to be transmitted to obtain sequence number information, timestamp information and virtual terminal identification information corresponding to each identification code; According to the sequence number information, the timestamp information and the virtual terminal identification information, each of the selected target video frames is laid out according to the image layout result to generate a recognition result of the virtual terminal; The positions, sizes and arrangements of the virtual terminals are compared according to the recognition results to complete the test of the video conference.
10. The video conference testing device according to claim 6, characterized in that: The verification module is further used for: According to a preset time interval, the operations of identifying each selected target video frame in the decoding result and performing consistency test verification on all the identification results are iteratively executed to continuously verify whether the effect of the multi-person screen synchronous display is always in line with expectations.