Codec quality testing method, device, computer equipment and storage medium
By extracting frames and comparing the audio and video data of the product to be tested, the image and audio similarity is calculated, and the problem of low efficiency of traditional encoding and codec quality testing is solved, and an automated and efficient testing process is realized.
Patent Information
- Application Number
- CN202111068560.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-13
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2041-09-13
AI Technical Summary
Traditional codec quality testing is inefficient. During manual testing, each person can only test one product to be tested, which is relatively inefficient.
By obtaining the audio and video composite data of the product to be tested, extracting frames to obtain the time stamped video frames and audio frames, and comparing them with the standard decoded sample data, calculating the image and audio similarity, and determining the compilation if the threshold is reached. The decoding quality is qualified.
Automatic and objective codec quality testing is realized, the amount of data analysis is reduced, the testing efficiency is improved, and multiple products to be tested can be analyzed simultaneously.
Smart Images

Figure CN113873226B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of multimedia technology, and in particular to a method, device, computer equipment and storage medium for testing coding and decoding quality. Background Art
[0002] In traditional codec quality testing, personnel are arranged to watch the playback of the output signal of the product under test, and then judge the codec quality (including encoding quality or decoding quality) of the product under test. However, in manual testing, each person can only test one product under test at a time, which is inefficient. Summary of the invention
[0003] The present application provides a codec quality testing method, apparatus, computer equipment and storage medium, which can improve the efficiency of codec quality testing.
[0004] A method for testing coding quality, the method comprising:
[0005] In response to a test request for the product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to the input audio and video composite data;
[0006] Extracting frames of the audio data to be analyzed and the video data to be analyzed to obtain at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0007] Extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing it with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of the audio and video composite data;
[0008] A sample audio frame having the same timestamp as the audio frame to be tested is extracted from the sample data, and compared with the audio frame to be tested to obtain audio similarity; if the image similarity reaches an image similarity threshold and the audio similarity reaches a first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0009] A coding quality testing device, the device comprising:
[0010] The to-be-analyzed data acquisition module is used to respond to a test request for the product to be tested and acquire the to-be-analyzed audio data and the to-be-analyzed video data outputted by the product to be tested corresponding to the input audio and video composite data;
[0011] A frame extraction module, used for extracting frames of the audio data to be analyzed and the video data to be analyzed, and obtaining at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0012] An image comparison module is used to extract a sample video frame having the same timestamp as the video frame to be tested from the sample data, and compare it with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of the audio and video composite data;
[0013] An audio comparison module, configured to extract a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and compare the sample audio frame with the audio frame to be tested to obtain audio similarity;
[0014] The evaluation module is used to determine that the encoding and decoding quality of the product to be tested is qualified when the image similarity reaches an image similarity threshold and the audio similarity reaches a first audio similarity threshold.
[0015] A computer device comprises a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:
[0016] In response to a test request for the product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to the input audio and video composite data;
[0017] Extracting frames of the audio data to be analyzed and the video data to be analyzed to obtain at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0018] Extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing it with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of the audio and video composite data;
[0019] A sample audio frame having the same timestamp as the audio frame to be tested is extracted from the sample data, and compared with the audio frame to be tested to obtain audio similarity; if the image similarity reaches an image similarity threshold and the audio similarity reaches a first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0020] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the following steps:
[0021] In response to a test request for the product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to the input audio and video composite data;
[0022] Extracting frames of the audio data to be analyzed and the video data to be analyzed to obtain at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0023] Extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing it with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of the audio and video composite data;
[0024] A sample audio frame having the same timestamp as the audio frame to be tested is extracted from the sample data, and compared with the audio frame to be tested to obtain audio similarity; if the image similarity reaches an image similarity threshold and the audio similarity reaches a first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0025] The above-mentioned codec quality testing method, device, computer equipment and storage medium, in response to a test request, obtain the audio data to be analyzed and the video data to be analyzed provided by the product to be tested based on the input audio and video composite data, extract frames of the audio data to be analyzed and the video data to be analyzed, extract at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp, and extract sample video frames with the same timestamp as the video frame to be tested from the sample data to perform image comparison on the video frame to be tested to obtain image similarity, extract sample audio frames with the same timestamp as the audio frame to be tested from the sample data to perform audio comparison on the audio frame to be tested to obtain audio similarity, if the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the codec quality of the product to be tested is qualified, and automatic and objective codec quality testing is realized, and only the extracted frames are analyzed, thereby reducing the amount of data analysis and improving test efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0027] Figure 1 FIG. 1 is an application environment diagram of a method for testing coding quality in one embodiment;
[0028] Figure 2 One of the flowcharts of the coding and decoding quality testing method in one embodiment;
[0029] Figure 3 The second flowchart of the coding and decoding quality testing method in one embodiment is shown;
[0030] Figure 4The third flowchart of the coding and decoding quality testing method in one embodiment;
[0031] Figure 5 FIG4 is a flowchart of a method for testing coding quality in an embodiment;
[0032] Figure 6 FIG5 is a flowchart of a method for testing coding quality in an embodiment;
[0033] Figure 7 FIG6 is a sixth flow chart of a method for testing coding and decoding quality in one embodiment;
[0034] Figure 8 FIG7 is a flowchart of a method for testing coding quality in an embodiment;
[0035] Fig. 9 FIG8 is a flowchart of a method for testing coding quality in an embodiment;
[0036] Fig.10 is a structural block diagram of a coding quality testing device in one embodiment;
[0037] Fig.11 is a structural block diagram of a coding quality testing device in another embodiment;
[0038] Fig.12 is a structural block diagram of an image detection module in one embodiment;
[0039] Fig.13 is a structural block diagram of a coding quality testing device in yet another embodiment;
[0040] Fig.14 is a structural block diagram of an audio detection module in one embodiment;
[0041] Fig.15 is a structural block diagram of an audio detection module in another embodiment;
[0042] Fig.16 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0043] In order to facilitate understanding of the present application, the present application will be described more fully below with reference to the relevant drawings. Embodiments of the present application are provided in the drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive.
[0044] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.
[0045] It can be understood that the terms "first", "second", etc. used in this application can be used in this article to describe various features, but these features are not limited by these terms. These terms are only used to distinguish the first feature from another feature.
[0046] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0047] The present application provides a method for testing the quality of coding and decoding. Figure 1 In the application environment shown. Among them, the test terminal 101 interacts with the product to be tested 102, obtains the audio data to be analyzed and the video data to be analyzed output by the product to be tested 102 corresponding to the input audio and video composite data, and performs data analysis to determine the encoding and decoding quality of the product to be tested. In one embodiment, the product to be tested 102 can be a multimedia codec, a mobile phone, a tablet computer, a laptop computer, a PDA, a mobile Internet device (Mobile Internet Device, MID), a wearable device (such as a smart watch, a smart bracelet, etc.) or an electronic device with a multimedia encoding function and / or decoding function.
[0048] like Figure 2 As shown, the present application provides a method for testing codec quality, including steps 201 to 208:
[0049] Step 201 , in response to a test request for a product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to input audio and video composite data.
[0050] Among them, the codec quality test includes the coding quality test and the decoding quality test. When the test request is a coding quality test request, the test result finally output is the coding quality test result; when the test request is a decoding quality test request, the test result finally output is the decoding quality test result. The audio and video composite data is the encoded data of the audio and video. The product under test encodes / decodes the audio and video composite data used for the test and then outputs the audio data to be analyzed and the video data to be analyzed. The test terminal responds to the test request for the product under test, obtains the audio data to be analyzed and the video data to be analyzed output by the product under test, and uses them for codec quality analysis.
[0051] Step 202: extract frames of the audio data to be analyzed and the video data to be analyzed to obtain at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp.
[0052] Frame extraction is performed on the audio data to be analyzed and the video data to be analyzed respectively, that is, at least one audio frame to be tested with a timestamp is extracted from the audio data to be analyzed, and at least one video frame to be tested with a timestamp is extracted from the video data to be analyzed. In one embodiment, frame extraction can be to randomly jump (fast forward or fast rewind) the audio data to be analyzed or the video data to be analyzed to a certain timestamp, and extract the frame corresponding to the timestamp as the audio frame to be tested / the video frame to be tested.
[0053] Step 203: extract a sample video frame having the same timestamp as the video frame to be tested from the sample data, and compare the sample video frame with the video frame to be tested to obtain image similarity.
[0054] The sample data is the data obtained by standard decoding of audio and video composite data. Standard decoding refers to decoding processing using equipment with qualified decoding quality. The sample data includes sample audio data.
[0055] A sample video frame having the same timestamp as the video frame to be tested obtained by frame extraction is extracted from the sample data, and the sample video frame having the same timestamp and the video frame to be tested are subjected to image similarity comparison to obtain image similarity. In one embodiment, the image similarity comparison can be implemented using a hash algorithm, a feature point detection algorithm, a peak signal to noise ratio algorithm (PSNR), an image structure similarity algorithm (SSIM, structural similarity index) and the like.
[0056] Step 204: extract a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and compare it with the audio frame to be tested to obtain audio similarity.
[0057] A sample audio frame having the same timestamp as the audio frame to be tested obtained by frame extraction is extracted from the sample data, and the sample audio frame having the same timestamp is compared with the audio frame to be tested for audio similarity to obtain audio similarity. In one embodiment, the audio similarity comparison can be implemented using algorithms such as voiceprint comparison, time domain-based similarity comparison, and frequency domain-based similarity comparison.
[0058] Step 205: compare whether the image similarity reaches an image similarity threshold.
[0059] Step 206: compare whether the audio similarity reaches a first audio similarity threshold.
[0060] Among them, the image similarity threshold is a preset reference value used to evaluate whether the similarity between the video frame to be tested and the sample video frame meets the qualified requirements of the encoding and decoding quality; the first audio similarity threshold is a preset reference value used to evaluate whether the similarity between the audio frame to be tested and the sample audio frame meets the qualified requirements of the encoding and decoding quality.
[0061] The image similarity corresponding to each video frame to be tested is compared with the image similarity threshold. If the image similarity corresponding to each video frame to be tested reaches the image similarity threshold, the video codec quality can be judged to be qualified. The audio similarity corresponding to each audio frame to be tested is compared with the first audio similarity threshold. If the audio similarity corresponding to each audio frame to be tested reaches the first audio similarity threshold, the audio codec quality can be judged to be qualified.
[0062] Step 207: If the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0063] When the image similarity corresponding to each video frame to be tested reaches the image similarity threshold, and the audio similarity corresponding to each audio frame to be tested reaches the first audio similarity threshold, that is, the encoding and decoding quality of the product to be tested for video and audio are qualified, it can be determined that the encoding and decoding quality of the product to be tested is qualified.
[0064] Step 208: If the image similarity does not reach the image similarity threshold, and / or the audio similarity does not reach the image similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is unqualified.
[0065] When the image similarity corresponding to any video frame to be tested does not reach the image similarity threshold, and / or the audio similarity corresponding to any audio frame to be tested does not reach the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is unqualified.
[0066] The above-mentioned codec quality testing method, in response to a test request, obtains the audio data to be analyzed and the video data to be analyzed corresponding to the input audio and video composite data provided by the product to be tested, extracts frames of the audio data to be analyzed and the video data to be analyzed, extracts at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp, and extracts sample video frames with the same timestamp as the video frame to be tested from the sample data to perform image comparison on the video frame to be tested to obtain image similarity, extracts sample audio frames with the same timestamp as the audio frame to be tested from the sample data to perform audio comparison on the audio frame to be tested to obtain audio similarity, if the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the codec quality of the product to be tested is qualified, and automatic and objective codec quality testing is realized, and only the extracted frames are analyzed, thereby reducing the amount of data analysis and improving test efficiency.
[0067] In one of the embodiments, the video data to be analyzed is sampled at intervals, and each sampled video frame to be tested is compared with its corresponding sample video frame for image similarity. If the image similarity of each sampled video frame to be tested reaches an image similarity threshold, it is determined that the encoding and decoding quality of the video part of the product to be tested is qualified. In addition, the audio data to be analyzed is also sampled at intervals, and each sampled audio frame to be tested is compared with its corresponding sample audio frame for audio similarity. If the audio similarity of each sampled audio frame to be tested reaches a first audio similarity threshold, it is determined that the encoding and decoding quality of the audio part of the product to be tested is qualified. When the encoding and decoding quality of the video part and the audio part of the product to be tested are qualified, it is determined that the encoding and decoding quality of the product to be tested is qualified. Among them, the interval frame extraction can be equal interval frame extraction, for example, one frame is extracted every 5 frames as the audio frame to be tested / video frame to be tested; the interval frame extraction can also be non-equal interval frame extraction, for example, the audio frame to be tested / video frame to be tested extracted for the second time is 2 frames apart from the audio frame to be tested / video frame to be tested extracted for the previous time, and the audio frame to be tested / video frame to be tested extracted for the third time is 5 apart from the audio frame to be tested / video frame to be tested extracted for the previous time, and the number of interval frames of each frame extraction can be increased or decreased compared with the previous time.
[0068] In one of the embodiments, if the test request is a decoding quality test request, the audio data to be analyzed and the video data to be analyzed are data output after the product to be tested directly decodes the audio and video composite data; if the test request is an encoding quality test request, the audio data to be analyzed and the video data to be analyzed are data output after the product to be tested sequentially decodes, encodes, and then decodes the audio and video composite data.
[0069] For the product under test that is undergoing decoding quality testing, the product under test directly decodes the audio and video composite data and outputs the audio data and video data to be analyzed. The final result of the encoding and decoding quality test is the decoding quality of the product under test.
[0070] For the product under test that is undergoing coding quality testing, the product under test will sequentially decode, encode, and then decode the audio and video composite data to output the audio data and video data to be analyzed. Since the audio and video composite data is coded data, it needs to be decoded as an input resource for coding processing. In order to avoid the influence of decoding processing on the coding quality test results, the first decoding and the second decoding processing are both performed by the product under test to ensure the consistency of decoding, so that the final output audio data and video data to be analyzed can objectively reflect the coding quality of the product under test.
[0071] like Figure 3 As shown, in one embodiment, the coding quality testing method includes steps 301 to 307:
[0072] Step 301, in response to a test request for a product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to input audio and video composite data;
[0073] Step 302, extracting frames of the audio data to be analyzed and the video data to be analyzed, and obtaining at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0074] Step 303, extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing the sample video frame with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of audio and video composite data;
[0075] Step 304, extracting a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and comparing it with the audio frame to be tested to obtain audio similarity;
[0076] Step 305: compare whether the image similarity reaches an image similarity threshold.
[0077] Step 306: If the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0078] Step 307: If the image similarity does not reach the image similarity threshold, image quality problem detection is performed on the video frame to be tested.
[0079] When the image similarity corresponding to any video frame to be tested does not reach the image similarity threshold, that is, the video codec quality of the product to be tested is unqualified, at this time, image quality problem detection can be performed on the video frames to be tested whose image similarity does not reach the image similarity threshold to determine the type of codec quality problem of the product to be tested.
[0080] like Figure 4 As shown, in one embodiment, the coding quality testing method includes steps 401 to 407:
[0081] Step 401, in response to a test request for a product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to input audio and video composite data;
[0082] Step 402, extracting frames of the audio data to be analyzed and the video data to be analyzed, and obtaining at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0083] Step 403, extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing the sample video frame with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of audio and video composite data;
[0084] Step 404, extracting a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and comparing it with the audio frame to be tested to obtain audio similarity;
[0085] Step 405: compare whether the image similarity reaches an image similarity threshold.
[0086] Step 406: If the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0087] Step 407: if the image similarity does not reach the image similarity threshold, pixel detection is performed on the video frame to be tested. If the proportion of black pixels in the video frame to be tested is higher than the pixel ratio threshold, the video frame to be tested is determined to be a black screen frame.
[0088] Among them, pixel detection is to detect the pixel value, gray value or RGB value of each pixel, identify whether each pixel is a black pixel, and record the number of black pixels in the image. The number of black pixels is compared with the total number of pixels in the image. If the proportion of black pixels is higher than the preset pixel ratio threshold, it is determined that the video frame to be tested is a black screen frame, that is, the video frame to be tested has a black screen problem.
[0089] This embodiment can identify that the type of quality problem is a black screen when the video frame to be tested does not meet the coding and decoding quality requirements.
[0090] like Figure 5 As shown, in one embodiment, the coding quality testing method includes steps 501 to 509:
[0091] Step 501, in response to a test request for a product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to input audio and video composite data;
[0092] Step 502, extracting frames of the audio data to be analyzed and the video data to be analyzed, and obtaining at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0093] Step 503, extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing the sample video frame with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of audio and video composite data;
[0094] Step 504, extracting a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and comparing it with the audio frame to be tested to obtain audio similarity;
[0095] Step 505: compare whether the image similarity reaches an image similarity threshold.
[0096] Step 506: If the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0097] Step 507 : if the image similarity does not reach the image similarity threshold, the video frame to be tested is divided into a plurality of image sub-regions, and the sample video frame having the same timestamp as the video frame to be tested is divided into sample image sub-regions having the same number as the image sub-regions.
[0098] Step 508 : perform a similarity comparison between each image sub-region and the corresponding sample image sub-region to obtain the region similarity.
[0099] Step 509: if the number of image sub-regions whose regional similarity is lower than the image similarity threshold is lower than the total number of image sub-regions, it is determined that the video frame to be tested is a distorted screen frame, and the image sub-region whose regional similarity is lower than the image similarity threshold is a distorted screen region.
[0100] The number of image sub-regions whose regional similarity is lower than the image similarity threshold is lower than the total number of image sub-regions, which means that there are still some image sub-regions in the video frame to be tested whose regional similarity with the corresponding sample image sub-regions reaches the image similarity threshold. It can be determined that the video frame to be tested has a flowery screen problem, the video frame to be tested is a flowery screen frame, and the image sub-regions whose regional similarity is lower than the image similarity threshold are the flowery screen regions in the video frame to be tested.
[0101] This embodiment can identify that the type of quality problem is a screen distortion when the video frame to be tested does not meet the coding quality requirement, and locate the specific area where the screen distortion occurs.
[0102] like Figure 6 As shown, in one embodiment, the coding quality testing method includes steps 601 to 607:
[0103] Step 601, in response to a test request for a product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to input audio and video composite data;
[0104] Step 602, extracting frames of the audio data to be analyzed and the video data to be analyzed, and obtaining at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0105] Step 603, extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing the sample video frame with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of audio and video composite data;
[0106] Step 604, extracting a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and comparing it with the audio frame to be tested to obtain audio similarity;
[0107] Step 605: compare whether the audio similarity reaches a first audio similarity threshold.
[0108] Step 606: If the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0109] Step 607: If the audio similarity does not reach the first audio similarity threshold, audio quality problem detection is performed on the audio frame to be tested.
[0110] When the audio similarity corresponding to any audio frame to be tested does not reach the first audio similarity threshold, that is, the audio codec quality of the product to be tested is unqualified, at this time, audio quality problem detection can be performed on the audio frames to be tested whose audio similarity does not reach the first audio similarity threshold to determine the type of codec quality problem of the product to be tested.
[0111] like Figure 7 As shown, in one embodiment, the coding quality testing method includes steps 701 to 708:
[0112] Step 701, in response to a test request for a product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to input audio and video composite data;
[0113] Step 702, extracting frames of the audio data to be analyzed and the video data to be analyzed, and obtaining at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0114] Step 703, extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing the sample video frame with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of audio and video composite data;
[0115] Step 704, extracting a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and comparing it with the audio frame to be tested to obtain audio similarity;
[0116] Step 705: compare whether the audio similarity reaches a first audio similarity threshold.
[0117] Step 706: If the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0118] Step 707: If the audio similarity does not reach the first audio similarity threshold, compare whether the audio similarity reaches the second audio similarity threshold.
[0119] Step 708: If the audio similarity reaches a second audio similarity threshold, it is determined that the audio frame to be tested is a noise-doped audio frame.
[0120] The second audio similarity threshold is lower than the first audio similarity threshold, and the second audio similarity threshold is a preset reference value for determining whether the audio frame to be tested is correlated with the sample audio frame. If the audio similarity between the audio frame to be tested and the sample audio frame does not reach the first audio similarity threshold, but reaches the second audio similarity threshold, it means that the audio frame to be tested is correlated with the sample audio frame, but is doped with noise so that the similarity with the sample audio frame does not reach the first audio similarity threshold.
[0121] like Figure 8 As shown, in one embodiment, the coding quality testing method includes steps 801 to 810:
[0122] Step 801, in response to a test request for a product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to input audio and video composite data;
[0123] Step 802, extracting frames of the audio data to be analyzed and the video data to be analyzed, and obtaining at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0124] Step 803, extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing the sample video frame with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of audio and video composite data;
[0125] Step 804, extracting a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and comparing it with the audio frame to be tested to obtain audio similarity;
[0126] Step 805: compare whether the audio similarity reaches a first audio similarity threshold.
[0127] Step 806: If the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0128] Step 807: If the audio similarity does not reach the first audio similarity threshold, compare whether the audio similarity reaches the second audio similarity threshold.
[0129] Step 808: If the audio similarity does not reach the second audio similarity threshold, the volume value of the audio frame to be tested is compared with the volume threshold.
[0130] Step 809: If the volume value of the audio frame to be tested reaches the volume threshold, it is determined that the audio frame to be tested is a pure noise audio frame.
[0131] Step 810: If the volume value of the audio frame to be tested does not reach the volume threshold, it is determined that the audio frame to be tested is a silent audio frame.
[0132] Among them, the second audio similarity threshold is lower than the first audio similarity threshold, and the volume threshold is a preset reference value for judging whether the audio frame to be tested is silent. When the audio similarity of the audio frame to be tested does not reach the second audio similarity threshold, the audio frame to be tested may be a pure noise audio frame or a silent audio frame. By comparing the volume value of the audio frame to be tested with the volume threshold, the type of quality problem of the audio frame to be tested can be determined. If the volume value of the audio frame to be tested does not reach the volume threshold, the audio frame to be tested is determined to be a silent audio frame; if the volume value of the audio frame to be tested reaches the volume threshold, the audio frame to be tested is determined to be a pure noise audio frame.
[0133] like Fig. 9 As shown, in one embodiment, the coding quality testing method includes steps 901 to 909:
[0134] Step 901, in response to a test request for a product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to input audio and video composite data;
[0135] Step 902, extracting frames of the audio data to be analyzed and the video data to be analyzed, and obtaining at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0136] Step 903, extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing the sample video frame with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of audio and video composite data;
[0137] Step 904, extracting a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and comparing it with the audio frame to be tested to obtain audio similarity;
[0138] Step 905: compare whether the audio similarity reaches a first audio similarity threshold.
[0139] Step 906: If the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0140] Step 907: If the audio similarity does not reach the first audio similarity threshold, compare whether the audio similarity reaches the second audio similarity threshold.
[0141] Step 908: if the audio similarity does not reach the second audio similarity threshold, then compare the adjacent frame set of the sample audio frame with the audio frame to be tested;
[0142] Step 909: If the similarity between any frame in the adjacent frame set and the audio frame to be tested reaches a first audio similarity threshold, it is determined that an audio offset occurs in the audio data to be analyzed.
[0143] Wherein, the second audio similarity threshold is lower than the first audio similarity threshold. The neighboring frame set of the sample audio frame includes audio frames that are adjacent to several frames in sequence and / or audio frames that are adjacent to several frames in sequence starting from the sample audio frame. When the audio similarity between the audio frame to be tested and the corresponding sample audio frame does not reach the first audio similarity threshold and does not reach the second audio similarity threshold, it may be due to audio offset of the audio data to be analyzed, that is, the timestamps of each audio frame have shifted forward or backward. The audio offset will cause the audio and image to be out of sync. In order to determine whether the encoding and decoding quality is unqualified due to the audio offset, the neighboring frame set of the sample audio frame can be used to compare with the audio frame to be tested. If the similarity between any frame in the neighboring frame set and the audio frame to be tested reaches the first audio similarity threshold, it indicates that the timestamp of the audio frame in the neighboring frame set is the correct timestamp of the audio frame to be tested. It can be determined that the audio data to be analyzed has audio offset, and based on the difference between the order and timestamp of the audio frame and the sample audio frame, it can be determined whether the audio data to be analyzed is offset forward or backward, and the offset time is determined.
[0144] It should be understood that although Figure 2-9 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 2-9 At least part of the steps may include multiple steps or multiple stages. These steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.
[0145] like Fig.10 As shown, the embodiment of the present application also provides a coding quality testing device 1000, including:
[0146] The to-be-analyzed data acquisition module 1010 is used to respond to a test request for the product to be tested and acquire the to-be-analyzed audio data and the to-be-analyzed video data outputted by the product to be tested corresponding to the input audio and video composite data;
[0147] The frame extraction module 1020 is used to extract frames of the audio data to be analyzed and the video data to be analyzed, and obtain at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0148] The image comparison module 1030 is used to extract a sample video frame having the same timestamp as the video frame to be tested from the sample data, and compare it with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of audio and video composite data;
[0149] The audio comparison module 1040 is used to extract a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and compare it with the audio frame to be tested to obtain audio similarity;
[0150] The evaluation module 1050 is used to determine that the encoding and decoding quality of the product to be tested is qualified when the image similarity reaches an image similarity threshold and the audio similarity reaches a first audio similarity threshold.
[0151] like Fig.11 As shown, in one embodiment, the coding quality testing device 1000 further includes:
[0152] The image detection module 1060 is used to perform image quality problem detection on the video frame to be tested when the image similarity corresponding to the video frame to be tested does not reach the image similarity threshold.
[0153] In one of the embodiments, the image detection module 1060 is used to perform pixel detection on the video frame to be tested when the image similarity corresponding to the video frame to be tested does not reach the image similarity threshold. If the proportion of black pixels in the video frame to be tested is higher than the pixel ratio threshold, the video frame to be tested is determined to be a black screen frame.
[0154] like Fig.12 As shown, in one embodiment, the image detection module 1060 includes:
[0155] The image segmentation unit 1061 is used to segment the video frame to be tested into a plurality of image sub-regions, and to segment the sample video frame having the same timestamp as the video frame to be tested into sample image sub-regions having the same number as the image sub-regions;
[0156] The image region comparison unit 1062 is used to compare the similarity of each image sub-region with the corresponding sample image sub-region to obtain the region similarity;
[0157] The distorted screen frame identification unit 1063 is used to determine that the video frame to be tested is a distorted screen frame and the image sub-region whose regional similarity is lower than the image similarity threshold is a distorted screen region when the number of image sub-regions whose regional similarity is lower than the image similarity threshold is lower than the total number of image sub-regions.
[0158] like Fig.13 As shown, in one embodiment, the coding quality testing device 1000 further includes:
[0159] The audio detection module 1070 is configured to perform audio quality problem detection on the audio frame to be tested if the audio similarity corresponding to the audio frame to be tested does not reach a first audio similarity threshold.
[0160] In one embodiment, the audio detection module 1070 is used to determine that the audio frame to be tested is a noise-doped audio frame when the audio similarity reaches a second audio similarity threshold; wherein the second audio similarity threshold is lower than the first audio similarity threshold.
[0161] like Fig.14 As shown, in one embodiment, the audio detection module 1070 includes:
[0162] The volume comparison unit 1071 is used to compare the volume value of the audio frame to be tested with the volume threshold when the audio similarity of the audio frame to be tested does not reach the second audio similarity threshold; wherein the second audio similarity threshold is lower than the first audio similarity threshold;
[0163] The pure noise audio frame detection unit 1072 is used to determine that the audio frame to be tested is a pure noise audio frame when the volume value of the audio frame to be tested reaches a volume threshold;
[0164] The silent audio frame detection unit 1073 is configured to determine that the audio frame to be tested is a silent audio frame when the volume value of the audio frame to be tested does not reach a volume threshold.
[0165] like Fig.15 As shown, in one embodiment, the audio detection module 1070 includes:
[0166] The adjacent frame comparison unit 1074 is used to compare the adjacent frame set of the sample audio frame with the audio frame to be tested when the audio similarity does not reach the second audio similarity threshold; wherein the second audio similarity threshold is lower than the first audio similarity threshold;
[0167] The audio offset detection unit 1075 is configured to determine that an audio offset occurs in the audio data to be analyzed when the similarity between any frame in the adjacent frame set and the audio frame to be detected reaches a first audio similarity threshold.
[0168] For the specific definition of the codec quality test device, please refer to the definition of the codec quality test method above, which will not be repeated here. Each module in the above-mentioned codec quality test device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0169] In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as follows: Fig.16 As shown. The computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, an operator network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a method for testing codec quality is implemented. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covered on the display screen, or a key, trackball or touchpad set on the computer device housing, or an external keyboard, touchpad or mouse, etc.
[0170] Those skilled in the art will understand that Fig.16 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0171] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:
[0172] In response to a test request for the product to be tested, obtaining the audio data to be analyzed and the video data to be analyzed outputted by the product to be tested corresponding to the input audio and video composite data;
[0173] Extract frames of the audio data to be analyzed and the video data to be analyzed to obtain at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0174] Extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing it with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of audio and video composite data;
[0175] Extracting a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and comparing it with the audio frame to be tested to obtain audio similarity;
[0176] If the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0177] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0178] If the image similarity does not reach the image similarity threshold, image quality problem detection is performed on the video frame to be tested.
[0179] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0180] Pixel detection is performed on the video frame to be tested. If the proportion of black pixels in the video frame to be tested is higher than the pixel ratio threshold, the video frame to be tested is determined to be a black screen frame.
[0181] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0182] The video frame to be tested is divided into a plurality of image sub-regions, and a sample video frame having the same timestamp as the video frame to be tested is divided into sample image sub-regions having the same number as the image sub-regions;
[0183] Compare the similarity of each image sub-region with the corresponding sample image sub-region to obtain the regional similarity;
[0184] If the number of image sub-regions whose regional similarity is lower than the image similarity threshold is lower than the total number of image sub-regions, the video frame to be tested is determined to be a distorted screen frame, and the image sub-region whose regional similarity is lower than the image similarity threshold is a distorted screen region.
[0185] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0186] If the audio similarity does not reach the first audio similarity threshold, audio quality problem detection is performed on the audio frame to be tested.
[0187] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0188] If the audio similarity reaches a second audio similarity threshold, the audio frame to be tested is determined to be a noise-doped audio frame; wherein the second audio similarity threshold is lower than the first audio similarity threshold.
[0189] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0190] If the audio similarity of the audio frame to be tested does not reach the second audio similarity threshold, comparing the volume value of the audio frame to be tested with the volume threshold; wherein the second audio similarity threshold is lower than the first audio similarity threshold;
[0191] If the volume value of the audio frame to be tested reaches the volume threshold, it is determined that the audio frame to be tested is a pure noise audio frame;
[0192] If the volume value of the audio frame to be tested does not reach the volume threshold, it is determined that the audio frame to be tested is a silent audio frame.
[0193] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0194] If the audio similarity does not reach a second audio similarity threshold, then using a neighboring frame set of the sample audio frame to compare with the audio frame to be tested; wherein the second audio similarity threshold is lower than the first audio similarity threshold;
[0195] If the similarity between any frame in the adjacent frame set and the audio frame to be tested reaches a first audio similarity threshold, it is determined that an audio offset occurs in the audio data to be analyzed.
[0196] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
[0197] In response to a test request for the product to be tested, obtaining the audio data to be analyzed and the video data to be analyzed outputted by the product to be tested corresponding to the input audio and video composite data;
[0198] Extract frames of the audio data to be analyzed and the video data to be analyzed to obtain at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp;
[0199] Extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing it with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of audio and video composite data;
[0200] Extracting a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and comparing it with the audio frame to be tested to obtain audio similarity;
[0201] If the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified.
[0202] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0203] If the image similarity does not reach the image similarity threshold, image quality problem detection is performed on the video frame to be tested.
[0204] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0205] Pixel detection is performed on the video frame to be tested. If the proportion of black pixels in the video frame to be tested is higher than the pixel ratio threshold, the video frame to be tested is determined to be a black screen frame.
[0206] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0207] The video frame to be tested is divided into a plurality of image sub-regions, and a sample video frame having the same timestamp as the video frame to be tested is divided into sample image sub-regions having the same number as the image sub-regions;
[0208] Compare the similarity of each image sub-region with the corresponding sample image sub-region to obtain the regional similarity;
[0209] If the number of image sub-regions whose regional similarity is lower than the image similarity threshold is lower than the total number of image sub-regions, the video frame to be tested is determined to be a distorted screen frame, and the image sub-region whose regional similarity is lower than the image similarity threshold is a distorted screen region.
[0210] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0211] If the audio similarity does not reach the first audio similarity threshold, audio quality problem detection is performed on the audio frame to be tested.
[0212] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0213] If the audio similarity reaches a second audio similarity threshold, the audio frame to be tested is determined to be a noise-doped audio frame; wherein the second audio similarity threshold is lower than the first audio similarity threshold.
[0214] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0215] If the audio similarity of the audio frame to be tested does not reach the second audio similarity threshold, comparing the volume value of the audio frame to be tested with the volume threshold; wherein the second audio similarity threshold is lower than the first audio similarity threshold;
[0216] If the volume value of the audio frame to be tested reaches the volume threshold, it is determined that the audio frame to be tested is a pure noise audio frame;
[0217] If the volume value of the audio frame to be tested does not reach the volume threshold, it is determined that the audio frame to be tested is a silent audio frame.
[0218] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0219] If the audio similarity does not reach a second audio similarity threshold, then using a neighboring frame set of the sample audio frame to compare with the audio frame to be tested; wherein the second audio similarity threshold is lower than the first audio similarity threshold;
[0220] If the similarity between any frame in the adjacent frame set and the audio frame to be tested reaches a first audio similarity threshold, it is determined that an audio offset occurs in the audio data to be analyzed.
[0221] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).
[0222] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0223] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.
Claims
1. A method for testing coding quality, characterized in that: The method comprises: In response to a test request for the product to be tested, obtaining audio data to be analyzed and video data to be analyzed outputted by the product to be tested corresponding to the input audio and video composite data; Extracting frames of the audio data to be analyzed and the video data to be analyzed to obtain at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp; Extracting a sample video frame having the same timestamp as the video frame to be tested from the sample data, and comparing it with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of the audio and video composite data; Extracting a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and comparing the sample audio frame with the audio frame to be tested to obtain audio similarity; If the image similarity reaches the image similarity threshold, and the audio similarity reaches the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is qualified; If the audio similarity does not reach the first audio similarity threshold, the method of detecting audio quality problems for the audio frame to be tested includes: if the audio similarity of the audio frame to be tested does not reach the second audio similarity threshold, comparing the volume value of the audio frame to be tested with the volume threshold, wherein the second audio similarity threshold is lower than the first audio similarity threshold, if the volume value of the audio frame to be tested reaches the volume threshold, determining that the audio frame to be tested is a pure noise audio frame, if the volume value of the audio frame to be tested does not reach the volume threshold, determining that the audio frame to be tested is a silent audio frame; and, if the audio similarity does not reach the second audio similarity threshold, using the neighboring frame set of the sample audio frame to compare with the audio frame to be tested, wherein the second audio similarity threshold is lower than the first audio similarity threshold, if the similarity between any frame in the neighboring frame set and the audio frame to be tested reaches the first audio similarity threshold, determining that the audio data to be analyzed has an audio offset; If the image similarity does not reach the image similarity threshold, the method of detecting image quality problems on the video frame to be tested includes: dividing the video frame to be tested into multiple image sub-regions, and dividing the sample video frame with the same timestamp as the video frame to be tested into sample image sub-regions with the same number as the image sub-regions, and comparing the similarity of each image sub-region with the corresponding sample image sub-region to obtain regional similarity, if the number of image sub-regions whose regional similarity is lower than the image similarity threshold is lower than the total number of image sub-regions, then determining that the video frame to be tested is a flower screen frame, and the image sub-region whose regional similarity is lower than the image similarity threshold is a flower screen region; and, performing pixel point detection on the video frame to be tested, if the proportion of black pixels in the video frame to be tested is higher than the pixel point ratio threshold, then determining that the video frame to be tested is a black screen frame.
2. The coding quality testing method according to claim 1, characterized in that: If the test request is a decoding quality test request, the audio data to be analyzed and the video data to be analyzed are data output after the audio and video composite data are directly decoded by the product to be tested; If the test request is a coding quality test request, the audio data to be analyzed and the video data to be analyzed are data output after the product to be tested sequentially decodes, encodes, and decodes the audio and video composite data.
3. The coding quality testing method according to claim 1, characterized in that: The standard decoding refers to the use of equipment with qualified decoding quality to perform decoding processing; the sample data includes sample audio data.
4. The coding quality testing method according to claim 1, characterized in that: The step of extracting frames from the audio data to be analyzed to obtain at least one audio frame to be tested with a timestamp includes: The audio data to be analyzed is randomly jumped to a timestamp, and a frame corresponding to the timestamp is extracted as the audio frame to be tested.
5. The coding quality testing method according to claim 1, characterized in that: The method further comprises: When the image similarity corresponding to any one of the video frames to be tested does not reach the image similarity threshold, and / or the audio similarity corresponding to any one of the audio frames to be tested does not reach the first audio similarity threshold, it is determined that the encoding and decoding quality of the product to be tested is unqualified.
6. The coding quality testing method according to claim 1, characterized in that: The step of extracting frames from the video data to be analyzed to obtain at least one video frame to be tested with a timestamp includes: The video data to be analyzed is randomly jumped to a timestamp, and a frame corresponding to the timestamp is extracted as a video frame to be tested.
7. The coding quality testing method according to claim 1, characterized in that: The step of performing audio quality problem detection on the audio frame to be tested comprises: If the audio similarity reaches the second audio similarity threshold, it is determined that the audio frame to be tested is a noise-doped audio frame; wherein the second audio similarity threshold is lower than the first audio similarity threshold.
8. The method for testing coding quality according to claim 1, characterized in that: The method further comprises: Extract frames of the video data to be analyzed at intervals, and compare the image similarity between each extracted video frame to be tested and the corresponding sample video frame; If the image similarity of each of the video frames to be tested reaches the image similarity threshold, it is determined that the encoding quality of the video part of the product to be tested is qualified.
9. The method for testing coding quality according to claim 1, characterized in that: The method further comprises: Extracting frames of the audio data to be analyzed at intervals, and comparing the audio similarity between each extracted audio frame to be tested and the corresponding sample audio frame; If the audio similarity of each of the audio frames to be tested reaches the first audio similarity threshold, it is determined that the encoding quality of the audio part of the product to be tested is qualified.
10. A coding quality testing device, characterized in that: The device comprises: The to-be-analyzed data acquisition module is used to respond to a test request for the product to be tested and acquire the to-be-analyzed audio data and the to-be-analyzed video data outputted by the product to be tested corresponding to the input audio and video composite data; A frame extraction module, used for extracting frames of the audio data to be analyzed and the video data to be analyzed, and obtaining at least one video frame to be tested with a timestamp and at least one audio frame to be tested with a timestamp; An image comparison module is used to extract a sample video frame having the same timestamp as the video frame to be tested from the sample data, and compare it with the video frame to be tested to obtain image similarity; the sample data is data obtained by standard decoding of the audio and video composite data; An audio comparison module, configured to extract a sample audio frame having the same timestamp as the audio frame to be tested from the sample data, and compare the sample audio frame with the audio frame to be tested to obtain audio similarity; An evaluation module, configured to determine that the encoding and decoding quality of the product to be tested is qualified when the image similarity reaches an image similarity threshold and the audio similarity reaches a first audio similarity threshold; The audio detection module is used for detecting the audio quality problem of the audio frame to be tested if the audio similarity does not reach the first audio similarity threshold, including: if the audio similarity of the audio frame to be tested does not reach the second audio similarity threshold, comparing the volume value of the audio frame to be tested with the volume threshold, wherein the second audio similarity threshold is lower than the first audio similarity threshold, if the volume value of the audio frame to be tested reaches the volume threshold, determining that the audio frame to be tested is a pure noise audio frame, if the volume value of the audio frame to be tested does not reach the volume threshold, determining that the audio frame to be tested is a silent audio frame; and, if the audio similarity does not reach the second audio similarity threshold, using the neighboring frame set of the sample audio frame to compare with the audio frame to be tested, wherein the second audio similarity threshold is lower than the first audio similarity threshold, if the similarity between any frame in the neighboring frame set and the audio frame to be tested reaches the first audio similarity threshold, determining that the audio data to be analyzed has an audio offset; An image detection module, for detecting image quality problems on the video frame to be tested if the image similarity does not reach the image similarity threshold, comprising: dividing the video frame to be tested into multiple image sub-regions, and dividing the sample video frame with the same timestamp as the video frame to be tested into sample image sub-regions with the same number as the image sub-regions, performing similarity comparison between each image sub-region and the corresponding sample image sub-region to obtain regional similarity, if the number of image sub-regions with regional similarity lower than the image similarity threshold is lower than the total number of image sub-regions, determining that the video frame to be tested is a distorted screen frame, and the image sub-region with the regional similarity lower than the image similarity threshold is a distorted screen region; and, performing pixel point detection on the video frame to be tested, if the proportion of black pixels in the video frame to be tested is higher than the pixel point ratio threshold, determining that the video frame to be tested is a black screen frame.
11. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 9 are implemented.
12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.
