Self-adaptive code rate test method and device, computer equipment, readable storage medium and program product

Abstract

The invention relates to a self-adaptive code rate testing method and device, computer equipment, a computer readable storage medium and a computer program product, and relates to the technical field of software testing. According to the method, the performance of the adaptive code rate algorithm under related network conditions can be evaluated, and data support is provided for improving video service quality. The method comprises the following steps: obtaining a simulation network condition of a test video stream according to network condition simulation information, the simulation network condition being used for simulating the network condition of the test video stream, and then obtaining test data obtained by processing the test video stream by a video stream processor running a self-adaptive code rate algorithm under the simulation network condition, and obtaining a test result of the adaptive code rate algorithm according to the test data.

Description

Technical Field

[0001] The present application relates to the field of software testing technology, and in particular to a method, apparatus, computer equipment, computer-readable storage medium, and computer program product for testing an adaptive bit rate. Background Art

[0002] With the development of network technology, video streaming services have become increasingly common on the internet. Users can watch high-definition videos in real time on various devices without having to download the entire file. However, due to the uncertainty of network conditions, traditional video transmission protocols often fail to provide a stable viewing experience. To address this, the adaptive bitrate (ABR) algorithm has been introduced into video streaming services.

[0003] Adaptive bitrate algorithms dynamically adjust the video bitrate based on current network conditions to provide the best viewing experience. However, current technologies lack the ability to test and analyze the performance of adaptive bitrate algorithms. Summary of the Invention

[0004] Based on this, it is necessary to provide an adaptive bit rate testing method, apparatus, computer equipment, computer-readable storage medium and computer program product to address the above technical issues.

[0005] In a first aspect, the present application provides a method for testing an adaptive bit rate, comprising:

[0006] According to the network condition simulation information, a simulated network condition of the test video stream is obtained; the simulated network condition is used to simulate the network condition of the test video stream;

[0007] Acquiring test data obtained by a video stream processor processing the test video stream under the simulated network conditions; the video stream processor running an adaptive bit rate algorithm;

[0008] A test result of the adaptive bit rate algorithm is obtained according to the test data.

[0009] In one embodiment, the test data obtained by the video stream processor processing the test video stream under the simulated network conditions includes: in a test environment, triggering a video stream receiver to receive the test video stream and transmit it to the video stream processor, and introducing the simulated network conditions during the process of the video stream receiver receiving the test video stream; and obtaining the test data obtained by the video stream processor processing the test video stream.

[0010] In one embodiment, introducing the simulated network condition during the process of the video stream receiver receiving the test video stream includes: setting the simulated network condition during the process of the video stream receiver receiving the test video stream through a flow control command provided by a target operating system.

[0011] In one embodiment, the network condition includes one or more of bandwidth, delay, and packet loss rate.

[0012] In one embodiment, obtaining the test result of the adaptive bitrate algorithm based on the test data includes: obtaining an indicator evaluation result of the test data corresponding to a preset evaluation indicator based on the test data and a preset evaluation indicator algorithm; the preset evaluation indicator algorithm corresponds to the preset evaluation indicator; and obtaining the test result of the adaptive bitrate algorithm based on the indicator evaluation result.

[0013] In one embodiment, after obtaining the test results of the adaptive bit rate algorithm based on the test data, the method further includes: obtaining the test results corresponding to the adaptive bit rate algorithm under different simulated network conditions to obtain a first test result set; obtaining the first test result sets corresponding to different adaptive bit rate algorithms to obtain a second test result set; and obtaining a test report based on the second test result set.

[0014] In a second aspect, the present application further provides a testing device for an adaptive bit rate, comprising:

[0015] A condition determination module is used to obtain simulated network conditions for the test video stream based on the network condition simulation information; the simulated network conditions are used to simulate the network conditions of the test video stream;

[0016] A data acquisition module is used to acquire test data obtained by a video stream processor processing the test video stream under the simulated network conditions; the video stream processor runs an adaptive bit rate algorithm;

[0017] The result obtaining module is used to obtain the test result of the adaptive bit rate algorithm according to the test data.

[0018] In a third aspect, the present application further provides a computer device comprising a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0019] According to the network condition simulation information, simulated network conditions of the test video stream are obtained; the simulated network conditions are used to simulate the network conditions of the test video stream; test data obtained by the video stream processor processing the test video stream under the simulated network conditions is obtained; the video stream processor runs an adaptive bit rate algorithm; and a test result of the adaptive bit rate algorithm is obtained according to the test data.

[0020] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0021] According to the network condition simulation information, simulated network conditions of the test video stream are obtained; the simulated network conditions are used to simulate the network conditions of the test video stream; test data obtained by the video stream processor processing the test video stream under the simulated network conditions is obtained; the video stream processor runs an adaptive bit rate algorithm; and a test result of the adaptive bit rate algorithm is obtained according to the test data.

[0022] In a fifth aspect, the present application further provides a computer program product, comprising a computer program, which, when executed by a processor, implements the following steps:

[0023] According to the network condition simulation information, simulated network conditions of the test video stream are obtained; the simulated network conditions are used to simulate the network conditions of the test video stream; test data obtained by the video stream processor processing the test video stream under the simulated network conditions is obtained; the video stream processor runs an adaptive bit rate algorithm; and a test result of the adaptive bit rate algorithm is obtained according to the test data.

[0024] The adaptive bitrate testing method, apparatus, computer device, computer-readable storage medium, and computer program product described above obtain simulated network conditions for a test video stream based on network condition simulation information. These simulated network conditions are used to simulate the network conditions of the test video stream. Test data obtained by a video stream processor running an adaptive bitrate algorithm processing the test video stream under the simulated network conditions is then obtained, and test results of the adaptive bitrate algorithm are obtained based on this test data. This solution can simulate different network conditions to obtain test data obtained by a video stream processor running an adaptive bitrate algorithm processing the test video stream under these network conditions. This test data can be used to obtain test results of the adaptive bitrate algorithm under these relevant network conditions, thereby evaluating the performance of the adaptive bitrate algorithm under these conditions and providing data support for improving video service quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments of the present application or related technical descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying any creative work.

[0026] FIG1 is a diagram illustrating an application environment of an adaptive bit rate testing method according to an embodiment;

[0027] FIG2 is a schematic flow chart of a method for testing an adaptive bit rate in one embodiment;

[0028] FIG3 is a structural block diagram of a testing device for adaptive bit rate according to an embodiment;

[0029] FIG4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0030] In order to make the purpose, technical solutions and advantages of this application more clear, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0031] The adaptive bit rate testing method provided in the embodiment of the present application can be applied to the application environment shown in Figure 1, which can be deployed in a server. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services. In this application environment, the test video stream represents the video stream to be tested, which can be from a real streaming media service or a pre-recorded video file. The video stream receiver can be responsible for receiving the test video stream and simulating different network conditions through a network simulator. The network simulator can simulate different network conditions. The video stream processor can decode and play the video stream received by the video stream receiver, and can use a video player library such as FFmpeg, GStreamer, etc. The data acquisition and analysis module can be used to collect and analyze relevant data of the video stream, and can be used to evaluate the performance of the video stream under different network conditions. It can be implemented by writing Python or Go programs. The test report generator can be used to generate a test report based on the test results.

[0032] The following describes the adaptive bit rate testing method of the present application based on the application environment shown in FIG1 and in combination with various embodiments and corresponding drawings.

[0033] In an exemplary embodiment, as shown in FIG2 , a method for testing an adaptive bit rate is provided. The method may be executed by a server and may include the following steps:

[0034] Step S201: obtaining simulated network conditions for testing video streams according to network condition simulation information.

[0035] The network condition simulation information may be related information set by the user for the server to simulate corresponding network conditions. The simulated network conditions are network conditions used to simulate the test video stream.

[0036] In one embodiment, the network conditions used to simulate the test video stream may include one or more of bandwidth, delay, and packet loss rate. The network condition simulation information may include the network conditions to be set, the value or value range for each network condition, and the like. For example, the network condition simulation information may include setting the bandwidth to 5 Mbps, the delay to 50 ms, and the packet loss rate to 2%.

[0037] In this step, the network simulator may obtain the simulated network conditions for the test video stream according to the network condition simulation information.

[0038] Step S202: Acquire test data obtained by the video stream processor processing the test video stream under simulated network conditions.

[0039] The video stream processor runs an adaptive bitrate algorithm, which may be the adaptive bitrate algorithm to be tested. The video stream processor running the adaptive bitrate algorithm can process a test video stream under simulated network conditions to obtain data related to the video stream as test data. For example, the test data may include video frames, video frame timestamps, and other test-related information. Specific test data can be collected based on test requirements.

[0040] In this step, the data acquisition and analysis module may acquire test data obtained by the video stream processor processing the test video stream under simulated network conditions.

[0041] Step S203: Obtain test results of the adaptive bit rate algorithm based on the test data.

[0042] In this step, test results of the adaptive bitrate algorithm under the aforementioned simulated network conditions can be obtained based on the test data. As an example, the test data can be used to analyze the test results, such as whether certain evaluation indicators (e.g., video quality) of the adaptive bitrate algorithm under the aforementioned simulated network conditions meet the expected requirements of the adaptive bitrate algorithm.

[0043] The adaptive bitrate testing method of this embodiment obtains simulated network conditions for a test video stream based on network condition simulation information. The simulated network conditions are used to simulate the network conditions of the test video stream. Then, test data obtained by a video stream processor running an adaptive bitrate algorithm processing the test video stream under the simulated network conditions is obtained. The test results of the adaptive bitrate algorithm are obtained based on this test data. This solution can obtain test data obtained by a video stream processor running an adaptive bitrate algorithm processing the test video stream under the network conditions by simulating different network conditions. Based on this data, the test results of the adaptive bitrate algorithm under the relevant network conditions can be obtained, thereby evaluating the performance of the adaptive bitrate algorithm under the relevant network conditions and providing data support for improving the quality of video services.

[0044] In an exemplary embodiment, obtaining test data obtained by processing the test video stream by the video stream processor under simulated network conditions in step S202 may include:

[0045] In a test environment, a video stream receiver is triggered to receive a test video stream and transmit it to a video stream processor, and simulated network conditions are introduced during the process of the video stream receiver receiving the test video stream; and test data obtained by the video stream processor processing the test video stream is obtained.

[0046] In this embodiment, the network conditions to be simulated can be controlled in a test environment so that the video stream processor can process the test video stream under the simulated network conditions, thereby obtaining relatively accurate test data. Specifically, a video stream receiver can be triggered to begin cyclically receiving the test video stream, and the video stream receiver can transmit the received test video stream to the video stream processor. Specifically, the network simulator can introduce simulated network conditions during the process of the video stream receiver receiving the test video stream, such as introducing delays, randomly discarding some data packets, etc. Thus, test data obtained by the video stream processor processing the test video stream under the simulated network conditions can be obtained.

[0047] In an exemplary embodiment, further, the above-mentioned introduction of simulated network conditions during the process of the video stream receiver receiving the test video stream may include:

[0048] The flow control commands provided by the target operating system are used to set simulated network conditions during the process of the video stream receiver receiving the test video stream.

[0049] The target operating system may be an operating system available on a server, such as a Linux system. In this embodiment, a traffic control command (tc command) provided by the Linux system may be used to set simulated network conditions during the process of the video stream receiver receiving the test video stream, thereby achieving the effect of introducing simulated network conditions during the process of the video stream receiver receiving the test video stream.

[0050] In an exemplary embodiment, obtaining a test result of the adaptive bit rate algorithm based on test data may include:

[0051] According to the test data and the preset evaluation index algorithm, the index evaluation result of the test data corresponding to the preset evaluation index is obtained; according to the index evaluation result, the test result of the adaptive bit rate algorithm is obtained.

[0052] Among them, the preset evaluation index algorithm corresponds to the preset evaluation index. The evaluation index can be determined as needed, and the corresponding evaluation index algorithm can be obtained based on the evaluation index. As an example, the evaluation index can include video quality, buffer overflow times, etc., so the evaluation index algorithm corresponding to the video quality and buffer overflow times can be obtained and handed over to the data acquisition and analysis module for use. Based on this, in this embodiment, after obtaining the test data, the data acquisition and analysis module can calculate the index evaluation results of the test data corresponding to the preset evaluation index, such as video quality, buffer rebuffering times, etc., based on the test data and the preset evaluation index algorithm. In this way, the test results of the adaptive bit rate algorithm can be obtained based on the index evaluation results of various evaluation indicators, and the index evaluation results of various evaluation indicators can be used as the test results of the adaptive bit rate algorithm.

[0053] In an exemplary embodiment, after obtaining the test result of the adaptive bit rate algorithm based on the test data in step S203, the method of the present application may further include:

[0054] Obtain test results corresponding to the adaptive bit rate algorithm under different simulated network conditions to obtain a first test result set; obtain the first test result set corresponding to different adaptive bit rate algorithms to obtain a second test result set; and obtain a test report based on the second test result set.

[0055] In this embodiment, multiple adaptive bit rate algorithms can be tested. For each adaptive bit rate algorithm, different simulated network conditions can be used for testing, thereby improving the efficiency and comprehensiveness of the test.

[0056] For each adaptive bitrate algorithm, corresponding test results of the adaptive bitrate algorithm under different simulated network conditions can be obtained to obtain a first test result set of the adaptive bitrate algorithm. Table 1 below shows one test result:

[0057] Table 1 Test results

[0058]

[0059] Thus, the first test result set corresponding to various adaptive bitrate algorithms can be obtained to obtain a second test result set. The second test result set can include the first test result set corresponding to the various adaptive bitrate algorithms, i.e., the test results corresponding to each of the various adaptive bitrate algorithms under different simulated network conditions. Thus, a test report generator can generate a test report based on the second test result set, and the test report can also include the second test result set, thereby improving the efficiency and comprehensiveness of the test. In practical applications, improvement suggestions can also be provided in the test report based on the second test result set for the corresponding adaptive bitrate algorithm to improve the quality of video service.

[0060] Overall, the adaptive bitrate testing method of the present application can be used to comprehensively and accurately evaluate the performance of various adaptive bitrate algorithms under different network conditions, help optimize the algorithms, and improve the quality of video services. It also has high testing efficiency and can customize and expand network conditions and evaluation indicators according to actual needs. It is suitable for different video streaming services, has good flexibility and scalability, and can also be applied to actual video streaming services.

[0061] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence according to the instructions of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above can include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0062] Based on the same inventive concept, embodiments of the present application also provide an adaptive bit rate testing device for implementing the adaptive bit rate testing method described above. The solution provided by this device is similar to the solution described in the method described above. Therefore, the specific limitations of one or more adaptive bit rate testing device embodiments provided below can be found in the limitations of the adaptive bit rate testing method described above and will not be further elaborated here.

[0063] In an exemplary embodiment, as shown in FIG3 , a testing apparatus for adaptive bit rate is provided. The apparatus 300 may include:

[0064] Condition determination module 301, used to obtain simulated network conditions for the test video stream based on network condition simulation information; the simulated network conditions are used to simulate the network conditions of the test video stream;

[0065] The data acquisition module 302 is used to obtain test data obtained by a video stream processor processing the test video stream under the simulated network conditions; the video stream processor runs an adaptive bit rate algorithm;

[0066] The result obtaining module 303 is used to obtain the test result of the adaptive bit rate algorithm according to the test data.

[0067] In an exemplary embodiment, the data acquisition module 302 is used to trigger a video stream receiver to receive the test video stream and transmit it to the video stream processor in a test environment, introduce the simulated network conditions during the process of the video stream receiver receiving the test video stream, and obtain the test data obtained by the video stream processor processing the test video stream.

[0068] In an exemplary embodiment, the data acquisition module 302 is configured to set the simulated network condition during the process of the video stream receiver receiving the test video stream through a flow control command provided by a target operating system.

[0069] In an exemplary embodiment, the network condition includes one or more of bandwidth, delay, and packet loss rate.

[0070] In an exemplary embodiment, the result obtaining module 303 is used to obtain an indicator evaluation result of the test data corresponding to the preset evaluation indicator based on the test data and a preset evaluation indicator algorithm; the preset evaluation indicator algorithm corresponds to the preset evaluation indicator; and based on the indicator evaluation result, the test result of the adaptive bit rate algorithm is obtained.

[0071] In an exemplary embodiment, the device 300 may also include: a report generation module, used to obtain the test results corresponding to the adaptive bit rate algorithm under different simulated network conditions, and obtain a first test result set; obtain the first test result set corresponding to different adaptive bit rate algorithms, and obtain a second test result set; and obtain a test report based on the second test result set.

[0072] Each module in the adaptive bit rate test device described above may be implemented in whole or in part through software, hardware, or a combination thereof. Each module may be embedded in or independent of a processor in a computer device in the form of hardware, or may be stored in a memory in the computer device in the form of software, so that the processor can call and execute the corresponding operations of each module.

[0073] In an exemplary embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be shown in Figure 4. The computer device includes a processor, memory, an input / output (I / O) interface, and a communication interface. The processor, memory, and I / O interface are connected via a system bus, and the communication interface is connected to the system bus via the I / O interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The database of the computer device is used to store data such as test results. The I / O interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals via a network connection. When executed by the processor, the computer program implements an adaptive bit rate testing method.

[0074] Those skilled in the art will understand that the structure shown in FIG4 is merely a block diagram of a portion of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0075] In one embodiment, a computer device is further provided, including a memory and a processor. The memory stores a computer program, and the processor implements the steps in the above method embodiments when executing the computer program.

[0076] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0077] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0078] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0079] Those skilled in the art will understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. In particular, any reference to memory, database, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The databases involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the various embodiments provided herein may be, but are not limited to, general-purpose processors, central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), programmable logic devices (PLDs), quantum computing-based data processing logic devices, artificial intelligence (AI) processors, and the like.

[0080] The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0081] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A method for testing an adaptive bit rate, characterized in that: The method comprises: According to the network condition simulation information, a simulated network condition of the test video stream is obtained; the simulated network condition is used to simulate the network condition of the test video stream; Acquire test data obtained by a video stream processor processing the test video stream under the simulated network conditions; the video stream processor runs an adaptive bit rate algorithm; A test result of the adaptive bit rate algorithm is obtained according to the test data.

2. The method according to claim 1, characterized in that The acquiring of the test data obtained by the video stream processor processing the test video stream under the simulated network condition includes: In a test environment, triggering a video stream receiver to receive the test video stream and transmit it to the video stream processor, and introducing the simulated network condition during the process of the video stream receiver receiving the test video stream; Acquire test data obtained by the video stream processor processing the test video stream.

3. The method according to claim 2, characterized in that The introducing the simulated network condition during the process of the video stream receiver receiving the test video stream comprises: The simulated network condition during the process of the video stream receiver receiving the test video stream is set through a flow control command provided by the target operating system.

4. The method according to any one of claims 1 to 3, characterized in that The network condition includes one or more of bandwidth, delay and packet loss rate.

5. The method according to claim 1, characterized in that The step of obtaining the test result of the adaptive bit rate algorithm according to the test data includes: According to the test data and the preset evaluation index algorithm, an index evaluation result of the test data corresponding to the preset evaluation index is obtained; the preset evaluation index algorithm corresponds to the preset evaluation index; According to the indicator evaluation result, the test result of the adaptive bit rate algorithm is obtained.

6. The method according to claim 1, characterized in that After obtaining the test result of the adaptive bit rate algorithm according to the test data, the method further includes: Obtain the test results corresponding to the adaptive bit rate algorithm under different simulated network conditions to obtain a first test result set; Obtaining the first test result sets corresponding to different adaptive bit rate algorithms to obtain a second test result set; A test report is obtained according to the second test result set.

7. A test device for adaptive bit rate, characterized in that: The device comprises: A condition determination module, used to obtain simulated network conditions for a test video stream according to network condition simulation information; the simulated network conditions are used to simulate network conditions for the test video stream; A data acquisition module, used for acquiring test data obtained by a video stream processor processing the test video stream under the simulated network condition; the video stream processor runs an adaptive bit rate algorithm; The result obtaining module is used to obtain the test result of the adaptive bit rate algorithm according to the test data.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images