Application testing method, device, system, equipment and storage medium

Abstract

Embodiments of the present application provide an application program testing method, device, system, equipment and storage medium. A test server sends a test instruction to a test terminal. When receiving the test instruction, the test terminal sends a display request for a test network resource to a service server through a to-be-tested application program, so as to display the test network resource in a display interface of the to-be-tested application program and obtain a to-be-processed video containing the display interface of the to-be-tested application program. The test terminal sends a target video obtained based on the to-be-processed video to the test server. When receiving the target video, the test server obtains adjacent transition video frames with different picture contents from the target video, selects a key video frame from the two adjacent transition video frames, and determines a test result of the to-be-tested application program based on a difference value of time stamps of the two adjacent key video frames. Based on the above processing, the application program can be automatically tested, and the test efficiency of the application program is improved.

Description

Technical Field

[0001] The present invention relates to the field of Internet technology, and in particular to an application testing method, device, system, equipment and storage medium. Background Art

[0002] With the rapid development of internet technology, applications are providing increasingly rich functionality to users. During the application development process, testers are required to test these features and optimize them based on the test results. For example, they can test the latency of an application loading network resources.

[0003] In related technologies, an application can request network resources and obtain a target video containing the content displayed on the application's display interface during the request. Testers then use a video framing tool to segment the target video into multiple frames. Furthermore, technicians observe and select key video frames from these multiple frames. These key video frames include the first video frame showing the loading page on the application's display interface and the first video frame showing the network resource. Based on these key video frames, the latency of the application loading the network resource is calculated.

[0004] However, manually framing the target video and selecting key video frames from a large number of video frames through manual observation increases the time investment of technicians, requires large labor and time costs, and results in low efficiency of application testing. Summary of the Invention

[0005] The purpose of the embodiments of the present invention is to provide an application testing method, apparatus, system, device, and storage medium to automatically test applications and improve application testing efficiency. The specific technical solution is as follows:

[0006] In a first aspect of the present invention, an application testing method is provided. The method is applied to an application testing system, the system comprising: a testing server and a testing terminal. The method comprises:

[0007] The test server sends a test instruction for the application to be tested to the test terminal;

[0008] Upon receiving the test instruction, the test terminal sends a display request for the test network resource to the service server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested, and obtain a video to be processed including the display interface of the application to be tested; wherein the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; and sends a target video to the test server, where the target video is obtained based on the video to be processed;

[0009] When receiving the target video, the test server obtains two adjacent video frames with different picture contents from the target video as transition video frames; selects one video frame from the two adjacent transition video frames as a key video frame; and determines the test result of the application to be tested based on the difference between the timestamps of the two adjacent key video frames.

[0010] In a second aspect of the present invention, a method for testing an application program is provided. The method is applied to a test server and includes:

[0011] Sending a test instruction for the application to be tested to the test terminal, so that when the test terminal receives the test instruction, it sends a display request for the test network resource to the service server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested, obtain a video to be processed including the display interface of the application to be tested, and send a target video to the test server; wherein the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; the target video is obtained based on the video to be processed;

[0012] Upon receiving the target video, obtaining two adjacent video frames with different picture contents from the target video as transition video frames;

[0013] Selecting a video frame from two adjacent transition video frames as a key video frame;

[0014] A test result of the application to be tested is determined based on a difference between the timestamps of two adjacent key video frames.

[0015] Optionally, the test terminal includes: a first sub-test terminal and a second sub-test terminal, wherein the application to be tested is installed in the second sub-test terminal;

[0016] Before sending the test instruction for the application to be tested to the test terminal, the method further includes:

[0017] Receive test configuration information input by the user; wherein the test configuration information includes: application version number, terminal type identifier, and network environment information;

[0018] The sending of a test instruction for the application to be tested to the test terminal includes:

[0019] When the version number of the application to be tested is consistent with the application version number in the test configuration information, the type identifier of the second sub-test terminal is consistent with the terminal type identifier in the test configuration information, and the network environment information of the second sub-test terminal is consistent with the network environment information in the test configuration information, a test instruction for the application to be tested is sent to the first sub-test terminal, so that when the first sub-test terminal receives the test instruction, it sends the test instruction to the second sub-test terminal, so that the second sub-test terminal sends a display request for the test network resource to the business server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested.

[0020] Optionally, the first sub-test terminal is a computer, and the second sub-test terminal includes: at least one of: a mobile phone, a television, a box and a computer.

[0021] Optionally, the target video includes a thumbnail of each video frame in the video to be processed;

[0022] The step of selecting a video frame from two adjacent transition video frames as a key video frame includes:

[0023] Display two adjacent transition video frames;

[0024] When a video frame selection instruction input by a user is received, the video frame indicated by the video frame selection instruction is determined as a key video frame.

[0025] Optionally, the test network resource is a video, and the test result of the application to be tested includes a delay for the application to be tested to load the video;

[0026] or,

[0027] The test network resource is a designated page, and the test result of the application to be tested includes a delay for the application to be tested to switch to the designated page.

[0028] In a third aspect of the present invention, a method for testing an application program is provided. The method is applied to a test terminal and includes:

[0029] When receiving a test instruction for the application to be tested sent by the test server, sending a display request for the test network resource to the business server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested;

[0030] Acquire a video to be processed that includes the display interface of the application to be tested; wherein the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction;

[0031] A target video is sent to the test server, where the target video is obtained based on the video to be processed, so that when the test server receives the target video, it obtains two adjacent video frames with different picture contents from the target video as transition video frames; selects one video frame from the two adjacent transition video frames as a key video frame; and determines a test result of the application to be tested based on a difference in timestamps of the two adjacent key video frames.

[0032] Optionally, the test terminal includes: a first sub-test terminal and a second sub-test terminal, wherein the application to be tested is installed in the second sub-test terminal;

[0033] When receiving a test instruction for the application to be tested sent by the test server, sending a display request for the test network resource to the business server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested, including:

[0034] receiving, via the first sub-test terminal, a test instruction for the application to be tested sent by the test server, and sending the test instruction to the second sub-test terminal;

[0035] When the second sub-test terminal receives the test instruction, it sends a display request for the test network resource to the service server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested.

[0036] Optionally, obtaining the video to be processed including the display interface of the application to be tested includes:

[0037] Recording the screen when receiving the test instruction via the second sub-test terminal to obtain a video to be processed including the display interface of the application to be tested;

[0038] or,

[0039] The first sub-test terminal is used to shoot the second sub-test terminal when the test instruction is received, so as to obtain a to-be-processed video including the display interface of the application to be tested.

[0040] Optionally, before sending the target video to the test server, the method further includes:

[0041] Dividing the video to be processed into frames to obtain video frames contained in the video to be processed;

[0042] Each video frame in the video to be processed is compressed to obtain a target video containing thumbnails of each video frame.

[0043] In a fourth aspect of the present invention, there is also provided an application testing device, which is applied to a testing server and includes:

[0044] A sending module, configured to send a test instruction for the application to be tested to the test terminal, so that when the test terminal receives the test instruction, it sends a display request for the test network resource to the service server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested, obtain a video to be processed including the display interface of the application to be tested, and send a target video to the test server; wherein the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; and the target video is obtained based on the video to be processed;

[0045] an acquisition module, configured to, upon receiving the target video, acquire two adjacent video frames having different picture contents from the target video as transition video frames;

[0046] A selection module is used to select a video frame from two adjacent transition video frames as a key video frame;

[0047] The determination module is configured to determine a test result of the application to be tested based on a difference between time stamps of two adjacent key video frames.

[0048] In a fifth aspect of the present invention, there is further provided an application testing device, which is applied to a test terminal and includes:

[0049] a request module configured to, upon receiving a test instruction for the application to be tested sent by the test server, send a display request for the test network resource to the business server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested;

[0050] An acquisition module is configured to acquire a video to be processed that includes a display interface of the application to be tested; wherein the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction;

[0051] A sending module is used to send a target video to the test server, where the target video is obtained based on the video to be processed, so that when the test server receives the target video, it obtains two adjacent video frames with different picture contents from the target video as transition video frames; selects one video frame from the two adjacent transition video frames as a key video frame; and determines the test result of the application to be tested based on the difference between the timestamps of the two adjacent key video frames.

[0052] In a sixth aspect of the present invention, an application testing system is provided, the system comprising: a testing server and a testing terminal, wherein:

[0053] The test server is configured to send a test instruction for the application to be tested to the test terminal;

[0054] The test terminal is configured to, upon receiving the test instruction, send a display request for a test network resource to a service server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested, and obtain a video to be processed that includes the display interface of the application to be tested; wherein the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; and send a target video to the test server, wherein the target video is obtained based on the video to be processed;

[0055] The test server is also used to, when receiving the target video, obtain two adjacent video frames with different picture contents from the target video as transition video frames; select one video frame from the two adjacent transition video frames as a key video frame; and determine the test result of the application to be tested based on the difference between the timestamps of the two adjacent key video frames.

[0056] In another aspect of the present invention, an electronic device is provided, comprising a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0057] Memory for storing computer programs;

[0058] The processor is configured to implement the application testing method for testing a server as described in the second aspect, or the application testing method steps for testing a terminal as described in the third aspect, when executing the program stored in the memory.

[0059] In another aspect of the implementation of the present invention, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, it implements the application testing method applied to the test server described in the second aspect above, or the application testing method steps applied to the test terminal described in the third aspect above.

[0060] In another aspect of the implementation of the present invention, a computer program product containing instructions is also provided. When the computer is run on the computer, it enables the computer to execute the application testing method applied to the test server described in the second aspect above, or the application testing method applied to the test terminal described in the third aspect above.

[0061] The technical solution provided by the embodiment of the present invention is that the test server sends a test instruction for the application to be tested to the test terminal. When the test terminal receives the test instruction, it sends a display request for the test network resource to the business server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested, and obtains the video to be processed containing the display interface of the application to be tested; the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; and sends the target video obtained based on the video to be processed to the test server. When the test server receives the target video, it obtains two adjacent video frames with different picture contents from the target video as transition video frames; selects one video frame from the two adjacent transition video frames as a key video frame; and determines the test result of the application to be tested based on the difference in the timestamps of the two adjacent key video frames.

[0062] Based on the above processing, the video to be processed contains the display content of the display interface of the application to be tested during the process of the test application loading the network resources, and the target video also contains the display content of the display interface of the application to be tested during the process of the test application loading the network resources. The change of the screen content in the target video can represent: the change of the display content in the display interface when the application to be tested loads the network resources. Therefore, the test result of the application to be tested can be determined based on the transition video frames with different screen contents in the target video. In addition, the target video containing the display interface of the application to be tested can be automatically obtained through the test terminal, and the test result of the application to be tested can be determined based on the target video through the test server, that is, the target video is obtained online and processed, that is, the application is automatically tested without the need for manual frame division of the target video and the selection of key video frames from a large number of video frames through manual observation. This can reduce large labor costs and time costs and improve the testing efficiency of the application. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for describing the embodiments or the prior art.

[0064] Figure 1 A flowchart of an application testing method provided by an embodiment of the present invention;

[0065] Figure 2 A flowchart of another application testing method provided by an embodiment of the present invention;

[0066] Figure 3 A flowchart of another application testing method provided by an embodiment of the present invention;

[0067] Figure 4 A flowchart of another application testing method provided by an embodiment of the present invention;

[0068] Figure 5 A flowchart of another application testing method provided by an embodiment of the present invention;

[0069] Figure 6 A flowchart of another application testing method provided by an embodiment of the present invention;

[0070] Figure 7 A flowchart of another application testing method provided by an embodiment of the present invention;

[0071] Figure 8 A flowchart of another application testing method provided by an embodiment of the present invention;

[0072] Figure 9 An architectural diagram of another application testing system provided by an embodiment of the present invention;

[0073] Figure 10 A flowchart of another application testing method provided by an embodiment of the present invention;

[0074] Figure 11 A structural diagram of an application testing device provided by an embodiment of the present invention;

[0075] Figure 12 A structural diagram of another application testing device provided by an embodiment of the present invention;

[0076] Figure 13 A structural diagram of an electronic device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0077] The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention.

[0078] With the rapid development of internet technology, applications are providing increasingly rich functionality to users. During the application development process, testers are required to test these features and optimize them based on the test results. For example, they can test the latency of loading a video or switching pages.

[0079] Example 1:

[0080] In order to test an application, an embodiment of the present invention provides an application testing system, which may include: a test server and a test terminal, wherein:

[0081] The test server sends a test instruction for the application to be tested to the test terminal.

[0082] Upon receiving the test command, the test terminal sends a display request for the test network resources to the service server via the application under test. This request displays the test network resources on the application's display interface and retrieves a video to be processed that includes the application's display interface. The starting frame of the video to be processed represents the content displayed on the application's display interface when the test terminal receives the test command. The target video, derived from the video to be processed, is then sent to the test server.

[0083] When receiving the target video, the test server obtains two adjacent video frames with different picture contents from the target video as transition video frames; selects one video frame from the two adjacent transition video frames as the key video frame; and determines the test result of the application to be tested based on the difference between the timestamps of the two adjacent key video frames.

[0084] Based on the application testing system provided by the embodiment of the present invention, if the video to be processed contains the display content of the display interface of the application to be tested during the process of the test application loading network resources, then the target video also contains the display content of the display interface of the application to be tested during the process of the test application loading network resources. The change in the screen content in the target video can represent: the change in the display content of the display interface when the application to be tested loads network resources. Therefore, the test result of the application to be tested can be determined based on the transition video frames with different screen content in the target video. In addition, the target video containing the display interface of the application to be tested can be automatically obtained through the test terminal, and the test result of the application to be tested can be determined based on the target video by the test server, that is, the target video can be obtained online and processed, that is, the application can be automatically tested without the need for manual frame segmentation of the target video and manual observation to select key video frames from a large number of video frames. This can reduce large labor costs and time costs and improve the testing efficiency of the application.

[0085] For other embodiments of the above application testing system, please refer to the subsequent introduction of related methods regarding the testing server and the testing terminal.

[0086] Example 2:

[0087] See also Figure 1 , Figure 1 A flowchart of an application testing method provided in an embodiment of the present invention is provided. The method can be applied to a test server in the above-mentioned application testing system. The method may include the following steps:

[0088] S101: Send a test instruction for the application to be tested to the test terminal, so that when the test terminal receives the test instruction, it sends a display request for the test network resource to the business server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested, obtain the video to be processed including the display interface of the application to be tested, and send the target video to the test server.

[0089] The starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; the target video is obtained based on the video to be processed.

[0090] S102: When a target video is received, two adjacent video frames with different picture contents are obtained from the target video as transition video frames.

[0091] S103: Select a video frame from two adjacent transition video frames as a key video frame.

[0092] S104: Determine a test result of the application to be tested based on a difference between the timestamps of two adjacent key video frames.

[0093] Based on the application testing method provided by the embodiment of the present invention, if the video to be processed contains the display content of the display interface of the application to be tested during the process of the test application loading the network resources, then the target video also contains the display content of the display interface of the application to be tested during the process of the test application loading the network resources. The change of the screen content in the target video can represent: the change of the display content of the display interface when the application to be tested loads the network resources. Therefore, the test result of the application to be tested can be determined based on the transition video frames with different screen contents in the target video. In addition, the target video containing the display interface of the application to be tested can be automatically obtained through the test terminal, and the test result of the application to be tested can be determined based on the target video by the test server, that is, the online acquisition of the target video and the processing of the target video are realized, that is, the automatic testing of the application is realized, and there is no need to manually frame the target video and select key video frames from a large number of video frames through manual observation. This can reduce large labor costs and time costs and improve the testing efficiency of the application.

[0094] For step S101 , the application to be tested may be any application. When the application to be tested needs to be tested, for example, to test the delay of the application to be tested in loading network resources, a test instruction for the application to be tested may be input to the test server.

[0095] Example 3:

[0096] In an embodiment of the present invention, a test server can communicate with a configuration client (i.e., the client logged in by a tester), and the tester can input test instructions for the application to be tested into the configuration client. Upon receiving the test instructions, the configuration client can send the test instructions for the application to be tested to the test server. Upon receiving the test instructions, the test server can determine that the application to be tested currently needs to be tested and send the test instructions for the application to be tested to the test terminal.

[0097] Example 4:

[0098] The test terminal may have an application to be tested installed. Upon receiving a test instruction, the test terminal may directly send a display request for test network resources to the service server through the application to be tested, thereby displaying the test network resources on the display interface of the application to be tested. Accordingly, the test terminal may record the screen upon receiving the test instruction. Since the application to be tested is installed in the test terminal, the test terminal records the display content of the application to be tested during the process of the application to be tested requesting the test network resources, thereby obtaining a processed video containing the display interface of the application to be tested. The target video, derived from the processed video, is then sent to the test server.

[0099] Example 5:

[0100] If the test terminal does not support screen recording, it will not be able to capture the video to be processed, including the display interface of the application to be tested. Therefore, two test terminals can be set up: a first sub-test terminal and a second sub-test terminal in the embodiment of the present invention. The first sub-test terminal communicates with the test server, while the second sub-test terminal has the application to be tested installed. If the second sub-test terminal does not support screen recording, the first sub-test terminal can be used to capture the second sub-test terminal to capture the video to be processed, including the display interface of the application to be tested.

[0101] In one embodiment of the present invention, the first sub-test terminal may be a computer, and the second sub-test terminal may include at least one of: a mobile phone, a television, a box, and a computer.

[0102] For example, the first sub-test terminal may be a computer. The first sub-test terminal is equipped with an image acquisition device (e.g., a camera), which can capture the display interface of the second sub-test terminal. The second sub-test terminal may be a terminal that does not support the screen recording function, such as a TV or a box that does not support the screen recording function. Of course, it is understood that the second sub-test terminal may also be a terminal that supports the screen recording function, such as a mobile phone or a computer that supports the screen recording function.

[0103] The first sub-test terminal and the second sub-test terminal can access the same local area network through a router and communicate through the accessed local area network.

[0104] Example 6:

[0105] Accordingly, the test terminal may include: a first sub-test terminal and a second sub-test terminal, wherein the application to be tested is installed in the second sub-test terminal. Figure 1 Based on Figure 2 Before step S101, the method may further include the following steps:

[0106] S105: Receive test configuration information input by the user.

[0107] The test configuration information includes: application version number, terminal type identifier, and network environment information.

[0108] Accordingly, step S101 may include the following steps:

[0109] S1011: When the version number of the application to be tested is consistent with the application version number in the test configuration information, the type identifier of the second sub-test terminal is consistent with the terminal type identifier in the test configuration information, and the network environment information of the second sub-test terminal is consistent with the network environment information in the test configuration information, a test instruction for the application to be tested is sent to the first sub-test terminal, so that when the first sub-test terminal receives the test instruction, it sends a test instruction to the second sub-test terminal, so that the second sub-test terminal sends a display request for the test network resource to the business server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested, and obtains a video to be processed including the display interface of the application to be tested, and sends the target video to the test server.

[0110] In an embodiment of the present invention, a tester can input test configuration information into a configuration client to indicate the application currently to be tested. The configuration client can then send the test configuration information to a test server. The test server can then receive the test configuration information. The test configuration information includes the application version number, terminal type identifier, and network environment information.

[0111] The terminal type identifier can indicate at least one of the type of device on which the application to be tested is installed, the device version number, and the operating system on the device. Device types include computers, mobile phones, and televisions. Device operating systems can include Android and Windows.

[0112] The network environment information indicates the operator of the network to which the device on which the application to be tested is installed is connected.

[0113] For example, if a tester needs to test an application running on a telecommunications network and installed on a computer with version 1.0, the tester can enter the following test configuration information into the configuration client: version number: 1.0, terminal type identifier: computer, and network environment information: telecommunications network. The configuration client can then send this test configuration information to the test server.

[0114] Accordingly, after receiving the test configuration information, the test server can obtain the current configuration information of the application to be tested, which includes: the version number of the application to be tested, the type identifier of the second sub-test terminal, and the network environment information of the second sub-test terminal.

[0115] If the current configuration information of the application to be tested is consistent with the received test configuration information, that is, the version number of the application to be tested is consistent with the application version number in the test configuration information, the type identifier of the second sub-test terminal is consistent with the terminal type identifier in the test configuration information, and the network environment information of the second sub-test terminal is consistent with the network environment information in the test configuration information, indicating that the application to be tested is the application that needs to be tested as indicated by the tester, then the test server can send a test instruction for the application to be tested to the first sub-test terminal.

[0116] Accordingly, the first sub-test terminal can send the received test instruction to the second sub-test terminal. Upon receiving the test instruction, the second sub-test terminal can send a display request for the test network resources to the service server via the application under test, thereby displaying the test network resources on the display interface of the application under test and obtaining a video to be processed that includes the display interface of the application under test. The target video, derived from the video under test, can then be sent to the test server.

[0117] Based on the above processing, the application to be tested can be tested according to the test configuration information input by the tester, which can meet the personalized needs of the tester.

[0118] Example 7:

[0119] Before testing an application, the tester can also input a first installation instruction into the configuration client, instructing the configuration client to install the corresponding application on the test terminal and configure the environment for the installed application. The first installation instruction carries the identifier of the application to be installed, the terminal type identifier, and network environment information. Upon receiving the first installation instruction, the configuration client can send the first installation instruction to the test server.

[0120] When the test server receives the first installation instruction, it can obtain the application installation package to which the identifier of the application to be installed belongs, and send a second installation instruction carrying the application installation package, the terminal type identifier, and the network environment information to the test terminal.

[0121] When receiving the second installation instruction, if the type identifier of the test terminal is the same as the terminal type identifier carried in the second installation instruction, the test terminal can directly install the application currently to be installed and adjust the current network environment of the test terminal to the network environment indicated by the network environment information carried in the second installation instruction.

[0122] Example 8:

[0123] The test terminal includes a first sub-test terminal and a second sub-test terminal, where there are multiple second sub-test terminals. Upon receiving the second installation instruction, the first sub-test terminal identifies, from among the multiple second sub-test terminals, a second sub-test terminal whose type identifier is the same as the terminal type identifier carried in the second installation instruction, and sends the second installation instruction to the second sub-test terminal. Upon receiving the second installation instruction, the second sub-test terminal may install the application currently to be installed and adjust the current network environment of the second sub-test terminal to the network environment indicated by the network environment information carried in the second installation instruction.

[0124] Based on the above processing, the tester can instruct the second sub-test terminal to install the application and instruct the second sub-test terminal to configure the operating environment of the application. The applications in different second sub-test terminals can be configured with different operating environments. The test server can communicate with multiple second sub-test terminals through the first sub-test terminal, realize the sharing of multiple operating environments, and test the application according to the specified operating environment, which can improve the comprehensiveness of the testing of the application.

[0125] Regarding step S102, when the application under test loads the test network resource, the display content in the display interface of the application under test will change. For example, if the test network resource is a video (which can be called a test video), before the application under test requests the test video from the service server, the display interface of the application under test displays the to-be-played page of the test video. When the application under test requests the test video from the service server, the display interface of the application under test begins to display the loading page. When the test video is requested, the display interface of the application under test begins to display the test video.

[0126] Therefore, the target video includes a video frame representing the page to be played of the test video displayed in the display interface of the application to be tested (which can be called the first video frame), a video frame representing the loading page displayed in the display interface of the application to be tested (which can be called the second video frame), and a video frame representing the test video displayed in the display interface of the application to be tested (which can be called the third video frame).

[0127] When the target video switches from the last first video frame to the first second video frame, that is, when the display content in the display interface of the application to be tested switches from the to-be-played page of the test video to the loading page, it indicates that the application to be tested starts to load the test video. When the target video switches from the last second video frame to the first third video frame, that is, when the display content in the display interface of the application to be tested switches from the loading page to the test video, it indicates that the application to be tested has successfully loaded the test video.

[0128] Therefore, the duration from the moment the loading page begins to be displayed on the display interface of the application under test to the moment the first video frame of the test video begins to be displayed on the display interface of the application under test can represent the latency of the application under test loading the test video. In other words, the duration from the first second video frame to the first third video frame in the target video can represent the latency of the application under test loading the test video.

[0129] Therefore, when testing an application to be tested, it is necessary to determine the video frames whose picture content changes from the target video frames, so as to determine the delay of the application to be tested in loading network resources based on the determined video frames.

[0130] Accordingly, upon receiving the target video sent by the test terminal, the test server may perform image recognition on the target video, and determine two adjacent video frames with different picture contents from the target video as transition video frames.

[0131] If the image contents of two adjacent video frames in the target video are different, it means that the scene in the target video has changed when switching from the previous video frame to the next video frame. For example, with respect to the above embodiment, when the target video switches from the last first video frame to the first second video frame, the scene in the target video has changed, that is, the target video switches from displaying the to-be-played page of the test video in the display interface of the application to be tested to displaying the loading page in the display interface of the application to be tested. Therefore, the last first video frame and the first second video frame in the target video are two adjacent transition video frames. When the target video switches from the last second video frame to the first third video frame, the scene in the target video has changed, that is, the target video switches from displaying the loading page in the display interface of the application to be tested to displaying the test video in the display interface of the application to be tested. Therefore, the last second video frame and the first third video frame in the target video are two adjacent transition video frames.

[0132] Example 9:

[0133] Regarding step S103 , after determining the transition video frame, the test server may directly determine the latter video frame of the two adjacent transition video frames as the key video frame according to the order of the two adjacent transition video frames in the target video.

[0134] For example, with respect to the above embodiment, the last first video frame and the first second video frame in the target video are two adjacent transition video frames, and the test server can determine that the first second video frame is a key video frame, that is, the first video frame in the display interface representing the application to be tested in the target video that displays the loading page is a key video frame. The last second video frame and the first third video frame in the target video are two adjacent transition video frames, and the test server can determine that the first third video frame is a transition video frame, that is, the first video frame in the display interface representing the application to be tested in the target video that displays the test video is a key video frame. The key video frame representing the display interface of the application to be tested that displays the loading page and the key video frame representing the display interface of the application to be tested that displays the test video are two adjacent key video frames.

[0135] Example 10:

[0136] In order to improve the accuracy of the determined key video frames, Figure 1 Based on Figure 3 , step S103 may include the following steps:

[0137] S1031: Display two adjacent transition video frames.

[0138] S1032: When receiving a video frame selection instruction input by the user, determine the video frame indicated by the video frame selection instruction as a key video frame.

[0139] After determining each two adjacent transition video frames, the test server may send the two adjacent transition video frames to the configuration client. Accordingly, the configuration client may display the two adjacent transition video frames. The tester may browse the video frames displayed by the configuration client and select a key video frame from the two adjacent transition video frames. Upon receiving the video frame selection instruction, the configuration client may determine the video frame indicated by the video frame selection instruction and send the video frame selected by the tester to the test server.

[0140] Accordingly, after receiving the video frame sent by the configuration client, the test server can determine that the video frame selected by the tester is a key video frame.

[0141] For example, if the test network resource is a test video, the last video frame of the target video representing the page to be played of the test video on the display interface of the application to be tested and the first video frame of the target video representing the loading page on the display interface of the application to be tested are two adjacent transition video frames. The last video frame of the target video representing the loading page on the display interface of the application to be tested and the first video frame of the target video representing the test video on the display interface of the application to be tested are two adjacent transition video frames.

[0142] The configuration client can display each of the two adjacent transition video frames. The tester can click on the first video frame of the loading page displayed in the display interface representing the application to be tested, and the first video frame of the test video displayed in the display interface representing the application to be tested, to input a video frame selection instruction to the configuration client.

[0143] Upon receiving the video frame selection instruction, the configuration client can send the video frame selected by the tester to the test server. Accordingly, the test server can determine that the first video frame displaying the loading page on the display interface representing the application under test and the first video frame displaying the test video on the display interface representing the application under test are two adjacent key video frames.

[0144] In addition, since the test server performs image recognition, errors may occur, resulting in the determination of an erroneous transition video frame, that is, the determined video frame is not a video frame indicating a change in the display content of the display interface of the application to be tested.

[0145] When a tester browses the transition video frame displayed by the configuration client, if the configuration client displays an incorrect transition video frame, the tester can input a reselection instruction to the configuration client to instruct the configuration client to redefine the transition video frame. The configuration client can send the reselection instruction to the test server. In response, the test server can redefine the transition video frame of the target video.

[0146] Based on the above processing, the situation where the wrong key video frame is determined due to the wrong transition video frame can be avoided to a certain extent, the accuracy of the determined key video can be improved, and then the accuracy of the test results of the application to be tested can be improved.

[0147] Example 11:

[0148] In one embodiment of the present invention, to conserve storage space on the test server, after acquiring the video to be processed, the test terminal can compress each video frame in the video to be processed, generating a target video containing thumbnails of each frame, and then sending the target video to the test server. Accordingly, each frame in the target video received by the test server is a thumbnail. Compared to sending the video to be processed to the test server, the target video occupies less storage space, reducing network bandwidth usage during transmission, improving transmission efficiency of the video to the test server, and conserving storage space on the test server.

[0149] Regarding step S104, after determining the key video frame, the test server can also calculate the difference between the timestamps of two adjacent key videos to obtain the test result of the sequencing of the application to be tested, that is, the delay of the application to be tested in loading network resources.

[0150] Example 12:

[0151] The test network resource is a test video, and the test result of the application to be tested includes the delay of the application to be tested loading the video.

[0152] The test network resource is a test video, and the key video frames include: the first video frame of the target video that displays a loading page in the display interface of the application to be tested, and the first video frame of the target video that displays a test video in the display interface of the application to be tested.

[0153] The difference between the timestamps of two adjacent key videos represents: the duration from the moment when the loading page starts to be displayed on the display interface of the application to be tested to the moment when the first video frame in the test video starts to be displayed on the display interface of the application to be tested, that is, the delay of the video loading by the application to be tested.

[0154] Example 13:

[0155] The test network resource is a specified page, and the test result of the application to be tested includes the delay of the application to be tested switching to the specified page.

[0156] The test network resource is a specified page, and the key video frames include: the first video frame in the target video representing the display interface of the application to be tested that displays the loading page, and the first video frame in the target video representing the display interface of the application to be tested that displays the specified page.

[0157] The difference between the timestamps of two adjacent key videos represents: the duration from the moment when the loading page starts to be displayed in the display interface of the application under test to the moment when the specified page starts to be displayed in the display interface of the application under test, that is, the delay of the application under test loading the specified page.

[0158] For example, the designated page is a login success page. When the user needs to log in to the application to be tested with an account, the page to be logged in is displayed in the display interface of the application to be tested, and the user can enter login information (for example, login account and password) in the page to be logged in. Upon receiving the login information input by the user, the application to be tested requests the login success page from the business server, and at this time, the loading page begins to be displayed in the display interface of the application to be tested. When the application to be tested requests the login success page, the login success page begins to be displayed in the display interface of the application to be tested. Therefore, the duration from the moment when the loading page begins to be displayed in the display interface of the application to be tested to the moment when the login success page begins to be displayed in the display interface of the application to be tested is the time delay for the application to be tested to load the login success page.

[0159] Example 14:

[0160] In order to improve the accuracy of the determined test results, the test terminal can obtain multiple target videos and send the multiple target videos to the test server. Each target video contains the display content of the display interface of the application to be tested.

[0161] Accordingly, upon receiving multiple target videos, the test server determines, for each target video, the test result for the application under test corresponding to that target video based on the key video frames corresponding to that target video. The test server then calculates the average of the test results for the application under test corresponding to each of the multiple target videos and uses the calculated average as the test result for the application under test.

[0162] Example 15:

[0163] After calculating the test results of the application to be tested, the test server can also send the test results of the application to be tested to the configuration client. Correspondingly, the configuration client can display the received test results for the tester to browse.

[0164] Example 16:

[0165] After calculating the test results for the application under test, the test server can also store the test results locally. Subsequently, upon receiving a query request for the application under test from the tester via the configuration client, the test server sends the test results of the application under test to the configuration client. In response, the configuration client can display the received test results for the tester to view.

[0166] Example 17:

[0167] See also Figure 4 , Figure 4 A flowchart of another application testing method provided by an embodiment of the present invention, which can be applied to a test terminal in the above-mentioned application testing system, may include the following steps:

[0168] S401: When a test instruction for the application to be tested is received from the test server, a display request for the test network resource is sent to the service server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested.

[0169] S402: Obtain a video to be processed that includes a display interface of the application to be tested.

[0170] The starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction.

[0171] S403: Send a target video to the test server, where the target video is obtained based on the video to be processed, so that when the test server receives the target video, it obtains two adjacent video frames with different picture contents from the target video as transition video frames; selects one video frame from the two adjacent transition video frames as a key video frame; and determines the test result of the application to be tested based on the difference between the timestamps of the two adjacent key video frames.

[0172] Based on the application program testing method provided in the embodiments of the present application, in the process of loading network resources by the test application program, the display content in the display interface of the test application program in the to-be-processed video also contains the display content in the display interface of the test application program in the process of loading network resources by the test application program, and the change of the picture content in the target video can represent the change of the display content in the display interface of the test application program when loading network resources. Therefore, the test result of the test application program can be determined based on the transition video frames with different picture content in the target video. In addition, the target video containing the display interface of the test application program can be automatically obtained by the test terminal, and the test result of the test application program can be determined by the test server based on the target video, that is, the target video is obtained online, and the target video is processed, that is, the application program is automatically tested, and manual frame division and manual observation to select key video frames from a large number of video frames are not required, which can reduce the labor cost and time cost, and improve the testing efficiency of the application program.

[0173] For steps S401 and S402, when the test application program needs to be tested, the test server can send a test instruction for the test application program to the test terminal. The test terminal can be a computer, a mobile phone, etc. The specific processing mode of the test server can be referred to the related description of the foregoing embodiments.

[0174] Correspondingly, the test terminal can receive the test instruction.

[0175] Embodiment 18:

[0176] The test application program is installed in the test terminal, and the test terminal can directly send a display request for the test network resource to the business server through the test application program, so as to display the test network resource in the display interface of the test application program.

[0177] Correspondingly, when the test instruction is received, the test terminal can start recording the screen according to the preset frame rate. Since the test application program is installed in the test terminal, when the test terminal records the screen, that is, records the display content in the display interface of the test application program in the process of requesting the test network resource by the test application program, the to-be-processed video containing the display interface of the test application program is obtained.

[0178] The duration of the screen recording is a specified duration. The specified duration can be determined according to the information currently to be tested. For example, if the time delay of the test application program loading a video needs to be tested, the specified duration can be 5 seconds.

[0179] The preset frame rate indicates the number of video frames contained in each second of the video to be processed. The preset frame rate can be set by technicians based on experience. For example, the preset frame rate can be 30 frames / second, or the preset frame rate can also be 40 frames / second, but is not limited thereto.

[0180] Example 19:

[0181] If the test terminal does not support screen recording, it will not be able to capture the video to be processed, including the display interface of the application to be tested. Therefore, two test terminals can be set up: a first sub-test terminal and a second sub-test terminal in the embodiment of the present invention. The first sub-test terminal communicates with the test server, while the second sub-test terminal has the application to be tested installed. If the second sub-test terminal does not support screen recording, the first sub-test terminal can be used to capture the second sub-test terminal to capture the video to be processed, including the display interface of the application to be tested.

[0182] Accordingly, the test terminal may include: a first sub-test terminal and a second sub-test terminal, wherein the application to be tested is installed in the second sub-test terminal. Figure 4 Based on Figure 5 , step S401 may include the following steps:

[0183] S4011: Receive, via the first sub-test terminal, a test instruction for the application to be tested sent by the test server, and send the test instruction to the second sub-test terminal.

[0184] S4012: When receiving the test instruction, the second sub-test terminal sends a display request for the test network resource to the service server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested.

[0185] The first sub-test terminal and the second sub-test terminal can communicate with each other. For example, the first sub-test terminal and the second sub-test terminal can access the same local area network through a router and communicate with each other through the accessed local area network.

[0186] The first sub-test terminal is equipped with an image acquisition device (e.g., a camera) that can capture the display interface of the second sub-test terminal. The second sub-test terminal can be a terminal that does not support screen recording, such as a TV or a box that does not support screen recording. Of course, it is understood that the second sub-test terminal can also be a terminal that supports screen recording, such as a mobile phone or computer that supports screen recording.

[0187] If the second sub-test terminal supports screen recording, it can record the screen upon receiving the test instruction to obtain a video to be processed that includes the display interface of the application under test, and then send the video to the first sub-test terminal. The first sub-test terminal can then send a target video derived from the video to the test server.

[0188] When the second sub-test terminal does not support the screen recording function, when the first sub-test terminal receives the test instruction, the display interface of the second sub-test terminal can be photographed through the image acquisition device. The second sub-test terminal has the application to be tested installed in it, and the display interface of the second sub-test terminal is photographed. That is, the display content in the display interface of the test application is photographed during the process of the application to be tested requesting the test network resources, and a video to be processed containing the display interface of the application to be tested is obtained.

[0189] Example 20:

[0190] With respect to step S403 , the test terminal may directly use the video to be processed as the target video and send the target video to the test server.

[0191] Example 21:

[0192] exist Figure 4 Based on Figure 6 Before step S403, the method may further include the following steps:

[0193] S404: Divide the video to be processed into frames to obtain video frames contained in the video to be processed.

[0194] S405: Compress each video frame in the video to be processed to obtain a target video containing thumbnails of each video frame.

[0195] To improve transmission efficiency when sending videos to the test server and conserve storage space, after acquiring the video to be processed, the test terminal can segment the video into frames, obtaining the individual frames it contains. The test terminal can then compress each frame to obtain a thumbnail of the frame. This allows the target video to be generated, containing the thumbnails of each frame.

[0196] Furthermore, the target video can be sent to the test server. Compared with the video to be processed, the target video occupies less storage space, which can reduce the network bandwidth occupied during the transmission process, improve the transmission efficiency of sending the video to the test server, and save the storage space of the test server.

[0197] Accordingly, when the test server receives the target video, it can determine the test result of the application to be tested based on the received target video. The specific processing process of the test server can refer to the relevant introduction of the above embodiment.

[0198] Example 22:

[0199] See also Figure 7 , Figure 7 A flowchart of another application testing method provided by an embodiment of the present invention.

[0200] When testing the application under test is required, an online platform (the test server in the aforementioned embodiment) can be launched. Specifically, the tester can input device check instructions to the test server through the configuration client. Upon receiving the device check instruction, the test server can determine whether the device is online—that is, whether a communication connection is currently established with the test terminal. If a communication connection is not currently established with the test terminal, the test server can send a request message to the test terminal to establish a communication connection. Correspondingly, upon receiving the request message, the test terminal can send a response message to the test server to establish a communication connection with the test server. Subsequently, the test server can perform environmental configuration / checks.

[0201] If a communication connection has been established with the test terminal, the test server can perform environment configuration, that is, the test server can receive a first installation instruction sent by the tester through the configuration client, and send a second installation instruction to the test terminal based on the first installation instruction, so that the test terminal installs the corresponding application according to the second installation instruction and configures the application.

[0202] Then, the test server can perform an environment check, that is, the test server can receive the test configuration information entered by the tester through the configuration client and obtain the current configuration information of the application to be tested. The test terminal can periodically report the status to the test server, that is, report the current configuration information of the application to be tested to the test server.

[0203] When the test configuration information is consistent with the current configuration information of the application to be tested, the test service sends a collection task to the test terminal, that is, the test server sends a test instruction for the application to be tested to the test terminal.

[0204] Correspondingly, when the test terminal receives the test instruction, it can send a display request for the test network resources to the business server through the application to be tested, so as to display the test network resources in the display interface of the application to be tested and collect video frames, that is, obtain the processed video including the display interface of the application to be tested.

[0205] The test terminal can then segment the video to be processed into frames, obtaining the frames it contains. Once the automatic frame capture and segmentation are complete, the test terminal can compress the frames, compressing each frame to obtain a target video containing thumbnails of each frame, and then send the target video to the test server.

[0206] Accordingly, upon receiving the target video, the test server can perform online verification and summary of the results. Specifically, the test server can retrieve two adjacent video frames with different content from the target video as transition video frames. The two adjacent transition video frames are displayed, and upon receiving a video frame selection instruction from the tester, the video frame indicated by the video frame selection instruction is determined as the key video frame. The test result for the application under test is determined based on the difference in the timestamps of the two adjacent key video frames.

[0207] Based on the application testing method provided by the embodiment of the present invention, if the video to be processed contains the display content of the display interface of the application to be tested during the process of the test application loading the network resources, then the target video also contains the display content of the display interface of the application to be tested during the process of the test application loading the network resources. The change of the screen content in the target video can represent: the change of the display content of the display interface when the application to be tested loads the network resources. Therefore, the test result of the application to be tested can be determined based on the transition video frames with different screen contents in the target video. In addition, the target video containing the display interface of the application to be tested can be automatically obtained through the test terminal, and the test result of the application to be tested can be determined based on the target video by the test server, that is, the online acquisition of the target video and the processing of the target video are realized, that is, the automatic testing of the application is realized, and there is no need to manually frame the target video and select key video frames from a large number of video frames through manual observation. This can reduce large labor costs and time costs and improve the testing efficiency of the application.

[0208] Example 23:

[0209] See also Figure 8 , Figure 8A flowchart of another application testing method provided in an embodiment of the present invention. The application testing method is applied to an application testing system, which includes: a browser (web browser), a server (Server), a client (TV performance), and a box / TV. The client and the box / TV are connected to the network via a router. The browser is the configuration client in the aforementioned embodiment. The server is the test server in the aforementioned embodiment. The client is the first sub-test terminal in the aforementioned embodiment. The box / TV is the second sub-test terminal in the aforementioned embodiment.

[0210] Before testing an application, the tester can configure the application environment using a configuration client. Specifically, the tester enters a first installation instruction into the configuration client. The first installation instruction carries the identifier of the application to be installed, the terminal type identifier, and network environment information. Upon receiving the first installation instruction, the configuration client sends the first installation instruction to the test server. Upon receiving the first installation instruction, the test server obtains the application installation package containing the identifier of the application to be installed and sends a second installation instruction to the first sub-test terminal, carrying the application installation package, the terminal type identifier, and the network environment information.

[0211] Upon receiving the second installation instruction, the first sub-test terminal identifies, from among the plurality of second sub-test terminals, a second sub-test terminal whose type identifier is the same as the terminal type identifier carried in the second installation instruction, and sends the second installation instruction to the second sub-test terminal. Upon receiving the second installation instruction, the second sub-test terminal may install the application to be installed and adjust the current network environment of the second sub-test terminal to the network environment indicated by the network environment information carried in the second installation instruction.

[0212] The tester can then perform a checklist check using the configuration client. The test server receives the test configuration information entered by the tester through the configuration client and retrieves the current configuration information of the application under test. The current configuration of the application under test is periodically reported to the test server by the first sub-test terminal. When the test configuration information matches the current configuration information of the application under test, the test service issues a collection task to the first sub-test terminal. The test server sends test instructions specific to the application under test to the first sub-test terminal.

[0213] Correspondingly, when the first sub-test terminal receives the test instruction, it sends the test instruction to the second sub-test terminal. The second sub-test terminal can send a display request for the test network resources to the business server through the application to be tested, so as to display the test network resources in the display interface of the application to be tested and collect video frames.

[0214] If the second sub-test terminal is a box, the first sub-test terminal can obtain the video to be processed, including the display interface of the application to be tested, from the second sub-test terminal using a capture card. If the second sub-test terminal is a mobile phone, upon receiving the test instruction, the second sub-test terminal can record the screen to obtain the video to be processed, including the display interface of the application to be tested, and then send the video to the first sub-test terminal.

[0215] If the second sub-test terminal is a television, the first sub-test terminal may shoot the second sub-test terminal upon receiving the test instruction to record a to-be-processed video including the display interface of the application to be tested.

[0216] Then, the first sub-test terminal can report data to the test server, that is, the first sub-test terminal sends the target video obtained based on the video to be processed to the test server. Accordingly, the test server can perform online confirmation and summary when receiving the target video, that is, the test server can obtain two adjacent video frames with different picture content from the target video as transition video frames, and send the transition video frames to the configuration client. The configuration client can display two adjacent transition video frames, and when receiving the video frame selection instruction input by the tester, determine the video frame indicated by the video frame selection instruction as the key video frame. Based on the difference in the timestamps of the two adjacent key video frames, the test result of the application to be tested is determined.

[0217] After calculating the test results of the application to be tested, the test server can also store the test results of the application to be tested in a database. In addition, the test server can generate a test report based on the test results of the application to be tested and send an email containing the test report to the client where the tester logs in to the mailbox.

[0218] After calculating the test results of the application to be tested, the test server can also send the test results of the application to be tested to the configuration client. Correspondingly, the configuration client can display the received test results for the tester to browse.

[0219] Based on the application testing method provided by the embodiment of the present invention, if the video to be processed contains the display content of the display interface of the application to be tested during the process of the test application loading the network resources, then the target video also contains the display content of the display interface of the application to be tested during the process of the test application loading the network resources. The change of the screen content in the target video can represent: the change of the display content of the display interface when the application to be tested loads the network resources. Therefore, the test result of the application to be tested can be determined based on the transition video frames with different screen contents in the target video. In addition, the target video containing the display interface of the application to be tested can be automatically obtained through the test terminal, and the test result of the application to be tested can be determined based on the target video by the test server, that is, the online acquisition of the target video and the processing of the target video are realized, that is, the automatic testing of the application is realized, and there is no need to manually frame the target video and select key video frames from a large number of video frames through manual observation. This can reduce large labor costs and time costs and improve the testing efficiency of the application.

[0220] Example 24:

[0221] See also Figure 9 , Figure 9 This is an architectural diagram of an application testing system provided in an embodiment of the present invention. The application testing system includes a user layer, a service layer, a storage layer, and an operating system. The service layer and the storage layer both represent the test server described in the aforementioned embodiment. The operating system is the operating system of the test terminal described in the aforementioned embodiment, for example, Linux CentOS (a computer operating system).

[0222] The user layer includes an online platform web browser and a capture device. The online platform web browser is the configuration client in the aforementioned embodiment, and is used to receive the first installation instructions and test configuration information input by the tester. The configuration client is also used to display transitional video frames and test results of the application under test. The capture device is the image capture device of the first sub-test terminal in the aforementioned embodiment, and is used to capture the video to be processed, including the display interface of the application under test.

[0223] The service layer includes a presentation layer, a business layer, and a data access layer. The presentation layer is used to convert data formats, for example, converting data from a storage format to a display format. The business layer is used to execute the application testing method described in the preceding embodiments. The data access layer is used to retrieve database / cached data, for example, to obtain test results of the application under test stored in the database.

[0224] The storage layer includes a database and a cache, both of which are used to store data, for example, the test results of the application to be tested and the target video sent by the test terminal.

[0225] Example 25:

[0226] See also Figure 10 , Figure 10 A flowchart of another application testing method provided by an embodiment of the present invention is provided. The method is applied to an application testing system. The application system includes: a test server and a test terminal. The method may include the following steps:

[0227] S1001: The test server sends a test instruction for the application to be tested to the test terminal.

[0228] S1002: When receiving the test instruction, the test terminal sends a display request for the test network resource to the service server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested.

[0229] S1003: The test terminal obtains a video to be processed including a display interface of the application to be tested; wherein the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction.

[0230] S1004: The test terminal sends a target video obtained based on the video to be processed to the test server.

[0231] S1005: When receiving the target video, the test server obtains two adjacent video frames with different picture contents from the target video as transition video frames.

[0232] S1006: The test server selects a video frame from two adjacent transition video frames as a key video frame.

[0233] S1007: The test server determines a test result of the application to be tested based on a difference between the timestamps of two adjacent key video frames.

[0234] Based on the application program testing method provided by the embodiment of the application, the display content in the display interface of the to-be-tested application program in the process of loading network resources by the to-be-tested application program is contained in the to-be-processed video, and the display content in the display interface of the to-be-tested application program in the process of loading network resources by the to-be-tested application program is also contained in the target video. The change of the picture content in the target video can represent the change of the display content in the display interface of the to-be-tested application program when the to-be-tested application program loads network resources. Therefore, the test result of the to-be-tested application program can be determined based on the transition video frames with different picture contents in the target video. In addition, the target video containing the display interface of the to-be-tested application program can be automatically acquired by the test terminal, and the test result of the to-be-tested application program can be determined by the test server based on the target video, that is, the target video is acquired online, and the target video is processed, that is, the application program is automatically tested, without manually framing the target video and manually observing and selecting the key video frames from a large number of video frames, so that the labor cost and time cost can be greatly reduced, and the test efficiency of the application program can be improved.

[0235] With Figure 1 corresponding to the method embodiment of the application, refer to Figure 11 , Figure 11 The structure diagram of an application program testing device provided by the embodiment of the application is shown in FIG. 11. The device is applied to a test server, and the device comprises:

[0236] The sending module 1101 is configured to send a test instruction for a to-be-tested application program to a test terminal, so that the test terminal sends a display request for a test network resource to a service server through the to-be-tested application program to display the test network resource in a display interface of the to-be-tested application program and acquires a to-be-processed video containing the display interface of the to-be-tested application program to a target video when the test instruction is received. The starting frame of the to-be-processed video represents the display content in the display interface of the to-be-tested application program when the test instruction is received by the test terminal. The target video is obtained based on the to-be-processed video.

[0237] The acquiring module 1102 is configured to acquire two video frames with adjacent and different picture contents from the target video as transition video frames when the target video is received.

[0238] The selecting module 1103 is configured to select one video frame from the two adjacent transition video frames as a key video frame.

[0239] The determining module 1104 is configured to determine the test result of the to-be-tested application program based on the difference between the time stamps of the two adjacent key video frames.

[0240] Optionally, the test terminal includes: a first sub-test terminal and a second sub-test terminal, wherein the application to be tested is installed in the second sub-test terminal;

[0241] The device further comprises:

[0242] A receiving module, configured to receive test configuration information input by a user before the sending module 1101 executes the sending of a test instruction for the application to be tested to the test terminal; wherein the test configuration information includes: an application version number, a terminal type identifier, and network environment information;

[0243] The sending module 1101 is specifically configured to send a test instruction for the application to be tested to the first sub-test terminal when the version number of the application to be tested is consistent with the application version number in the test configuration information, the type identifier of the second sub-test terminal is consistent with the terminal type identifier in the test configuration information, and the network environment information of the second sub-test terminal is consistent with the network environment information in the test configuration information, so that when the first sub-test terminal receives the test instruction, it sends the test instruction to the second sub-test terminal, so that the second sub-test terminal sends a display request for the test network resource to the business server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested.

[0244] Optionally, the target video includes a thumbnail of each video frame in the video to be processed;

[0245] The selection module 1103 is specifically configured to display two adjacent transition video frames; upon receiving a video frame selection instruction input by a user, determine the video frame indicated by the video frame selection instruction as a key video frame.

[0246] Optionally, the test network resource is a video, and the test result of the application to be tested includes a delay of the application to be tested loading the video;

[0247] or,

[0248] The test network resource is a designated page, and the test result of the application to be tested includes a delay for the application to be tested to switch to the designated page.

[0249] Based on the application program testing device provided by the embodiment of the application, the display content in the display interface of the to-be-tested application program in the process of loading network resources by the to-be-tested application program in the to-be-processed video, and the display content in the display interface of the to-be-tested application program in the process of loading network resources by the to-be-tested application program in the target video are contained in the target video. Changes in the picture content in the target video can represent changes in the display content in the display interface of the to-be-tested application program when the to-be-tested application program loads network resources. Therefore, the test result of the to-be-tested application program can be determined based on the transition video frames with different picture content in the target video. In addition, the target video containing the display interface of the to-be-tested application program can be automatically obtained by the test terminal, and the test result of the to-be-tested application program can be determined by the test server based on the target video, that is, the target video is obtained online, and the target video is processed, that is, the application program is automatically tested, without manually framing the target video and manually observing and selecting key video frames from a large number of video frames, so that the labor cost and time cost can be greatly reduced, and the test efficiency of the application program can be improved.

[0250] With Figure 4 corresponding to the method embodiment of the application, refer to Figure 12 , Figure 12 a structure diagram of an application program testing device provided by the embodiment of the application, the device is applied to a test terminal, and the device comprises:

[0251] The request module 1201 is configured to, when receiving the test instruction for the to-be-tested application program sent by the test server, send a display request for a test network resource to a service server through the to-be-tested application program, so that the test network resource is displayed in the display interface of the to-be-tested application program.

[0252] The acquisition module 1202 is configured to acquire a to-be-processed video containing the display interface of the to-be-tested application program. The starting frame of the to-be-processed video represents the display content in the display interface of the to-be-tested application program when the test terminal receives the test instruction.

[0253] The sending module 1203 is configured to send a target video to the test server, the target video is obtained based on the to-be-processed video, so that, when receiving the target video, the test server acquires two video frames adjacent to each other and different in picture content from the target video as transition video frames, selects one video frame from the two adjacent transition video frames as a key video frame, and determines the test result of the to-be-tested application program based on the difference between the time stamps of the two adjacent key video frames.

[0254] Optionally, the test terminal includes: a first sub-test terminal and a second sub-test terminal, wherein the application to be tested is installed in the second sub-test terminal;

[0255] The request module 1201 is specifically configured to receive, through the first sub-test terminal, a test instruction for the application to be tested sent by the test server, and send the test instruction to the second sub-test terminal; upon receiving the test instruction, the second sub-test terminal sends a display request for the test network resource to the business server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested.

[0256] Optionally, the acquisition module 1202 is specifically configured to record the screen via the second sub-test terminal upon receiving the test instruction, so as to obtain a video to be processed including the display interface of the application to be tested;

[0257] or,

[0258] The first sub-test terminal is used to shoot the second sub-test terminal when the test instruction is received, so as to obtain a to-be-processed video including the display interface of the application to be tested.

[0259] Optionally, the device further includes:

[0260] A framing module, configured to perform framing on the video to be processed to obtain video frames contained in the video to be processed before the sending module 1203 sends the target video to the test server;

[0261] The compression module is used to compress each video frame in the video to be processed to obtain a target video containing thumbnails of each video frame.

[0262] Based on the application testing device provided by the embodiment of the present invention, if the video to be processed contains the display content of the display interface of the application to be tested during the process of the test application loading the network resources, then the target video also contains the display content of the display interface of the application to be tested during the process of the test application loading the network resources. The change of the screen content in the target video can represent: the change of the display content of the display interface when the application to be tested loads the network resources. Therefore, the test result of the application to be tested can be determined based on the transition video frames with different screen contents in the target video. In addition, the target video containing the display interface of the application to be tested can be automatically obtained through the test terminal, and the test result of the application to be tested can be determined based on the target video by the test server, that is, the online acquisition of the target video and the processing of the target video are realized, that is, the automatic testing of the application is realized, and there is no need to manually frame the target video and select key video frames from a large number of video frames through manual observation. This can reduce large labor costs and time costs and improve the testing efficiency of the application.

[0263] The embodiment of the present invention further provides an electronic device, such as Figure 13 As shown, it includes a processor 1301, a communication interface 1302, a memory 1303 and a communication bus 1304, wherein the processor 1301, the communication interface 1302, and the memory 1303 communicate with each other through the communication bus 1304.

[0264] Memory 1303, used for storing computer programs;

[0265] The processor 1301 is configured to implement the application testing method applied to the server test in the above embodiment, or the application testing method steps applied to the terminal test in the above embodiment, when executing the program stored in the memory 1303 .

[0266] The communication bus mentioned in the electronic device mentioned above may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. This communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is used in the figure, but this does not mean that there is only one bus or only one type of bus.

[0267] The communication interface is used for communication between the above electronic device and other devices.

[0268] The memory may include random access memory (RAM) or non-volatile memory, such as at least one disk storage. Alternatively, the memory may be at least one storage device located away from the processor.

[0269] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0270] In another embodiment provided by the present invention, a computer-readable storage medium is also provided, which stores a computer program. When the computer program is executed by a processor, it implements the application testing method applied to the test server in the above embodiment, or the application testing method applied to the test terminal in the above embodiment.

[0271] In another embodiment provided by the present invention, a computer program product containing instructions is also provided. When the computer is run on the computer, the computer executes the application testing method applied to the test server in the above embodiment, or the application testing method applied to the test terminal in the above embodiment.

[0272] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0273] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0274] Each embodiment in this specification is described in a related manner. Similar portions between embodiments can be referenced to each other. Each embodiment focuses on the differences between other embodiments. In particular, since the apparatus, system, device, computer-readable storage medium, and computer program product embodiments are generally similar to the method embodiments, their descriptions are relatively simplified. For related portions, reference can be made to the descriptions of the method embodiments.

[0275] The above description is only a preferred embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention are included in the scope of protection of the present invention.

Claims

1. An application testing method, characterized in that: The method is applied to an application testing system, the system comprising: a test server and a test terminal, the test terminal comprising: a first sub-test terminal and a second sub-test terminal, the method comprising: The test server receives test configuration information input by a user, wherein the test configuration information includes: an application version number, a terminal type identifier, and network environment information, wherein the network environment information indicates the operator of the network to which the device on which the application to be tested is installed is connected; and sends a second installation instruction to the first sub-test terminal, wherein the second installation instruction includes: an application installation package, the terminal type identifier, and the network environment information. The first sub-test terminal sends the second installation instruction to the second sub-test terminal identified by the terminal type; Upon receiving the second installation instruction, the second sub-test terminal installs the application to be tested and adjusts its current network environment to the network environment indicated by the network environment information carried in the second installation instruction; The test server periodically receives current configuration information of the application to be tested, the current configuration information including: a version number of the application to be tested, a type identifier of the second sub-test terminal, and network environment information of the second sub-test terminal; The test server sends a test instruction for the application to be tested to the first sub-test terminal when the version number of the application to be tested is consistent with the application version number in the test configuration information, the type identifier of the second sub-test terminal is consistent with the terminal type identifier in the test configuration information, and the network environment information of the second sub-test terminal is consistent with the network environment information in the test configuration information; When receiving the test instruction, the first sub-test terminal sends the test instruction to the second sub-test terminal; The second sub-test terminal sends a display request for the test network resource to the service server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested.

2. The method according to claim 1, characterized in that The method further comprises: The test terminal obtains a video to be processed that includes the display interface of the application to be tested; wherein the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; and sends a target video to the test server, wherein the target video is obtained based on the video to be processed; When receiving the target video, the test server obtains two adjacent video frames with different screen contents from the target video as transition video frames; selects one video frame from the two adjacent transition video frames as a key video frame; and determines the test result of the application to be tested based on the difference in timestamps of the two adjacent key video frames, wherein the target video includes: a first video frame, a second video frame, and a third video frame, the first video frame is a video frame representing a page to be played of a network resource displayed in a display interface of the application to be tested, the second video frame is a video frame representing a loading page displayed in the display interface of the application to be tested, and the third video frame is a video frame representing a network resource displayed in the display interface of the application to be tested; the last first video frame and the first second video frame in the target video are two adjacent transition video frames, and the last second video frame and the first third video frame in the target video are two adjacent transition video frames, and the test result includes: the delay of the application to be tested in loading the network resource.

3. An application testing method, characterized in that: The method is applied to a test server, wherein the test terminal includes: a first sub-test terminal and a second sub-test terminal, wherein the second sub-test terminal has an application to be tested installed therein, and the method includes: Receive test configuration information input by the user; wherein the test configuration information includes: application version number, terminal type identifier, and network environment information, the network environment information indicating the operator of the network to which the device on which the application to be tested is installed is connected; Sending a second installation instruction to the first sub-test terminal, the second installation instruction including: an application installation package, the terminal type identifier, and the network environment information, so that the first sub-test terminal sends the second installation instruction to a second sub-test terminal identified by the terminal type, and the second sub-test terminal, upon receiving the second installation instruction, installs the application to be tested and adjusts its current network environment to the network environment indicated by the network environment information carried in the second installation instruction; Periodically receiving current configuration information of the application to be tested, the current configuration information including: a version number of the application to be tested, a type identifier of the second sub-test terminal, and network environment information of the second sub-test terminal; When the version number of the application to be tested is consistent with the application version number in the test configuration information, the type identifier of the second sub-test terminal is consistent with the terminal type identifier in the test configuration information, and the network environment information of the second sub-test terminal is consistent with the network environment information in the test configuration information, a test instruction for the application to be tested is sent to the first sub-test terminal, so that when the first sub-test terminal receives the test instruction, it sends the test instruction to the second sub-test terminal, so that the second sub-test terminal sends a display request for the test network resource to the business server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested.

4. The method according to claim 3, characterized in that The method further comprises: Upon receiving the target video sent by the test terminal, two adjacent video frames with different screen contents are obtained from the target video as transition video frames; wherein, the target video is obtained based on the to-be-processed video including the display interface of the application to be tested obtained by the test terminal; the starting frame of the to-be-processed video represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; the target video comprises: a first video frame, a second video frame and a third video frame, the first video frame being a video frame representing a to-be-played page of a network resource displayed in the display interface of the application to be tested, the second video frame being a video frame representing a loading page displayed in the display interface of the application to be tested, the third video frame being a video frame representing a network resource displayed in the display interface of the application to be tested, the last first video frame and the first second video frame in the target video being two adjacent transition video frames, and the last second video frame and the first third video frame in the target video being two adjacent transition video frames; Selecting a video frame from two adjacent transition video frames as a key video frame; Based on the difference between the timestamps of two adjacent key video frames, a test result of the application to be tested is determined, where the test result includes a delay in loading network resources by the application to be tested.

5. The method according to claim 3, characterized in that The first sub-test terminal is a computer, and the second sub-test terminal includes at least one of a mobile phone, a television, a box, and a computer.

6. The method according to claim 4, characterized in that The target video includes a thumbnail of each video frame in the video to be processed; The step of selecting a video frame from two adjacent transition video frames as a key video frame includes: Display two adjacent transition video frames; When a video frame selection instruction input by a user is received, the video frame indicated by the video frame selection instruction is determined as a key video frame.

7. The method according to claim 3, characterized in that The test network resource is a video, and the test result of the application to be tested includes a delay of the application to be tested loading the video; or, The test network resource is a designated page, and the test result of the application to be tested includes a delay for the application to be tested to switch to the designated page.

8. An application testing method, characterized in that: The method is applied to a test terminal, the test terminal including: a first sub-test terminal and a second sub-test terminal, wherein the second sub-test terminal has an application to be tested installed therein; the method includes: receiving, through the first sub-test terminal, a second installation instruction sent by the test server, the second installation instruction including: an application installation package, a terminal type identifier, and network environment information, the network environment information indicating the operator of the network to which the device on which the application to be tested is installed belongs; sending the second installation instruction to the second sub-test terminal identified by the terminal type through the first sub-test terminal; Upon receiving the second installation instruction, the second sub-test terminal installs the application to be tested and adjusts its current network environment to the network environment indicated by the network environment information carried in the second installation instruction; Periodically sending, via the test terminal, current configuration information of the application to be tested to the test server, the current configuration information including: a version number of the application to be tested, a type identifier of the second sub-test terminal, and network environment information of the second sub-test terminal; Receiving, through the first sub-test terminal, a test instruction for the application to be tested sent by the test server, and sending the test instruction to the second sub-test terminal, the test instruction being an instruction sent by the test server when the version number of the application to be tested is consistent with the application version number in the test configuration information input by the user, the type identifier of the second sub-test terminal is consistent with the terminal type identifier in the test configuration information, and the network environment information of the second sub-test terminal is consistent with the network environment information in the test configuration information; When the second sub-test terminal receives the test instruction, it sends a display request for the test network resource to the service server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested.

9. The method according to claim 8, characterized in that The method further comprises: Acquire a video to be processed that includes the display interface of the application to be tested; wherein the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; A target video is sent to the test server, where the target video is obtained based on the video to be processed, so that when the test server receives the target video, it obtains two adjacent video frames with different screen contents from the target video as transition video frames; selects one video frame from the two adjacent transition video frames as a key video frame; and determines a test result of the application to be tested based on a difference in timestamps between the two adjacent key video frames, wherein the target video includes: a first video frame, a second video frame, and a third video frame; the first video frame is a video frame representing a to-be-played page of a network resource displayed in a display interface of the application to be tested; the second video frame is a video frame representing a loading page displayed in the display interface of the application to be tested; and the third video frame is a video frame representing a network resource displayed in the display interface of the application to be tested; the last first video frame and the first second video frame in the target video are two adjacent transition video frames, and the last second video frame and the first third video frame in the target video are two adjacent transition video frames. The test result includes: a delay in loading the network resource by the application to be tested.

10. The method according to claim 9, characterized in that The step of obtaining a video to be processed that includes a display interface of the application to be tested includes: Recording the screen when receiving the test instruction via the second sub-test terminal to obtain a video to be processed including the display interface of the application to be tested; or, The first sub-test terminal is used to shoot the second sub-test terminal when the test instruction is received, so as to obtain a to-be-processed video including the display interface of the application to be tested.

11. The method according to claim 9, characterized in that Before sending the target video to the test server, the method further includes: Dividing the video to be processed into frames to obtain video frames contained in the video to be processed; Each video frame in the video to be processed is compressed to obtain a target video containing thumbnails of each video frame.

12. An application testing device, characterized in that: The device is applied to a test server, and the test terminal includes: a first sub-test terminal and a second sub-test terminal, wherein the second sub-test terminal is installed with an application to be tested; the device includes: A receiving module, configured to receive test configuration information input by a user before sending a test instruction for the application to be tested to the test terminal; wherein the test configuration information includes: an application version number, a terminal type identifier, and network environment information, wherein the network environment information indicates the operator of the network to which the device on which the application to be tested is installed belongs; a sending module, configured to send a second installation instruction to the first sub-test terminal, the second installation instruction including: an application installation package, the terminal type identifier, and the network environment information, so that the first sub-test terminal sends the second installation instruction to a second sub-test terminal identified by the terminal type identifier, and the second sub-test terminal, upon receiving the second installation instruction, installs the application to be tested and adjusts its current network environment to the network environment indicated by the network environment information carried in the second installation instruction; The receiving module is further configured to periodically receive current configuration information of the application to be tested, the current configuration information including: a version number of the application to be tested, a type identifier of the second sub-test terminal, and network environment information of the second sub-test terminal; The sending module is further configured to send a test instruction for the application to be tested to the first sub-test terminal when the version number of the application to be tested is consistent with the application version number in the test configuration information, the type identifier of the second sub-test terminal is consistent with the terminal type identifier in the test configuration information, and the network environment information of the second sub-test terminal is consistent with the network environment information in the test configuration information, so that when the first sub-test terminal receives the test instruction, it sends the test instruction to the second sub-test terminal, so that the second sub-test terminal sends a display request for the test network resource to the business server through the application to be tested, so as to display the test network resource in the display interface of the application to be tested.

13. The device according to claim 12, characterized in that The device further comprises: An acquisition module is used to, when receiving a target video sent by the test terminal, acquire two adjacent video frames with different screen contents from the target video as transition video frames, wherein the target video is obtained based on the to-be-processed video including the display interface of the application to be tested acquired by the test terminal; the starting frame of the to-be-processed video represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; the target video comprises: a first video frame, a second video frame and a third video frame, the first video frame being a video frame representing a page to be played of a network resource displayed in the display interface of the application to be tested, the second video frame being a video frame representing a loading page displayed in the display interface of the application to be tested, the third video frame being a video frame representing a network resource displayed in the display interface of the application to be tested, the last first video frame and the first second video frame in the target video being two adjacent transition video frames, and the last second video frame and the first third video frame in the target video being two adjacent transition video frames; A selection module is used to select a video frame from two adjacent transition video frames as a key video frame; The determination module is configured to determine a test result of the application to be tested based on a difference between timestamps of two adjacent key video frames, wherein the test result includes a delay in loading network resources by the application to be tested.

14. An application testing device, characterized in that: The device is applied to a test terminal, the test terminal including: a first sub-test terminal and a second sub-test terminal, wherein the second sub-test terminal is installed with an application to be tested; the device includes: a receiving module configured to, before receiving the test instruction, receive, through the first sub-test terminal, a second installation instruction sent by the test server, the second installation instruction including: an application installation package, a terminal type identifier, and network environment information, the network environment information indicating the operator of the network to which the device on which the application to be tested is installed belongs; A sending module, configured to send the second installation instruction to the second sub-test terminal identified by the terminal type through the first sub-test terminal; an adjustment module, configured to install the application to be tested and adjust its current network environment to the network environment indicated by the network environment information carried in the second installation instruction via the second sub-test terminal upon receiving the second installation instruction; The sending module is further configured to periodically send current configuration information of the application to be tested to the test server through the test terminal, the current configuration information including: a version number of the application to be tested, a type identifier of the second sub-test terminal, and network environment information of the second sub-test terminal; a request module, configured to receive, through the first sub-test terminal, a test instruction for an application to be tested sent by a test server, and send the test instruction to the second sub-test terminal, wherein the test instruction is an instruction sent by the test server when the version number of the application to be tested is consistent with the application version number in the test configuration information input by the user, the type identifier of the second sub-test terminal is consistent with the terminal type identifier in the test configuration information, and the network environment information of the second sub-test terminal is consistent with the network environment information in the test configuration information; The request module is further configured to send a display request for the test network resource to the service server through the application to be tested upon receiving the test instruction through the second sub-test terminal, so as to display the test network resource in the display interface of the application to be tested.

15. The device according to claim 14, characterized in that The device further comprises: An acquisition module is configured to acquire a video to be processed that includes a display interface of the application to be tested; wherein the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; The sending module is further configured to send a target video to the test server, where the target video is obtained based on the video to be processed, so that when the test server receives the target video, it obtains two adjacent video frames with different screen contents from the target video as transition video frames; selects one video frame from the two adjacent transition video frames as a key video frame; and determines a test result of the application to be tested based on a difference in timestamps between the two adjacent key video frames. The target video includes: a first video frame, a second video frame, and a third video frame; the first video frame is a video frame representing a page to be played of a network resource displayed in a display interface of the application to be tested; the second video frame is a video frame representing a loading page displayed in the display interface of the application to be tested; and the third video frame is a video frame representing a network resource displayed in the display interface of the application to be tested; the last first video frame and the first second video frame in the target video are two adjacent transition video frames, and the last second video frame and the first third video frame in the target video are two adjacent transition video frames. The test result includes: a delay in loading network resources for the application to be tested.

16. An application testing system, characterized in that: The system includes: a test server and a test terminal, wherein the test terminal includes: a first sub-test terminal and a second sub-test terminal, wherein: The test server is configured to receive test configuration information input by a user, wherein the test configuration information includes: an application version number, a terminal type identifier, and network environment information, wherein the network environment information indicates the operator of the network to which the device on which the application to be tested is installed is connected; and to send a second installation instruction to the first sub-test terminal, wherein the second installation instruction includes: an application installation package, the terminal type identifier, and the network environment information; The first sub-test terminal is configured to send the second installation instruction to the second sub-test terminal identified by the terminal type; The second sub-test terminal is configured to install the application to be tested and adjust its current network environment to the network environment indicated by the network environment information carried in the second installation instruction upon receiving the second installation instruction; The test server is further configured to periodically receive current configuration information of the application to be tested, the current configuration information including: a version number of the application to be tested, a type identifier of the second sub-test terminal, and network environment information of the second sub-test terminal; The test server is further configured to send a test instruction for the application to be tested to the first sub-test terminal if the version number of the application to be tested is consistent with the application version number in the test configuration information, the type identifier of the second sub-test terminal is consistent with the terminal type identifier in the test configuration information, and the network environment information of the second sub-test terminal is consistent with the network environment information in the test configuration information; The first sub-test terminal is further configured to send the test instruction to the second sub-test terminal upon receiving the test instruction; The second sub-test terminal is further configured to send a display request for a test network resource to a service server through the application to be tested, so as to display the test network resource in a display interface of the application to be tested.

17. The system according to claim 16, wherein: The test terminal is further configured to obtain a video to be processed that includes a display interface of the application to be tested; wherein the starting frame of the video to be processed represents the display content in the display interface of the application to be tested when the test terminal receives the test instruction; and to send a target video to the test server, wherein the target video is obtained based on the video to be processed; The test server is further configured to, upon receiving the target video, obtain two adjacent video frames with different screen contents from the target video as transition video frames; select one video frame from the two adjacent transition video frames as a key video frame; and determine a test result of the application to be tested based on a difference in timestamps between the two adjacent key video frames, wherein the target video comprises: a first video frame, a second video frame, and a third video frame, the first video frame being a video frame representing a page to be played of a network resource displayed in a display interface of the application to be tested, the second video frame being a video frame representing a loading page displayed in a display interface of the application to be tested, and the third video frame being a video frame representing a network resource displayed in a display interface of the application to be tested; the last first video frame and the first second video frame in the target video are two adjacent transition video frames, and the last second video frame and the first third video frame in the target video are two adjacent transition video frames, and the test result comprises: a delay in loading network resources for the application to be tested.

18. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; Memory for storing computer programs; A processor, configured to implement the method steps described in any one of claims 1 to 11 when executing a program stored in a memory.

19. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method steps of any one of claims 1 to 11 are implemented.

Images