Cloud application testing method, device, equipment and storage medium

Abstract

The embodiment of the application discloses a cloud application testing method, device, equipment and storage medium, and belongs to the technical field of computers. The method comprises the following steps: a test control device receives a first application page of a cloud application, obtains first operation information corresponding to the first application page by identifying the first application page, and the first operation information indicates an operation required to be performed on the cloud application; the test control device sends the first operation information to a cloud application terminal; the cloud application terminal converts the first operation information into a first operation instruction through a virtual input device, controls the cloud application to operate based on the first operation instruction, and sends a second application page obtained after the cloud application operates to the test control device; and the test control device determines a test result of the cloud application based on the second application page. The test method realizes automatic testing of the cloud application, and saves labor cost.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a cloud application testing method, apparatus, device, and storage medium. Background Technology

[0002] With the continuous development of computer technology and game clients, game clients are offering more and more game functions, and the memory occupied by game clients on the terminal is also increasing. In order to reduce the memory occupied by game clients on the terminal, cloud gaming has become an increasingly common gaming method. However, the problem that arises is how to test cloud games.

[0003] In related technologies, cloud gaming runs on a cloud gaming server, and the cloud gaming terminal is associated with the cloud game on the server, displaying the game screen. Players connect their input devices to the cloud gaming terminal and can trigger operation commands by manipulating the devices. These commands then allow the cloud gaming terminal to control the cloud game, thus obtaining test results. However, this testing method requires manual operation by the player, resulting in high labor costs. Summary of the Invention

[0004] This application provides a cloud application testing method, apparatus, device, and storage medium, which enables automated testing of cloud applications and saves labor costs. The technical solution is as follows:

[0005] On the one hand, a cloud application testing method is provided, which is executed by a cloud application testing system. The cloud application testing system includes a test control device, a cloud application terminal, and a cloud application server. The cloud application terminal is associated with the cloud application running on the cloud application server.

[0006] The method includes:

[0007] The test control device receives the first application page of the cloud application, and obtains the first operation information corresponding to the first application page by recognizing the first application page. The first operation information indicates the operation to be performed on the cloud application.

[0008] The test control device sends the first operation information to the cloud application terminal;

[0009] The cloud application terminal converts the first operation information into a first operation instruction through a virtual input device, controls the cloud application to perform operations based on the first operation instruction, and sends the second application page obtained by the cloud application after performing the operation to the test control device.

[0010] The test control device determines the test results of the cloud application based on the second application page.

[0011] In one possible implementation, the operation guidance information is further used to indicate the operation result corresponding to the operation, and the test control device determines the test result of the cloud application based on the second application page, including:

[0012] The test control device determines the test result based on the second application page and the operation result.

[0013] In another possible implementation, before the test control device receives the first application page of the cloud application, the method further includes:

[0014] The cloud application terminal captures the currently displayed application page to obtain the first application page, and sends the first application page to the test control device.

[0015] In another possible implementation, before the test control device receives the first application page of the cloud application, the method further includes:

[0016] The test control device sends a client startup command to the cloud application terminal, and the client startup command carries the cloud application identifier corresponding to the cloud application.

[0017] In response to the client startup command, the cloud application terminal starts the cloud application client in the cloud application terminal and sends a cloud application startup command to the cloud application server. The cloud application startup command carries the cloud application identifier.

[0018] In response to the cloud application launch command, the cloud application server launches the cloud application in the cloud application server and sends the application page of the cloud application to the cloud application terminal.

[0019] The cloud application terminal displays the application page through the cloud application client and sends the application page to the test control device.

[0020] On the other hand, a cloud application testing method is provided, the method comprising:

[0021] Receive the first application page of the cloud application sent by the cloud application terminal, wherein the cloud application runs in the cloud application server and is associated with the cloud application terminal;

[0022] By identifying the first application page, the first operation information corresponding to the first application page is obtained, and the first operation information indicates the operation that needs to be performed on the cloud application;

[0023] The cloud application terminal sends the first operation information to the cloud application terminal, which converts the first operation information into a first operation instruction through a virtual input device and controls the cloud application to perform operations based on the first operation instruction.

[0024] The system receives a second application page sent by the cloud application terminal and determines the test result of the cloud application based on the second application page.

[0025] In one possible implementation, obtaining the first operation information corresponding to the first application page by identifying the first application page includes:

[0026] Identify the first application scenario to which the first application page belongs;

[0027] Obtain the first operation information that matches the first application scenario, wherein the first operation information indicates the operation that needs to be performed on the first application scenario.

[0028] In another possible implementation, identifying the first application scenario to which the first application page belongs includes:

[0029] The first application page is matched with a preset scene image to obtain the matching result;

[0030] If the matching result indicates that the first application page matches the preset scene image, the application scene corresponding to the preset scene image is determined as the first application scene.

[0031] In another possible implementation, obtaining the first operation information corresponding to the first application page by identifying the first application page includes:

[0032] Identify the operation guidance information in the first application page, the operation guidance information being used to prompt the first application page based on the cloud application to perform the operation;

[0033] Based on the operation guidance information, the first operation information is determined.

[0034] In another possible implementation, the operation guidance information is also used to indicate the operation result corresponding to the operation, and the step of determining the test result of the cloud application based on the second application page includes:

[0035] The test result is determined based on the second application page and the operation result.

[0036] In another possible implementation, determining the test results of the cloud application based on the second application page includes:

[0037] Identify the second application scenario to which the second application page belongs;

[0038] Based on the second application scenario and the target application scenario that matches the first operation information, the test result is determined. The target application scenario is the application scenario obtained after performing the operation indicated by the first operation information on the cloud application.

[0039] On the other hand, a cloud application testing method is provided, the method comprising:

[0040] The test control device sends a first application page of a cloud application to the test control device. The cloud application runs on a cloud application server and is associated with the current cloud application terminal. The test control device is used to identify the first application page and obtain first operation information corresponding to the first application page. The first operation information indicates the operation to be performed on the cloud application.

[0041] Receive the first operation information sent by the test control device through a virtual input device;

[0042] The virtual input device converts the first operation information into a first operation instruction, controls the cloud application to perform operations based on the first operation instruction, and sends the second application page obtained after the cloud application performs the operation to the test control device. The test control device is also used to determine the test result of the cloud application based on the second application page.

[0043] In one possible implementation, converting the first operation information into a first operation instruction via a virtual input device includes:

[0044] The virtual input device converts the first operation information into the first operation instruction in the target format, and the first operation instruction in the target format satisfies the communication protocol between the virtual input device and the cloud application server.

[0045] In another possible implementation, before converting the first operation information into a first operation instruction via the virtual input device, the method further includes:

[0046] If the virtual input device is not configured in the operating system, or if the virtual input device configured in the operating system does not have the target interaction function, the virtual input device is configured in the cloud application client in the cloud application terminal, and the virtual input device configured in the cloud application client has the target interaction function.

[0047] The target interaction function refers to the function of receiving operation information sent by other devices connected to the cloud application terminal and converting the operation information into operation instructions.

[0048] On the other hand, a cloud application testing device is provided, the device comprising:

[0049] The page receiving module is used to receive the first application page of the cloud application sent by the cloud application terminal. The cloud application runs in the cloud application server and is associated with the cloud application terminal.

[0050] The operation information acquisition module is used to obtain the first operation information corresponding to the first application page by recognizing the first application page. The first operation information indicates the operation that needs to be performed on the cloud application.

[0051] An operation information sending module is used to send the first operation information to the cloud application terminal. The cloud application terminal is used to convert the first operation information into a first operation instruction through a virtual input device, and control the cloud application to perform operations based on the first operation instruction.

[0052] The test result determination module is used to receive the second application page sent by the cloud application terminal, and determine the test result of the cloud application based on the second application page.

[0053] In one possible implementation, the operation information acquisition module includes:

[0054] A scene recognition unit is used to identify the first application scene to which the first application page belongs;

[0055] An operation information determination unit is used to obtain the first operation information that matches the first application scenario, wherein the first operation information indicates the operation that needs to be performed on the first application scenario.

[0056] In another possible implementation, the scene recognition unit is used for:

[0057] The first application page is matched with a preset scene image to obtain the matching result;

[0058] If the matching result indicates that the first application page matches the preset scene image, the application scene corresponding to the preset scene image is determined as the first application scene.

[0059] In another possible implementation, the operation information acquisition module includes:

[0060] An operation guidance recognition unit is used to recognize operation guidance information in the first application page, wherein the operation guidance information is used to prompt the first application page based on the cloud application to perform the operation;

[0061] An operation information determination unit is used to determine the first operation information based on the operation guidance information.

[0062] In another possible implementation, the operation guidance information is also used to prompt the operation result corresponding to the operation, and the test result determination module is used to determine the test result based on the second application page and the operation result.

[0063] In another possible implementation, the test result determination module is used for:

[0064] Identify the second application scenario to which the second application page belongs;

[0065] Based on the second application scenario and the target application scenario that matches the first operation information, the test result is determined. The target application scenario is the application scenario obtained after performing the operation indicated by the first operation information on the cloud application.

[0066] On the other hand, a cloud application testing device is provided, the device comprising:

[0067] The page sending module is used to send the first application page of the cloud application to the test control device. The cloud application runs in the cloud application server and is associated with the current cloud application terminal. The test control device is used to obtain the first operation information corresponding to the first application page by recognizing the first application page. The first operation information indicates the operation to be performed on the cloud application.

[0068] An operation information receiving module is used to receive the first operation information sent by the test control device through a virtual input device;

[0069] The page sending module is further configured to convert the first operation information into a first operation instruction through the virtual input device, control the cloud application to perform an operation based on the first operation instruction, and send the second application page obtained after the cloud application performs the operation to the test control device. The test control device is further configured to determine the test result of the cloud application based on the second application page.

[0070] In one possible implementation, the page sending module is further configured to convert the first operation information into the first operation instruction in a target format via the virtual input device, wherein the first operation instruction in the target format satisfies the communication protocol between the virtual input device and the cloud application server.

[0071] In another possible implementation, the device further includes:

[0072] A virtual input device configuration module is used to configure the virtual input device in the cloud application client in the cloud application terminal when the virtual input device is not configured in the operating system or the virtual input device configured in the operating system does not have the target interaction function. The virtual input device configured in the cloud application client has the target interaction function.

[0073] The target interaction function refers to the function of receiving operation information sent by other devices connected to the cloud application terminal and converting the operation information into operation instructions.

[0074] On the other hand, a test control device is provided, the test control device including a processor and a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to perform the operations performed by the cloud application testing method as described above.

[0075] On the other hand, a cloud application terminal is provided, the cloud application terminal including a processor and a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to perform the operations performed by the cloud application testing method as described above.

[0076] On the other hand, a computer-readable storage medium is provided that stores at least one computer program, which is loaded and executed by a processor to perform the operations performed by the cloud application testing method described above.

[0077] On the other hand, a computer program product is provided, including a computer program that, when executed by a processor, performs the operations performed by the cloud application testing method described above.

[0078] The cloud application testing scheme provided in this application embodiment directly identifies the first application page of the cloud application by the test control device to obtain the first operation information. Then, the first operation information is converted into a first operation command through the virtual input device in the cloud application terminal, and the cloud application is controlled to perform the operation based on the first operation command. Then, the second application page obtained after the operation is sent to the test control device, and the test control device obtains the test result based on the second application page, thereby completing the test of the cloud application. In the entire testing process, the cloud application terminal does not need an external input device to input operation commands. Instead, the operation commands are obtained directly through the cooperation of the test control device and the virtual input device in the cloud application terminal. Moreover, the test control device can obtain the corresponding operation information by identifying the application page of the cloud application, without the need for the user to manually input operation information. From triggering the operation information to obtaining the final test result, the entire process does not require manual operation by the user, realizing automatic testing of cloud applications and saving labor costs. Attached Figure Description

[0079] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0080] Figure 1 This is a schematic diagram of a cloud application testing system provided in an embodiment of this application;

[0081] Figure 2 This is a flowchart of a cloud application testing method provided in an embodiment of this application;

[0082] Figure 3 This is a flowchart of another cloud application testing method provided in the embodiments of this application;

[0083] Figure 4 This is a schematic diagram of a first application page provided in an embodiment of this application;

[0084] Figure 5 This is a schematic diagram of a cloud gaming testing scenario provided in an embodiment of this application;

[0085] Figure 6 This is a schematic diagram of an operation process provided in an embodiment of this application;

[0086] Figure 7 This is a schematic diagram of another operation process provided in an embodiment of this application;

[0087] Figure 8 This is a schematic diagram of another operation process provided in the embodiments of this application;

[0088] Figure 9 This is a schematic diagram illustrating a process of sending an application page according to an embodiment of this application;

[0089] Figure 10 This is a schematic diagram of a cloud application testing process provided in an embodiment of this application;

[0090] Figure 11 This is a schematic diagram illustrating the interaction process between a test control device and a cloud application terminal, as provided in an embodiment of this application.

[0091] Figure 12 This is a schematic diagram illustrating the interaction process between another test control device and a cloud application terminal provided in an embodiment of this application;

[0092] Figure 13 This is a schematic diagram of a testing process in a related technology provided in an embodiment of this application;

[0093] Figure 14 This is a schematic diagram of a testing process in another related technology provided in an embodiment of this application;

[0094] Figure 15 This is a schematic diagram of a testing process in another related technology provided in an embodiment of this application;

[0095] Figure 16 This is a schematic diagram of a testing process in another related technology provided in an embodiment of this application;

[0096] Figure 17 This is a flowchart of yet another cloud application testing method provided in the embodiments of this application;

[0097] Figure 18 This is a flowchart of yet another cloud application testing method provided in the embodiments of this application;

[0098] Figure 19 This is a flowchart of a cloud gaming testing method provided in an embodiment of this application;

[0099] Figure 20 This is a schematic diagram of the structure of a cloud application testing device provided in an embodiment of this application;

[0100] Figure 21 This is a schematic diagram of another cloud application testing device provided in an embodiment of this application;

[0101] Figure 22 This is a schematic diagram of the structure of a terminal provided in an embodiment of this application;

[0102] Figure 23 This is a schematic diagram of the structure of a server provided in an embodiment of this application. Detailed Implementation

[0103] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0104] It is understood that the terms "first," "second," etc., used in this application may be used to describe various concepts herein, but unless otherwise specified, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another. For example, without departing from the scope of this application, the first arrangement order may be referred to as the second arrangement order, and the second arrangement order may be referred to as the first arrangement order.

[0105] As used in this application, the terms "at least one," "multiple," "each," and "any" include, respectively, "at least one," "multiple," "each," and "any," where "at least one" includes one, two, or more; "multiple" includes two or more; "each" refers to each of the corresponding multiples; and "any" refers to any one of the multiples. For example, multiple cloud games include three cloud games, where "each cloud game" refers to every single one of the three cloud games, and "any" refers to any one of the three cloud games, which could be the first, the second, or the third.

[0106] Cloud technology refers to a hosting technology that unifies hardware, software, and network resources within a wide area network (WAN) or local area network (LAN) to achieve data computation, storage, processing, and sharing. Based on the cloud computing business model, cloud technology encompasses network technology, information technology, integration technology, management platform technology, and application technology. It can form resource pools, providing flexible and convenient on-demand access. Cloud computing technology will become a crucial support. Backend services of technical network systems require substantial computing and storage resources, such as video websites, image websites, and many portal websites. With the rapid development and application of the internet industry, every item may have its own identification mark in the future, requiring transmission to backend systems for logical processing. Data at different levels will be processed separately, and various industry data will require robust system support, which can only be achieved through cloud computing.

[0107] Cloud gaming, also known as gaming on demand, is an online gaming technology based on cloud computing. It enables thin clients with relatively limited graphics processing and data processing capabilities to run high-quality games. In cloud gaming, the game does not reside on the player's terminal but runs on a cloud server. The cloud server renders the game scene as a video and audio stream, which is then transmitted to the player's terminal via the network. The player's terminal does not need powerful graphics processing and data processing capabilities; it only needs basic streaming media playback capabilities and the ability to receive player input commands and send them to the cloud server.

[0108] Figure 1 This is a schematic diagram of a cloud application testing system provided in an embodiment of this application. See also... Figure 1 The cloud application testing system includes a test control device 101, a cloud application terminal 102, and a cloud application server 103. The test control device 101 and the cloud application terminal 102 are connected via a wireless or wired network, and the cloud application terminal 102 and the cloud application server 103 are connected via a wireless or wired network.

[0109] Optionally, the test control device 101 can be a terminal or a server. For example, the test control device 101 can be a computer, mobile phone, tablet computer, or other terminal; or the test control device 101 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. The cloud application terminal 102 can be a computer, mobile phone, tablet computer, television, or other terminal with display capabilities. The cloud application server 103 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0110] During cloud application testing, the test control device 101 controls the cloud application in the cloud application server 103 through the cloud application terminal 102, and obtains the test results of the cloud application based on the application page obtained after the operation. The cloud application terminal 102 is associated with the cloud application in the cloud application server 103. The cloud application terminal 102 is used to convert the operation information sent by the test control device 101 into operation instructions, so that the cloud application server 103 controls the operation of the cloud application based on the operation instructions and obtains the application page after operation. Furthermore, since the cloud application server 103 does not have a display function, it also sends the application page of the cloud application to the cloud application terminal 102, which then displays the application page.

[0111] In one possible implementation, the cloud application terminal 102 has a cloud application client installed, which is associated with a cloud application in the cloud application server 103. For example, the cloud application client is a cloud game client, and the cloud application server 103 contains a cloud game associated with that client.

[0112] The cloud application testing method provided in this application involves the interaction between the test control device, the cloud application terminal, and the cloud application server during the testing process. The cloud application testing process will be described from the perspective of the interaction between the test control device, the cloud application terminal, and the cloud application server.

[0113] Figure 2 This is a flowchart illustrating a cloud application testing method provided in an embodiment of this application. The executing entity of this embodiment is a cloud application testing system, which includes a test control device, a cloud application terminal, and a cloud application server. The cloud application terminal is associated with the cloud application running on the cloud application server. See also... Figure 2 The method includes the following steps:

[0114] 201. The test control device receives the first application page of the cloud application and obtains the first operation information corresponding to the first application page by recognizing the first application page.

[0115] In this context, "cloud application" refers to any cloud application running on a cloud application server, such as cloud gaming, cloud conferencing, or cloud note-taking. This application embodiment does not limit the type of cloud application. The first application page of the cloud application is the application page currently displayed on the cloud application terminal. By identifying the first application page, the test control device can determine what operation can be performed on that first application page, thereby obtaining first operation information. This first operation information indicates the operation that needs to be performed on the cloud application.

[0116] 202. The test control equipment sends the first operation information to the cloud application terminal.

[0117] In this embodiment of the application, the test control device cannot directly interact with the cloud application server to control the operation of the cloud application in the cloud application server. Therefore, the test control device needs to forward the obtained first operation information to the cloud application terminal, and then the cloud application terminal controls the operation of the cloud application in the cloud application server based on the first operation information.

[0118] 203. The cloud application terminal converts the first operation information into a first operation instruction through a virtual input device, controls the cloud application to perform the operation based on the first operation instruction, and sends the second application page obtained by the cloud application after performing the operation to the test control device.

[0119] In this embodiment, to achieve automated testing of cloud applications, a physical input device is no longer needed. A virtual input device is configured in the cloud application terminal to simulate a physical input device. This virtual input device converts the first operation information into a first operation instruction, which indicates the operation to be performed on the cloud application. This first operation instruction is a responsive instruction for the cloud application server. The second application page is the application page obtained after performing the operation indicated by the first operation instruction on the cloud application.

[0120] 204. The test control device determines the test results of the cloud application based on the second application page.

[0121] After receiving the second application page, the test control device processes the page to obtain the test result for the cloud application. The test result indicates whether the cloud application has passed the test.

[0122] The method provided in this application embodiment directly identifies the first application page of the cloud application by the test control device to obtain first operation information. Then, the first operation information is converted into a first operation command through a virtual input device in the cloud application terminal. Based on the first operation command, the cloud application is controlled to perform an operation. The resulting second application page is then sent to the test control device, which obtains the test result based on the second application page, thereby completing the test of the cloud application. Throughout the entire testing process, the cloud application terminal does not require an external input device to input operation commands. Instead, the operation commands are obtained directly through the cooperation of the test control device and the virtual input device in the cloud application terminal. Furthermore, the test control device can obtain the corresponding operation information simply by identifying the application page of the cloud application, without requiring manual input from the user. From triggering the operation information to obtaining the final test result, the entire process requires no manual operation from the user, achieving automated testing of the cloud application and saving labor costs.

[0123] Figure 3This is a flowchart of another cloud application testing method provided in this application embodiment. The execution entity of this application embodiment is a cloud application testing system, which includes a test control device, a cloud application terminal, and a cloud application server, and the cloud application terminal is associated with the cloud application running on the cloud application server. See also... Figure 3 The method includes the following steps:

[0124] 301. The test control equipment receives the first application page of the cloud application sent by the cloud application terminal.

[0125] In this embodiment, the test control device is used to test cloud applications. The cloud applications run on a cloud application server and their application pages are displayed on a cloud application terminal. To enable the test control device to automatically test the cloud applications, the cloud application terminal sends the application pages of the cloud applications to the test control device, allowing the test control device to subsequently determine operation information based on these application pages. The first application page is the application page currently displayed on the cloud application terminal. The cloud application can be any cloud application running on the cloud application server, such as cloud gaming, cloud conferencing, or cloud notes. This embodiment does not limit the type of cloud application.

[0126] In one possible implementation, the cloud application terminal proactively sends the application page to the test control device. That is, when the cloud application server is running the cloud application, it sends the application page of that cloud application to the cloud application terminal. Then, while displaying the application page, the cloud application terminal sends the currently displayed first application page to the test control device every preset time interval. The preset time interval can be any pre-set duration, such as 30 seconds, 1 minute, or another duration.

[0127] In another possible implementation, when the test control device needs to test the cloud application, it sends a test request to the cloud application terminal. The test request carries the cloud application identifier corresponding to the cloud application to be tested. After receiving the test request, the cloud application terminal determines the cloud application to be tested based on the cloud application identifier carried in the test request and sends the current first application page of the cloud application to the test control device.

[0128] For the two possible implementations mentioned above, since the application page displayed on the cloud application terminal is also sent by the cloud application server, the first application page sent by the cloud application terminal to the test control device can be the application page sent by the cloud application server to the cloud application terminal; or, the cloud application terminal can capture the currently displayed application page, determine the captured image as the first application page, and send the first application page to the test control device.

[0129] Before displaying the first application page, the cloud application terminal needs to launch the cloud application. In one possible implementation, the test control device sends a client launch command to the cloud application terminal, which carries the cloud application identifier corresponding to the cloud application. In response to this command, the cloud application terminal launches the cloud application client corresponding to the cloud application identifier within the terminal and sends a cloud application launch command to the cloud application server, carrying the cloud application identifier. The cloud application server, in response, launches the cloud application corresponding to the identifier and sends the application page to the cloud application terminal. The cloud application terminal displays the application page through the cloud application client and sends the application page back to the test control device. Here, the cloud application identifier is the cloud application name or other unique identifier representing the cloud application.

[0130] In another possible implementation, the user triggers the icon of the cloud application client in the cloud application terminal, the cloud application terminal starts the cloud application client, and sends a cloud application start command to the cloud application server. The cloud application start command carries the cloud application identifier of the cloud application client. The cloud application server responds to the cloud application start command and starts the cloud application corresponding to the cloud application identifier in the cloud application server.

[0131] 302. The test control equipment obtains the first operation information corresponding to the first application page by recognizing the first application page.

[0132] The first operation information indicates the operation to be performed on the cloud application, such as pressing the A key on the keyboard or right-clicking the mouse. Furthermore, the same operation information may correspond to different operations for different cloud applications. For example, in two types of cloud games, the control command triggered by pressing the A key on the keyboard in one type of cloud game is used to control the virtual character to jump, while in another type of cloud game, the control command triggered by pressing the A key on the keyboard is used to control the virtual character to run.

[0133] In one possible implementation, the test control device identifies the first application scenario to which the first application page belongs; and obtains first operation information matching the first application scenario. This first operation information indicates the operation to be performed on the first application scenario. An application scenario refers to a virtual scene displayed on the application page, which includes virtual objects, controls, and other virtual elements. The application scenario varies depending on the type of cloud application. For example, taking cloud gaming as an example, the application scenario is a scene used to simulate virtual space in cloud gaming. This application scenario is a virtual scene that simulates a real environment, or a semi-simulated / semi-fictional virtual scene, or a completely fictional virtual scene. Another example is cloud conferencing, where the application scenario is a scenario where multiple user accounts communicate in a cloud meeting. This application scenario includes multiple user accounts, and may also include meeting files, etc.

[0134] Optionally, the test control device stores operation information corresponding to each application scenario. After identifying the first application scenario to which the first application page belongs, the first operation information matching the first application scenario can be determined. Specifically, if an application scenario matches at least one type of operation information, and the first application scenario has one matching operation information, that operation information is determined as the first operation information. If the first application scenario has multiple matching operation information, any one of the multiple operation information is determined as the first operation information. Furthermore, for a single operation information, it can match at least one application scenario.

[0135] In one possible implementation, the test control device identifies the first application scenario to which the first application page belongs, including: the test control device matches the first application page with a preset scenario image to obtain a matching result, wherein the matching result is used to indicate whether the first application page matches the preset scenario image, the preset scenario image being a pre-set image, and each preset scenario image corresponding to an application scenario. If the matching result indicates that the first application page matches the preset scenario image, the test control device determines the application scenario corresponding to the preset scenario image as the first application scenario; if the matching result indicates that the first application page does not match the preset scenario image, the test control device matches the first application page with other preset scenario images to obtain corresponding matching results, until the obtained matching result indicates that the first application page matches the corresponding preset scenario image.

[0136] Optionally, the test control device matches the first application page with a preset scene image, including: the test control device comparing the first application page with the preset scene image to determine whether there is a region in the first application page that is the same as the preset scene image; if there is a region in the first application page that is the same as the preset scene image, then the first application page is determined to match the preset scene image; or, the test control device extracts features from the first application page and the preset scene image respectively to obtain scene features corresponding to the first application page and scene features corresponding to the preset scene image, and then determines whether the similarity between the scene features corresponding to the first application page and the scene features corresponding to the preset scene image is greater than a preset similarity; if the similarity is greater than the preset similarity, then the first application page is determined to match the preset scene image. The scene features are used to describe the application scene in the first application page or the preset scene image. Of course, the test control device can also use other methods to determine whether the first application page matches the preset scene image; this application does not limit the matching method.

[0137] In another possible implementation, where the first application page includes operation guidance information, the test control device identifies this information, which prompts the cloud-based application page to perform an operation. Based on this operation guidance information, the test control device determines the first operation information. In other words, since the operation guidance information on the first application page indicates what operation can be performed on it, the test control device can directly determine the first operation information based on the operation suggested by this guidance information.

[0138] In the case where the operation guidance information prompts an operation, the test control device determines a first operation information indicating that such operation should be performed on the first application page; in the case where the operation guidance information prompts multiple operations, the test control device selects any one of the multiple operations, and the determined first operation information indicates that such selected operation should be performed on the first application page.

[0139] For example, see Figure 4 The diagram of the first application page shown has operation guidance information displayed in the lower right corner of the first application page 401, which includes the arrow keys for "select" and the A key for "confirm". This operation guidance information indicates that on the first application page 401, you can select the corresponding game mode, mission encyclopedia, and other functions by inputting the arrow keys, and confirm the selected functions by inputting the A key.

[0140] In one possible implementation, a test control program runs on the test control device, and the test control device executes the above-described embodiments through this test control program. If the test control device is a terminal, a test control client for testing cloud applications may be installed on the test control device, and the test control device executes the above-described embodiments through this client.

[0141] 303. The test control equipment sends the first operation information to the cloud application terminal.

[0142] In this embodiment of the application, the test control device cannot directly interact with the cloud application server to control the operation of the cloud application in the cloud application server. Therefore, the test control device needs to forward the obtained first operation information to the cloud application terminal, and then the cloud application terminal controls the operation of the cloud application in the cloud application server based on the first operation information.

[0143] In one possible implementation, the test control device packages the first operation information into a first network packet and sends the first network packet, which includes the first operation information, to the cloud application terminal. Alternatively, the test control device sends the first operation information to the cloud application terminal via a data cable connected to it.

[0144] 304. The cloud application terminal receives the first operation information, converts the first operation information into a first operation instruction through a virtual input device, and sends the first operation instruction to the cloud application server.

[0145] In related technologies, during manual testing of cloud applications, the user operates a physical input device, which then sends the triggered operation command to the cloud application terminal. The cloud application terminal's operating system then forwards this command to the cloud application client, which in turn sends it to the cloud application server. The cloud application server then controls the cloud application to perform operations based on the received command. For example, see... Figure 5 The diagram illustrates a cloud gaming test scenario. Physical input device 501 is connected to cloud gaming terminal 502, and cloud gaming terminal 502 is connected to cloud gaming server 503. (See also...) Figure 6 The diagram shown illustrates the operation process, based on Figure 5 In the cloud gaming test scenario shown, the user operates physical input devices such as a mouse, keyboard, and gamepad. The physical input devices send the operation instructions generated based on the user's operation to the cloud gaming terminal, which then forwards the operation instructions to the cloud gaming server via the network.

[0146] In this embodiment, to achieve automated testing of cloud applications, physical input devices are no longer required. However, for the cloud application server, it only controls the cloud application to operate based on the received control commands from the input device. The input device refers to an input device that has a defined communication protocol with the cloud application server. If the test control device directly sends the first operation information to the cloud application server, the cloud application server cannot directly control the cloud application to operate based on the first operation information. Therefore, the first operation information is converted into a first operation command through a virtual input device in the cloud application terminal. The virtual input device is an input device configured in the cloud application terminal to simulate a physical input device.

[0147] Optionally, the virtual input device is an input device configured in the operating system of the cloud application terminal. In this case, the test control device sends the first operation information to the cloud application terminal, and then the cloud application terminal converts the first operation information into a first operation instruction through the virtual input device configured in the operating system and the cloud application client. Alternatively, the virtual input device is a virtual input device configured in the cloud application client. In this case, the test control device sends the first operation information to the cloud application terminal, and then the cloud application terminal converts the first operation information into a first operation instruction through the virtual input device in the cloud application client.

[0148] For example, see Figure 7 The diagram illustrates the operation process. The test control device can send first operation information to the virtual input device in the cloud gaming client of the cloud gaming terminal, or to the virtual input device in the operating system of the cloud gaming terminal. Ultimately, however, the first operation information is converted into a first operation command and sent to the cloud gaming server. Furthermore, in... Figure 7 This also shows the difference between using physical input devices and using test control terminals. When using physical input devices to input operation commands, the cloud application terminal sends the operation commands to the cloud gaming client through the operating system, and then the cloud application client forwards them to the cloud application server. When physical input devices are available, virtual input devices do not play a role.

[0149] It should be noted that, for the above implementation method, the test control device needs to first send the first operation information to the operating system in the cloud application terminal, and then the operating system forwards the first operation information to the cloud application client, and then the cloud application client interacts with the cloud application server.

[0150] In one possible implementation, if the cloud application terminal does not have a virtual input device configured in its operating system, or if the virtual input device configured in the operating system does not have target interaction functionality, a virtual input device is configured in the cloud application client within the cloud application terminal. The virtual input device configured in the cloud application client has target interaction functionality, which refers to the ability to receive operation information sent by other devices connected to the cloud application terminal and convert that information into operation commands.

[0151] In one possible implementation, the cloud application terminal converts the first operation information into a first operation instruction in a target format via a virtual input device. This first operation instruction in the target format conforms to the communication protocol between the virtual input device and the cloud application server. In other words, the virtual input device and the cloud application server have a fixed communication protocol, and the first operation information needs to be converted into a form that conforms to this protocol—that is, into a first operation instruction. Only then can the cloud application server respond to the first operation instruction upon receiving it and perform operations on the cloud application based on the first operation instruction.

[0152] In addition, the operation instructions carry a cloud application identifier so that the cloud application server can determine which cloud application needs to be operated on based on the cloud application identifier.

[0153] In one possible implementation, the cloud application terminal packages the first operation instruction into a second network packet via a virtual input device and sends the second network packet to the cloud application server. For example, see... Figure 8 As shown in the diagram, the test control device sends a first network packet to the cloud application terminal. Then, the cloud application terminal parses the first network packet through the virtual input device in the cloud application client to obtain the first operation information in the first network packet. Then, according to the communication protocol between the virtual input device and the cloud application server, the first operation information is converted into a second network packet and sent to the cloud game server.

[0154] 305. The cloud application server responds to the first operation command, controls the cloud application to perform the operation, and sends the second application page obtained after the operation to the cloud application terminal.

[0155] In this embodiment, the cloud application server responds to a first operation instruction, controls the cloud application to perform the operation instructed by the first operation instruction, and sends the resulting second application page to the cloud application terminal. For example, if the first operation instruction instructs a virtual object standing on the ground in the first application page to jump, the cloud application server controls the cloud application to perform the operation of controlling the virtual object to jump, and then the cloud application server sends the resulting second application page to the cloud application terminal. In the second application page, the virtual object has already left the ground and begun to jump upwards.

[0156] In one possible implementation, after the cloud application server controls the cloud application to perform an operation, if this operation causes continuous changes to the application pages within the cloud application, then multiple application pages are obtained after the operation. For example, if a virtual object in an application page jumps upwards, and the jumping process is a continuous change, then multiple application pages containing the continuous jumping process are obtained after the jump. The cloud application server sends a video stream consisting of multiple application pages to the cloud application terminal. The cloud application terminal decodes the video stream and continuously plays the decoded multiple application pages, including a second application page.

[0157] For example, see Figure 9 The diagram illustrates the process of sending application pages. The cloud application server sends a video stream to the cloud application terminal, which includes multiple consecutive application pages. The cloud application terminal then decodes the video stream to obtain multiple images (application pages), and plays these images consecutively on the cloud application terminal so that the user can view the images on the cloud application terminal.

[0158] In one possible implementation, when the cloud application terminal sends a second network packet to the cloud application server, the cloud application server receives the second network packet, parses the second network packet, and obtains the first operation instruction in the second network packet.

[0159] 306. The cloud application terminal sends the received second application page to the test control equipment.

[0160] In this embodiment, after receiving the second application page from the cloud application server, the cloud application terminal displays the second application page on its own device and simultaneously sends the second application page to the test control device. The process of the cloud application terminal sending the second application page to the test control device is the same as the process of the cloud application terminal sending the first application page to the test control device, and will not be described again here.

[0161] 307. The test control device determines the test results of the cloud application based on the received second application page.

[0162] After receiving the second application page, the test control device processes the page to obtain the test result for the cloud application. The test result indicates whether the cloud application has passed the test.

[0163] In one possible implementation, the test control device identifies the second application scenario to which the second application page belongs; based on the second application scenario and the target application scenario matching the first operation information, the test result is determined. The target application scenario is the application scenario obtained after performing the operation indicated by the first operation information on the cloud application, i.e., the target application scenario is the desired scenario. The implementation method for identifying the second application scenario to which the second application page belongs is similar to the implementation method for identifying the first application scenario to which the first application page belongs, and will not be repeated here.

[0164] Optionally, the test control device determines the test result based on the second application scenario and the target application scenario that matches the first operation information, including: if the second application scenario and the target application scenario are consistent, the test control device determines that the test for the first application page has passed; if the second application scenario and the target application scenario are inconsistent, the test for the first application page has failed.

[0165] In one possible implementation, when the first operation information is determined based on the operation guidance information, the operation guidance information is also used to prompt the operation result corresponding to the operation. The test control device determines the test result of the cloud application based on the second application page, including: the test control device determines the test result based on the operation result prompted by the second application page and the operation guidance information. Optionally, if the operation result represents the target application scenario obtained after the operation, the test control device obtains the second application scenario to which the second application page belongs, and determines the test result based on the second application scenario and the target application scenario represented by the operation result.

[0166] In one possible implementation, after obtaining the test results, the test control device will also generate a test report, which includes the test results, first operation information, first application page, and second application page.

[0167] In one possible implementation, the operations performed by the test control device are based on the test control program within the test control device. In this case, the cloud application testing process in this embodiment of the application refers to... Figure 10 The cloud application server sends the application page to the cloud application terminal via the network. The cloud application terminal takes a screenshot of the application page and sends the captured image to the test control device. The test control device extracts the scene features of the image through the test control program. Based on the pre-stored preset scene images and the extracted scene features, it determines the application scene to which the image belongs. Then, based on the pre-stored operation information corresponding to different application scenes, it determines the operation information corresponding to the application scene to which the image belongs and sends the operation information to the cloud application terminal. The cloud application terminal converts the operation information into operation instructions through a virtual input device and sends the operation instructions to the cloud application server. The cloud application server controls the cloud application based on the operation instructions.

[0168] During the above testing process, the interaction between the test control device and the cloud application terminal was as follows: Figure 11 As shown, the test control device sends operation information to the cloud application terminal. Then, the cloud application terminal controls the cloud application to perform operations based on the operation information and sends the resulting application page to the test control device. The test control device obtains the test results based on the application page through the test control program.

[0169] The interaction between the test control equipment and the cloud application terminal is also like Figure 12 As shown, the test control device first interacts with the cloud application terminal through the test control program, causing the cloud application terminal to launch the cloud application client and the cloud application server to launch the cloud application. Then, if there is no usable virtual input device in the cloud application terminal's operating system, a virtual input device is configured in the cloud application terminal. After the test starts, the test control device performs scene recognition on the received first application page and determines the corresponding first operation information based on the recognized scene. The first operation information is then sent to the cloud application terminal. The cloud application terminal controls the cloud application to perform operations based on the first operation information and sends the resulting second application page to the test control device. The test control device obtains the test results based on the second application page and generates a test report.

[0170] It should be noted that this embodiment only illustrates the testing of one application page in a cloud application. In another embodiment, other application pages in the cloud application can also be tested. In one possible implementation, the test control device can further identify the second application page to obtain the second operation information corresponding to the second application page, that is, execute a similar implementation method as steps 301-307 above to continue testing the cloud application, which will not be described in detail here.

[0171] In related technologies, when testing applications installed locally on the terminal, see [link to relevant documentation]. Figure 13 This involves direct interaction between the test control equipment and the terminal under test. However, this testing method in related technologies is not suitable for cloud applications. See [link to relevant documentation]. Figure 14 The test control equipment sends control information to the terminal under test based on a communication protocol. However, the terminal under test cannot directly control the application under test in the cloud application server based on this operation information. Therefore, the testing methods for local terminal applications in related technologies are not applicable to the cloud applications in this application embodiment.

[0172] Additionally, see Figure 15Since cloud applications require the application page to be displayed on the cloud application terminal to complete the cloud application's operation, if the test control device interacts directly with the cloud application server, there will be no interaction between the cloud application server and the cloud application terminal, and the test process for the cloud application cannot be completed.

[0173] Additionally, see Figure 16 In related technologies, test cases are stored in the test control device in advance, and then the terminal under test executes the test cases to obtain the corresponding application page. However, since the test cases are set for specific applications, if no corresponding test cases are set for a certain application, it is impossible to test that application, which has limitations.

[0174] The method provided in this application embodiment directly identifies the first application page of the cloud application by the test control device to obtain first operation information. Then, the first operation information is converted into a first operation command through a virtual input device in the cloud application terminal. Based on the first operation command, the cloud application is controlled to perform an operation. The resulting second application page is then sent to the test control device, which obtains the test result based on the second application page, thereby completing the test of the cloud application. Throughout the entire testing process, the cloud application terminal does not require an external input device to input operation commands. Instead, the operation commands are obtained directly through the cooperation of the test control device and the virtual input device in the cloud application terminal. Furthermore, the test control device can obtain the corresponding operation information simply by identifying the application page of the cloud application, without requiring manual input from the user. From triggering the operation information to obtaining the final test result, the entire process requires no manual operation from the user, achieving automated testing of the cloud application and saving labor costs.

[0175] Furthermore, in this embodiment, since the first operation information is determined based on the first application scenario to which the first application page belongs, this method of determining operation information based on the application scenario is applicable to any cloud application. For different cloud applications, as long as these cloud applications have the same application scenario, the operation information used for testing can be determined based on the correspondence between the application scenario and the operation information, thereby making the cloud application testing method of this embodiment universal.

[0176] The above embodiments describe the cloud application testing process from the perspective of the interaction between the test control device, the cloud application terminal, and the cloud application server. The following describes the cloud application testing process from the perspectives of the test control device and the cloud application terminal, respectively.

[0177] Figure 17 This is a flowchart illustrating another cloud application testing method provided in this application embodiment. The execution entity in this application embodiment is a test control device. See also... Figure 17The method includes the following steps:

[0178] 1701. The test control device receives the first application page of the cloud application sent by the cloud application terminal. The cloud application runs in the cloud application server and is associated with the cloud application terminal.

[0179] The implementation method of step 1701 is the same as that of step 301 above, and will not be repeated here.

[0180] 1702. The test control equipment identifies the first application page and obtains the first operation information corresponding to the first application page. The first operation information indicates the operation that needs to be performed on the cloud application.

[0181] The implementation method of step 1702 is the same as that of step 302 described above, and will not be repeated here.

[0182] 1703. The test control device sends the first operation information to the cloud application terminal. The cloud application terminal is used to convert the first operation information into a first operation instruction through a virtual input device, and control the cloud application to perform operations based on the first operation instruction.

[0183] The implementation method of step 1703 is the same as that of steps 303-306 above, and will not be repeated here.

[0184] 1704. The test control device receives the second application page sent by the cloud application terminal and determines the test result of the cloud application based on the second application page.

[0185] The implementation method of step 1704 is the same as that of step 307 above, and will not be repeated here.

[0186] The method provided in this application embodiment directly involves a test control device identifying a first application page of a cloud application, obtaining first operation information, and sending this first operation information to a cloud application terminal. The cloud application terminal then controls the cloud application to perform operations based on this first operation information. The test control device subsequently obtains a second application page from the cloud application terminal after the operation and obtains the test result based on this second application page, thus completing the test of the cloud application. Throughout the entire testing process, the test control device obtains the corresponding operation information simply by identifying the application page of the cloud application, without requiring manual input from the user. From triggering the operation information to obtaining the final test result, the entire process requires no manual user intervention, achieving automated testing of the cloud application and saving labor costs.

[0187] Figure 18 This is a flowchart illustrating another cloud application testing method provided in this application embodiment. The execution subject of this application embodiment is a cloud application terminal. See also... Figure 18 The method includes the following steps:

[0188] 1801. The cloud application terminal sends the first application page of the cloud application to the test control device. The cloud application runs in the cloud application server and is associated with the current cloud application terminal. The test control device is used to obtain the first operation information corresponding to the first application page by recognizing the first application page. The first operation information indicates the operation to be performed on the cloud application.

[0189] The implementation method of step 1801 is the same as that of step 301 above, and will not be repeated here.

[0190] 1802. The cloud application terminal receives the first operation information sent by the test control device through the virtual input device.

[0191] 1803. The cloud application terminal converts the first operation information into a first operation instruction through a virtual input device, controls the cloud application to perform operations based on the first operation instruction, and sends the second application page obtained after the cloud application performs the operation to the test control device. The test control device is also used to determine the test result of the cloud application based on the second application page.

[0192] The implementation methods for steps 1802-1803 are the same as those for steps 302-307 described above, and will not be repeated here.

[0193] The method provided in this application embodiment involves a cloud application terminal sending a first application page to a test control device. The test control device directly determines first operation information based on this first application page. After obtaining the first operation information, the cloud application terminal converts it into a first operation command via a virtual input device and controls the cloud application to perform the operation based on this command. Then, the resulting second application page is sent back to the test control device, which obtains the test result based on this second application page, thus completing the test of the cloud application. Throughout the entire testing process, the cloud application terminal does not require an external input device to input operation commands. Instead, it directly obtains the operation commands through the cooperation of the test control device and the virtual input device within the cloud application terminal. Furthermore, the test control device can obtain the corresponding operation information simply by recognizing the application page of the cloud application, eliminating the need for manual input from the user. From triggering the operation information to obtaining the final test result, the entire process requires no manual operation from the user, achieving automated testing of the cloud application and saving labor costs.

[0194] The following section uses cloud gaming as an example to illustrate the automated testing scenario for cloud gaming.

[0195] Figure 19This is a flowchart illustrating a cloud gaming testing method provided in an embodiment of this application. The executing entity of this embodiment is a cloud gaming testing system, which includes a test control device, a cloud gaming terminal, and a cloud gaming server. The cloud gaming terminal is associated with a cloud game running on the cloud gaming server. See also... Figure 19 The method includes the following steps:

[0196] 1901. The test control device receives the first game page of the cloud game sent by the cloud game terminal.

[0197] 1902. The test control device obtains the first operation information corresponding to the first game page by recognizing the first game page.

[0198] 1903. The test control equipment sends the first operation information to the cloud gaming terminal.

[0199] 1904. The cloud gaming terminal receives the first operation information, converts the first operation information into a first operation instruction through a virtual input device, and sends the first operation instruction to the cloud gaming server.

[0200] 1905. The cloud gaming server responds to the operation command, controls the cloud game to perform the operation, and sends the second game page obtained after the operation to the cloud gaming terminal.

[0201] 1906. The cloud gaming terminal sends the received second game page to the test control device.

[0202] 1907. The test control device determines the test results of cloud gaming based on the received second game page.

[0203] The implementation methods for steps 1901-1907 are the same as those for steps 301-307 described above, and will not be repeated here.

[0204] Of course, this application embodiment only uses cloud gaming as an example for illustration. In another embodiment, the cloud application can also be other types of applications. This application embodiment does not limit the type of cloud application.

[0205] Figure 20 This is a schematic diagram of the structure of a cloud application testing device provided in an embodiment of this application. See also... Figure 20 The device includes:

[0206] The page receiving module 2001 is used to receive the first application page of the cloud application sent by the cloud application terminal. The cloud application runs in the cloud application server and is associated with the cloud application terminal.

[0207] The operation information acquisition module 2002 is used to obtain the first operation information corresponding to the first application page by recognizing the first application page. The first operation information indicates the operation that needs to be performed on the cloud application.

[0208] The operation information sending module 2003 is used to send first operation information to the cloud application terminal. The cloud application terminal is used to convert the first operation information into a first operation instruction through a virtual input device, and control the cloud application to perform operations based on the first operation instruction.

[0209] The test result determination module 2004 is used to receive the second application page sent by the cloud application terminal and determine the test result of the cloud application based on the second application page.

[0210] The apparatus provided in this application embodiment directly identifies the first application page of the cloud application by the test control device, obtains the first operation information, and sends the first operation information to the cloud application terminal. Then, the cloud application terminal controls the cloud application to perform operations based on the first operation information. The test control device then obtains the second application page after the operation sent by the cloud application terminal and obtains the test result based on the second application page, thereby completing the test of the cloud application. Throughout the entire testing process, the test control device can obtain the corresponding operation information by identifying the application page of the cloud application, without requiring the user to manually input operation information. From triggering the operation information to obtaining the final test result, the entire process does not require manual operation by the user, realizing automatic testing of the cloud application and saving labor costs.

[0211] In one possible implementation, the operation information acquisition module 2002 includes:

[0212] The scene recognition unit is used to identify the first application scene to which the first application page belongs;

[0213] The operation information determination unit is used to obtain first operation information that matches the first application scenario. The first operation information indicates the operation that needs to be performed on the first application scenario.

[0214] In another possible implementation, the scene recognition unit is used for:

[0215] The first application page is matched with the preset scene image to obtain the matching result;

[0216] If the matching result indicates that the first application page matches the preset scene image, the application scene corresponding to the preset scene image is determined as the first application scene.

[0217] In another possible implementation, the operation information acquisition module 2002 includes:

[0218] The operation guidance recognition unit is used to recognize the operation guidance information in the first application page. The operation guidance information is used to prompt the first application page based on the cloud application to perform an operation.

[0219] The operation information determination unit is used to determine the first operation information based on the operation guidance information.

[0220] In another possible implementation, the operation guidance information is also used to prompt the operation result corresponding to the operation. The test result determination module 2004 is used to determine the test result based on the second application page and the operation result.

[0221] In another possible implementation, the test result determination module 2004 is used for:

[0222] Identify the second application scenario to which the second application page belongs;

[0223] Based on the second application scenario and the target application scenario that matches the first operation information, the test result is determined. The target application scenario is the application scenario obtained after performing the operation indicated by the first operation information on the cloud application.

[0224] All of the above-mentioned optional technical solutions can be combined in any way to form the optional embodiments of this application, and will not be described in detail here.

[0225] It should be noted that the cloud application testing device provided in the above embodiments is only used as an example to illustrate the division of the above functional modules when testing cloud applications. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the test control equipment can be divided into different functional modules to complete all or part of the functions described above. In addition, the cloud application testing device and the cloud application testing method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.

[0226] Figure 21 This is a schematic diagram of another cloud application testing device provided in an embodiment of this application. See also... Figure 21 The device includes:

[0227] The page sending module 2101 is used to send the first application page of the cloud application to the test control device. The cloud application runs in the cloud application server and is associated with the current cloud application terminal. The test control device is used to obtain the first operation information corresponding to the first application page by recognizing the first application page. The first operation information indicates the operation to be performed on the cloud application.

[0228] The operation information receiving module 2102 is used to receive the first operation information sent by the test control device through a virtual input device;

[0229] The page sending module 2101 is also used to convert the first operation information into a first operation instruction through a virtual input device, control the cloud application to perform operations based on the first operation instruction, and send the second application page obtained after the cloud application performs the operation to the test control device. The test control device is also used to determine the test result of the cloud application based on the second application page.

[0230] The apparatus provided in this application embodiment involves a cloud application terminal sending a first application page to a test control device. The test control device directly determines first operation information based on this first application page. After obtaining the first operation information, the cloud application terminal converts it into a first operation command via a virtual input device and controls the cloud application to perform the operation based on this command. Then, the resulting second application page is sent back to the test control device, which obtains the test result based on this second application page, thus completing the test of the cloud application. Throughout the entire testing process, the cloud application terminal does not require an external input device to input operation commands. Instead, it directly obtains the operation commands through the cooperation of the test control device and the virtual input device within the cloud application terminal. Furthermore, the test control device can obtain the corresponding operation information simply by recognizing the application page of the cloud application, eliminating the need for manual input from the user. From triggering the operation information to obtaining the final test result, the entire process requires no manual operation from the user, achieving automated testing of the cloud application and saving labor costs.

[0231] In one possible implementation, the page sending module 2101 is further configured to convert the first operation information into a first operation instruction in a target format via a virtual input device, wherein the first operation instruction in the target format satisfies the communication protocol between the virtual input device and the cloud application server.

[0232] In another possible implementation, the device also includes:

[0233] The virtual input device configuration module is used to configure a virtual input device in the cloud application client in the cloud application terminal when no virtual input device is configured in the operating system or the virtual input device configured in the operating system does not have the target interaction function. The virtual input device configured in the cloud application client has the target interaction function.

[0234] Among them, the target interaction function refers to the function of receiving operation information sent by other devices connected to the cloud application terminal and converting the operation information into operation instructions.

[0235] The target application scenario is the application scenario obtained after executing the operation indicated by the first operation information on the cloud application.

[0236] All of the above-mentioned optional technical solutions can be combined in any way to form the optional embodiments of this application, and will not be described in detail here.

[0237] It should be noted that the cloud application testing device provided in the above embodiments is only used as an example to illustrate the division of the above functional modules when testing cloud applications. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the cloud application terminal can be divided into different functional modules to complete all or part of the functions described above. In addition, the cloud application testing device and the cloud application testing method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.

[0238] This application also provides a cloud application terminal, which includes a processor and a memory. The memory stores at least one computer program, which is loaded and executed by the processor to perform the operations performed by the cloud application testing method of the above embodiments.

[0239] This application also provides a test control device, which includes a processor and a memory. The memory stores at least one computer program, which is loaded and executed by the processor to perform the operations performed by the cloud application testing method of the above embodiments.

[0240] Figure 22 This is a schematic diagram of the structure of a terminal 2200 provided in an embodiment of this application. The terminal 2200 is either the cloud application terminal or the test control device described above. The terminal 2200 includes a processor 2201 and a memory 2202.

[0241] Processor 2201 may include one or more processing cores, such as a quad-core processor or an octa-core processor. Processor 2201 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 2201 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 2201 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 2201 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0242] The memory 2202 may include one or more computer-readable storage media, which may be non-transitory. The memory 2202 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 2202 are used to store at least one computer program, which is executed by the processor 2201 to implement the cloud application testing method provided in the method embodiments of this application.

[0243] In some embodiments, the terminal 2200 may also optionally include a peripheral device interface 2203 and at least one peripheral device. The processor 2201, memory 2202, and peripheral device interface 2203 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 2203 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 2204, a display screen 2205, a camera assembly 2206, an audio circuit 2207, a positioning assembly 2208, and a power supply 2209.

[0244] Peripheral device interface 2203 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 2201 and memory 2202. In some embodiments, processor 2201, memory 2202 and peripheral device interface 2203 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 2201, memory 2202 and peripheral device interface 2203 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0245] The radio frequency (RF) circuit 2204 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 2204 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 2204 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 2204 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 2204 can communicate with other terminals through at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 2204 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0246] Display screen 2205 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 2205 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 2201 for processing. In this case, display screen 2205 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 2205, disposed on the front panel of terminal 2200; in other embodiments, there may be at least two display screens, disposed on different surfaces of terminal 2200 or in a folded design; in still other embodiments, display screen 2205 may be a flexible display screen, disposed on a curved or folded surface of terminal 2200. Furthermore, display screen 2205 may be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The display screen 2205 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0247] The camera assembly 2206 is used to acquire images or videos. Optionally, the camera assembly 2206 includes a front-facing camera and a rear-facing camera. The front-facing camera is disposed on the front panel of the terminal, and the rear-facing camera is disposed on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 2206 may also include a flash. The flash may be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cool light flash, which can be used for light compensation at different color temperatures.

[0248] The audio circuit 2207 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting them into electrical signals that are input to the processor 2201 for processing, or to the radio frequency circuit 2204 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the terminal 2200. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 2201 or the radio frequency circuit 2204 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 2207 may also include a headphone jack.

[0249] The positioning component 2208 is used to locate the current geographical location of the terminal 2200 in order to enable navigation or LBS (Location Based Service).

[0250] Power supply 2209 is used to power the various components in terminal 2200. Power supply 2209 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 2209 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, and a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0251] In some embodiments, the terminal 2200 further includes one or more sensors 2210. The one or more sensors 2210 include, but are not limited to: an acceleration sensor 2211, a gyroscope sensor 2212, a pressure sensor 2213, an optical sensor 2214, and a proximity sensor 2215.

[0252] Those skilled in the art will understand that Figure 22 The structure shown does not constitute a limitation on terminal 2200 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0253] Figure 23This is a schematic diagram of a server structure provided in an embodiment of this application. The server 2300 can vary significantly due to different configurations or performance. It may include one or more Central Processing Units (CPUs) 2301 and one or more memories 2302. The memories 2302 store at least one computer program, which is loaded and executed by the processor 2301 to implement the methods provided in the various method embodiments described above. Of course, the server may also have wired or wireless network interfaces, a keyboard, and input / output interfaces for input and output. The server may also include other components for implementing device functions, which will not be elaborated upon here.

[0254] This application also provides a computer-readable storage medium storing at least one computer program, which is loaded and executed by a processor to perform the operations of the cloud application testing method described above.

[0255] This application also provides a computer program product, which includes a computer program that, when executed by a processor, performs the operations performed by the cloud application testing method described above.

[0256] In some embodiments, the computer program involved in the present application embodiments may be deployed and executed on a computer device, or on multiple computer devices located in one location, or on multiple computer devices distributed in multiple locations and interconnected through a communication network. Multiple computer devices distributed in multiple locations and interconnected through a communication network may constitute a blockchain system.

[0257] It is understood that in the specific implementation of this application, data related to user accounts is involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0258] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0259] The above are merely optional embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present application should be included within the protection scope of the present application.

Claims

1. A cloud application testing method, characterized in that, The testing is performed by a cloud application testing system, which includes a test control device, a cloud application terminal, and a cloud application server. The cloud application terminal is associated with the cloud application running on the cloud application server. The method includes: The cloud application terminal captures the application page of the currently displayed cloud application to obtain a first application page, and sends the first application page to the test control device; the application page of the cloud application is sent to the cloud application terminal by the cloud application server. The test control device receives the first application page, and obtains the first operation information corresponding to the first application page by recognizing the first application page. The first operation information indicates the operation that needs to be performed on the cloud application. The test control device sends the first operation information to the cloud application terminal; The cloud application terminal converts the first operation information into a first operation instruction through a virtual input device and sends the first operation instruction to the cloud application server. The cloud application server controls the cloud application to perform operations based on the first operation instruction, and sends the second application page obtained by the cloud application after performing the operation to the cloud application terminal. The cloud application terminal displays the second application page, captures the second application page, and sends the captured second application page to the test control device; The test control device determines the test results of the cloud application based on the second application page.

2. The method according to claim 1, characterized in that, The step of obtaining the first operation information corresponding to the first application page by identifying the first application page includes: The test control device identifies the first application scenario to which the first application page belongs; The test control device acquires the first operation information that matches the first application scenario, and the first operation information indicates the operation that needs to be performed on the first application scenario.

3. The method according to claim 2, characterized in that, The test control device identifies the first application scenario to which the first application page belongs, including: The test control device matches the first application page with a preset scene image to obtain a matching result; When the matching result indicates that the first application page matches the preset scene image, the test control device determines the application scene corresponding to the preset scene image as the first application scene.

4. The method according to claim 1, characterized in that, The step of obtaining the first operation information corresponding to the first application page by identifying the first application page includes: The test control device identifies the operation guidance information in the first application page, and the operation guidance information is used to prompt the first application page based on the cloud application to perform the operation; The test control device determines the first operation information based on the operation guidance information.

5. The method according to claim 1, characterized in that, The test control device determines the test results of the cloud application based on the second application page, including: The test control device identifies the second application scenario to which the second application page belongs; The test control device determines the test result based on the second application scenario and the target application scenario that matches the first operation information. The target application scenario is the application scenario obtained after performing the operation indicated by the first operation information on the cloud application.

6. The method according to claim 1, characterized in that, The cloud application terminal converts the first operation information into a first operation instruction through a virtual input device, including: The cloud application terminal converts the first operation information into the first operation instruction in the target format through the virtual input device, and the first operation instruction in the target format satisfies the communication protocol between the virtual input device and the cloud application server.

7. The method according to claim 1, characterized in that, Before the cloud application terminal converts the first operation information into a first operation instruction through a virtual input device, the method further includes: If the virtual input device is not configured in the operating system of the cloud application terminal, or if the virtual input device configured in the operating system does not have the target interaction function, the virtual input device is configured in the cloud application client in the cloud application terminal, and the virtual input device configured in the cloud application client has the target interaction function. The target interaction function refers to the function of receiving operation information sent by other devices connected to the cloud application terminal and converting the operation information into operation instructions.

8. A cloud application testing method, characterized in that, The method includes: The cloud application terminal receives a first application page of a cloud application sent by the cloud application terminal. The cloud application runs on a cloud application server and is associated with the cloud application terminal. The cloud application terminal is used to capture the currently displayed application page of the cloud application to obtain the first application page. The application page of the cloud application is sent to the cloud application terminal by the cloud application server. By identifying the first application page, the first operation information corresponding to the first application page is obtained, and the first operation information indicates the operation that needs to be performed on the cloud application; The cloud application terminal sends the first operation information to the cloud application terminal, which converts the first operation information into a first operation instruction through a virtual input device and sends the first operation instruction to the cloud application server. The cloud application server controls the cloud application to perform operations based on the first operation instruction and sends a second application page obtained after the cloud application performs the operation to the cloud application terminal. The cloud application terminal displays the second application page, captures the second application page, and sends the captured second application page to the test control device. The system receives the second application page sent by the cloud application terminal and determines the test result of the cloud application based on the second application page.

9. A cloud application testing method, characterized in that, The method includes: The application page of the currently displayed cloud application is captured to obtain the first application page; the application page of the cloud application is sent to the current cloud application terminal by the cloud application server; The test control device sends the first application page to the test control device. The cloud application runs on the cloud application server and is associated with the cloud application terminal. The test control device is used to obtain the first operation information corresponding to the first application page by recognizing the first application page. The first operation information indicates the operation that needs to be performed on the cloud application. Receive the first operation information sent by the test control device through a virtual input device; The virtual input device converts the first operation information into a first operation instruction and sends the first operation instruction to the cloud application server; the cloud application server controls the cloud application to perform operations based on the first operation instruction and sends the second application page obtained by the cloud application after performing the operation to the cloud application terminal. Display the second application page and capture a screenshot of the second application page; The test control device sends the intercepted second application page to the test control device, and the test control device is further used to determine the test result of the cloud application based on the second application page.

10. A cloud application testing device, characterized in that, The device includes: The page receiving module is used to receive the first application page of the cloud application sent by the cloud application terminal. The cloud application runs in the cloud application server and is associated with the cloud application terminal. The cloud application terminal is used to capture the currently displayed application page of the cloud application to obtain the first application page. The application page of the cloud application is sent to the cloud application terminal by the cloud application server. The operation information acquisition module is used to obtain the first operation information corresponding to the first application page by recognizing the first application page. The first operation information indicates the operation that needs to be performed on the cloud application. An operation information sending module is used to send the first operation information to the cloud application terminal. The cloud application terminal is used to convert the first operation information into a first operation instruction through a virtual input device and send the first operation instruction to the cloud application server. The cloud application server is used to control the cloud application to perform operations based on the first operation instruction and send a second application page obtained after the cloud application performs the operation to the cloud application terminal. The cloud application terminal is used to display the second application page, capture the second application page, and send the captured second application page to the test control device. The test result determination module is used to receive the second application page sent by the cloud application terminal, and determine the test result of the cloud application based on the second application page.

11. A cloud application testing device, characterized in that, The device includes: A module for capturing the first application page of the currently displayed cloud application; the application page of the cloud application is sent to the current cloud application terminal by the cloud application server; The page sending module is used to send the first application page to the test control device. The cloud application runs in the cloud application server and is associated with the cloud application terminal. The test control device is used to obtain the first operation information corresponding to the first application page by recognizing the first application page. The first operation information indicates the operation to be performed on the cloud application. An operation information receiving module is used to receive the first operation information sent by the test control device through a virtual input device; The page sending module is further configured to convert the first operation information into a first operation instruction through the virtual input device and send the first operation instruction to the cloud application server; the cloud application server is configured to control the cloud application to perform the operation based on the first operation instruction and send the second application page obtained by the cloud application after performing the operation to the cloud application terminal. A module for displaying the second application page and capturing the second application page; The page sending module is further configured to send the captured second application page to the test control device, and the test control device is further configured to determine the test result of the cloud application based on the second application page.

12. A test control device, characterized in that, The test control device includes a processor and a memory, the memory storing at least one computer program, which is loaded and executed by the processor to perform the operations described in claim 8 for cloud application testing.

13. A cloud application terminal, characterized in that, The cloud application terminal includes a processor and a memory. The memory stores at least one computer program, which is loaded and executed by the processor to perform the operations described in claim 9.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one computer program, which is loaded and executed by a processor to perform the operations of the cloud application testing method as described in claim 8, or to implement the cloud application testing method as described in claim 9.

15. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it performs the operations performed by the cloud application testing method of claim 8, or performs the operations performed by the cloud application testing method of claim 9.

Images