A data processing method and device based on a cloud computing system

Abstract

The application provides a data processing method and device based on a cloud computing system. The user can quickly view the first interface data obtained by the terminal on the screen of the terminal after inputting a control input, so that the user can avoid waiting for a long time to view the first interface data obtained by the terminal, thereby reducing the time delay of the user viewing the first interface data obtained by the terminal, and improving the user experience. In addition, in the application, when the user needs to control the target application interface change of the cloud application displayed on the screen of the terminal, and the first interface data obtained by the terminal is displayed on the local area in the target application interface, the terminal can not send the first interface data obtained by the terminal to the cloud, so that the network resources between the terminal and the server can be saved. In addition, the terminal can not encode the first interface data, so that the computing resources of the terminal can be saved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a data processing method and apparatus based on a cloud computing system. Background Technology

[0002] With the rapid development of technology, cloud applications have emerged. They run in the cloud through virtualization, collect user input on the terminal through network protocols, calculate data processing results based on the input, and then push the data processing results to the terminal in the form of a network stream. This enables control of cloud applications from the terminal, and can support lightweight thin terminals as well as control cloud applications.

[0003] For example, the terminal obtains the user's input to the player, transmits the input to the cloud via the network, and the cloud application in the cloud responds to the input and sends the image back to the terminal in real time for display.

[0004] In one example, suppose we need to display the interface of a cloud application on the terminal's screen, and the application interface displays an image acquired by the terminal itself. The user can input control input to the terminal. The terminal acquires the image based on the control input and then sends the control input and the acquired image to the cloud. The cloud retrieves the interface data of the application based on the control input, overlays the interface data with the acquired image, and sends the overlaid interface data to the terminal. The terminal receives the overlaid interface data and renders it so that the user can view the image on the cloud application's interface.

[0005] However, the inventors discovered that in the above example, after the user inputs control input to the terminal, it takes a relatively long time before the image acquired by the terminal itself can be seen on the screen, which reduces the user experience. Summary of the Invention

[0006] To improve user experience, this application discloses a data processing method and apparatus based on a cloud computing system.

[0007] In a first aspect, this application discloses a data processing method based on a cloud computing system, the cloud computing system including a terminal and a cloud, wherein a cloud application runs in the cloud, and the method is applied to the terminal, the method comprising:

[0008] Obtain control input for the cloud application; the control input is used to control the changes of the target application interface of the cloud application displayed on the screen of the terminal; the target application interface includes a local area and a cloud area, the local area is used to render data obtained by the terminal itself, and the cloud area is used to render data returned by the cloud.

[0009] According to the control input, first interface data for rendering on the local area is obtained, the first interface data is rendered on the local area, and a data acquisition request is sent to the cloud according to the control input, so that the cloud acquires at least second interface data for rendering on the cloud area in the target application interface according to the data acquisition request, and sends the second interface data to the terminal.

[0010] Receive the second interface data sent from the cloud;

[0011] At least the second interface data is rendered on the cloud region.

[0012] In one optional implementation, the second interface data includes preset fill data for filling the local area;

[0013] Rendering at least the second interface data on the cloud region includes:

[0014] The first interface data is used to replace the preset fill data in the second interface data to obtain the third interface data;

[0015] The third interface data is rendered on the cloud region.

[0016] In one optional implementation, the second interface data is interface data obtained by encoding the original interface data used for display on the cloud area in the target application interface by the cloud.

[0017] Rendering at least the second interface data on the cloud region includes:

[0018] The second interface data is decoded to obtain the original interface data;

[0019] The original interface data is rendered on the cloud region.

[0020] In an optional implementation, after rendering at least the second interface data on the cloud region, the method further includes:

[0021] If a fourth interface data for rendering on the local area is obtained when the terminal does not receive the control input, the interface data rendered on the local area will be replaced by the fourth interface data instead of the first interface data.

[0022] In one optional implementation, obtaining first interface data for rendering on the local area based on the control input includes:

[0023] The terminal's camera is activated based on the control input;

[0024] Image data is acquired based on the camera and used as the first interface data.

[0025] Secondly, this application discloses a data processing method based on a cloud computing system, the cloud computing system including a terminal and a cloud, wherein a cloud application runs in the cloud, and the method is applied to the cloud, the method comprising:

[0026] The receiving terminal sends a data acquisition request to the cloud based on the control input, which is used to control the changes of the target application interface of the cloud application displayed on the screen of the terminal; the target application interface includes a local area and a cloud area, the local area is used to render the data acquired by the terminal itself, and the cloud area is used to render the data returned by the cloud.

[0027] According to the data acquisition request, at least second interface data for rendering on the cloud area in the target application interface is obtained;

[0028] The second interface data is sent to the terminal so that the terminal renders the second interface data on the cloud area.

[0029] In an optional implementation, obtaining at least the second interface data for rendering on the cloud region in the target application interface according to the data acquisition request includes:

[0030] According to the data acquisition request, obtain interface data for displaying on the cloud area in the target application interface and preset fill data for filling on the local area;

[0031] The second interface data is obtained based on the interface data to be displayed in the cloud area of ​​the target application interface and the preset fill data.

[0032] In an optional implementation, obtaining at least the second interface data for rendering on the cloud region in the target application interface according to the data acquisition request includes:

[0033] According to the data acquisition request, at least the original interface data used for display on the cloud area in the target application interface is obtained;

[0034] The original interface data is encoded to obtain the second interface data.

[0035] Thirdly, this application discloses a data processing device based on a cloud computing system, the cloud computing system including a terminal and a cloud, wherein cloud applications run in the cloud, and the device is applied to the terminal, the device comprising:

[0036] The first acquisition module is used to acquire control input for the cloud application; the control input is used to control the changes of the target application interface of the cloud application displayed on the screen of the terminal; the target application interface includes a local area and a cloud area, the local area is used to render data acquired by the terminal itself, and the cloud area is used to render data returned by the cloud.

[0037] The second acquisition module is used to acquire first interface data for rendering on the local area according to the control input; the first rendering module is used to render the first interface data on the local area; and the first sending module is used to send a data acquisition request to the cloud according to the control input, so that the cloud acquires at least second interface data for rendering on the cloud area in the target application interface according to the data acquisition request, and sends the second interface data to the terminal.

[0038] The first receiving module is used to receive the second interface data sent by the cloud.

[0039] The second rendering module is used to render at least the second interface data on the cloud region.

[0040] In one optional implementation, the second interface data includes preset fill data for filling the local area;

[0041] The second rendering module includes:

[0042] A replacement module is used to replace the preset fill data in the second interface data with the first interface data to obtain the third interface data;

[0043] The first rendering unit is used to render the third interface data on the cloud area.

[0044] In one optional implementation, the second interface data is interface data obtained by encoding the original interface data used for display on the cloud area in the target application interface by the cloud.

[0045] The second rendering module includes:

[0046] A decoding unit is used to decode the second interface data to obtain the original interface data;

[0047] The second rendering unit is used to render the original interface data on the cloud region.

[0048] In an alternative implementation, the apparatus further includes:

[0049] The replacement module is configured to replace the first interface data with the fourth interface data when the terminal does not receive the control input and a fourth interface data for rendering on the local area is obtained.

[0050] In one optional implementation, the second acquisition module includes:

[0051] A startup unit is used to activate the camera of the terminal according to the control input;

[0052] The acquisition unit is used to acquire image data based on the camera and use it as the first interface data.

[0053] Fourthly, this application discloses a data processing apparatus based on a cloud computing system, the cloud computing system including a terminal and a cloud, wherein cloud applications run in the cloud, and the apparatus is applied to the cloud, the apparatus comprising:

[0054] The second receiving module is used to receive a data acquisition request sent by the terminal to the cloud according to the control input. The control input is used to control the changes of the target application interface of the cloud application displayed on the screen of the terminal. The target application interface includes a local area and a cloud area. The local area is used to render the data acquired by the terminal itself, and the cloud area is used to render the data returned by the cloud.

[0055] The third acquisition module is used to acquire, according to the data acquisition request, at least the second interface data used for rendering on the cloud area in the target application interface;

[0056] The second sending module is used to send the second interface data to the terminal so that the terminal renders the second interface data on the cloud area.

[0057] In one optional implementation, the third acquisition module includes:

[0058] The first acquisition unit is used to acquire interface data for displaying on the cloud area in the target application interface and preset fill data for filling on the local area according to the data acquisition request.

[0059] The second acquisition unit is used to acquire the second interface data based on the interface data to be displayed on the cloud area in the target application interface and the preset fill data.

[0060] In one optional implementation, the third acquisition module includes:

[0061] The third acquisition unit is used to acquire, according to the data acquisition request, at least the original interface data to be displayed on the cloud area in the target application interface;

[0062] An encoding unit is used to encode the original interface data to obtain the second interface data.

[0063] Fifthly, this application discloses an electronic device comprising:

[0064] processor;

[0065] Memory used to store processor-executable instructions;

[0066] The processor is configured to execute the data processing method based on the cloud computing system as described in the first aspect.

[0067] In a sixth aspect, this application discloses a non-transitory computer-readable storage medium in which, when the instructions in the storage medium are executed by a processor of an electronic device, enable the electronic device to perform the data processing method based on a cloud computing system as described in the first aspect.

[0068] In a seventh aspect, this application discloses a computer program product in which, when the instructions in the computer program product are executed by a processor of an electronic device, the electronic device is enabled to perform the data processing method based on a cloud computing system as described in the first aspect.

[0069] Eighthly, this application discloses an electronic device comprising:

[0070] processor;

[0071] Memory used to store processor-executable instructions;

[0072] The processor is configured to execute the data processing method based on the cloud computing system as described in the second aspect.

[0073] In a ninth aspect, this application discloses a non-transitory computer-readable storage medium in which, when instructions in the storage medium are executed by a processor of an electronic device, enable the electronic device to perform the data processing method based on a cloud computing system as described in the second aspect.

[0074] In a tenth aspect, this application discloses a computer program product in which, when the instructions in the computer program product are executed by a processor of an electronic device, the electronic device is enabled to perform the data processing method based on a cloud computing system as described in the second aspect.

[0075] Compared with the prior art, the embodiments of this application have the following advantages:

[0076] In this application, a terminal acquires control input for a cloud application. This control input is used to control changes in the target application interface of the cloud application displayed on the terminal's screen. The target application interface includes a local area and a cloud area. The local area is used to render data acquired by the terminal itself, and the cloud area is used to render data returned from the cloud. Based on the control input, the terminal acquires first interface data for rendering in the local area, renders the first interface data in the local area, and sends a data acquisition request to the cloud based on the control input. The cloud receives the data acquisition request, acquires at least second interface data for rendering in the cloud area of ​​the target application interface, and sends the second interface data to the terminal. The terminal receives the second interface data sent by the cloud and renders at least the second interface data in the cloud area.

[0077] This application enables users to control changes in the target application interface of a cloud application displayed on their terminal screen. Specifically, it allows the terminal to display first interface data acquired by itself in a local area of ​​the target application interface. Instead of sending the first interface data to the cloud and waiting for the cloud to render the target application interface containing the first interface data, the terminal can render the first interface data on its screen immediately after acquiring it. This allows the user to view the first interface data on the terminal screen immediately. Simultaneously, after waiting for the cloud to return second interface data for rendering in the cloud area of ​​the target application interface, at least the second interface data is rendered in the cloud area. This achieves the display of the target application interface on the terminal screen, as well as the display of both the first and second interface data on the target application interface for the user to view.

[0078] Thus, compared to existing technologies, in this application, the user can quickly view the first interface data automatically acquired by the terminal on the terminal screen after inputting the control input. This avoids the user having to wait a long time to view the first interface data automatically acquired by the terminal, thereby reducing the latency for the user to view the first interface data automatically acquired by the terminal and improving the user experience.

[0079] Furthermore, in this application, when the user needs to control the changes of the target application interface of the cloud application displayed on the terminal's screen, and the terminal displays the first interface data it has obtained itself in the local area of ​​the target application interface, the terminal can choose not to send the first interface data it has obtained itself to the cloud, thus saving network resources between the terminal and the server. Also, the terminal can avoid encoding the first interface data, thereby saving the terminal's computing resources.

[0080] Secondly, since the terminal can choose not to send the initial interface data to the cloud, in scenarios where the user views the initial interface data obtained by the terminal itself, the cloud can also refrain from processing the initial interface data, thereby saving cloud computing resources. For example, the cloud can avoid decoding the encoded interface data (obtained by encoding the initial interface data), thus saving cloud computing resources. Attached Figure Description

[0081] Figure 1 This is a structural block diagram of a cloud computing system illustrated in an exemplary embodiment of this application.

[0082] Figure 2 This is a flowchart illustrating a data processing method based on a cloud computing system, as shown in an exemplary embodiment of this application.

[0083] Figure 3 This is a structural block diagram of a data processing device based on a cloud computing system, as illustrated in an exemplary embodiment of this application.

[0084] Figure 4 This is a structural block diagram of a data processing device based on a cloud computing system, as illustrated in an exemplary embodiment of this application.

[0085] Figure 5 This is a schematic diagram of the structure of an apparatus provided in an exemplary embodiment of this application. Detailed Implementation

[0086] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0087] Figure 1 A structural block diagram of a cloud computing system according to this application is shown. The system includes a terminal 01 and a cloud 02.

[0088] Cloud applications run in the cloud. These cloud applications possess their own data processing logic. Terminals have the framework and shell of cloud applications, but do not possess their own data processing logic.

[0089] Terminals can include thin clients, etc.

[0090] Terminals include devices that can be directly controlled by a wide range of users, such as mobile phones, tablets, laptops, desktop computers, smartwatches, smart speakers, and smart glasses.

[0091] There is a long-lived connection between the terminal and the cloud, and data interaction between the terminal and the cloud can be carried out based on the long-lived connection.

[0092] In one embodiment, at least one VM (Virtual Machine) runs on the cloud, and cloud applications can run on the VM. In this embodiment, a thin client can log in to the corresponding VM so that the thin client can interact with the cloud applications on the corresponding VM for data exchange, etc.

[0093] Figure 2 This invention illustrates a flowchart of a data processing method based on a cloud computing system, which is applied to... Figure 1 In the cloud computing system shown, the method may include:

[0094] In step S101, the terminal acquires control input for the cloud application. This control input is used to control the changes in the target application interface of the cloud application displayed on the terminal's screen. The target application interface includes a local area and a cloud area. The local area is used to render data acquired by the terminal itself, and the cloud area is used to render data returned from the cloud.

[0095] In this application, when a user needs to control the changes of the target application interface of the cloud application displayed on the terminal screen, and the first interface data obtained by the terminal is displayed in the local area of ​​the target application interface, the user can input control input for the cloud application on the terminal, and then the terminal can obtain the control input for the cloud application input by the user and then execute step S102.

[0096] In one embodiment of this application, the control input may include, but is not limited to: clicking virtual buttons displayed on the screen of the terminal that are related to cloud applications, changing the posture of the terminal held by the user, and voice commands input by the user to the terminal.

[0097] The target application interface can be one of the multiple application interfaces included in the cloud application.

[0098] The initial interface data used for displaying on a local area of ​​the target application interface may include interface data acquired by the terminal itself. The process by which the terminal acquires interface data may be independent of the cloud.

[0099] For example, the interface data acquired by the terminal itself may include, but is not limited to: data collected by the user based on the camera on the terminal, data that the terminal has previously stored on the terminal, and data acquired by the terminal from external devices (such as USB flash drives or hard drives) that are connected to the terminal.

[0100] In step S102, the terminal obtains first interface data for rendering on the local area according to the control input, renders the first interface data on the local area, and sends a data acquisition request to the cloud according to the control input, so that the cloud obtains at least second interface data for rendering on the cloud area in the target application interface according to the data acquisition request, and sends the second interface data to the terminal.

[0101] In one embodiment of this application, the control input is used to instruct the terminal to control the terminal's camera to capture images. Thus, when the terminal obtains first interface data for rendering on the local area according to the control input, the terminal can activate the terminal's camera according to the control input, and capture image data based on the camera, which is then used as the first interface data for rendering on the local area.

[0102] Alternatively, in another approach, the control input is used to instruct the terminal to select a user-specified image from the images stored on the terminal. For example, the control input may include the image identifier of the user-specified image, and different images may have different image identifiers. The image identifier may include the image name, URL (Uniform Resource Locator), or number, etc.

[0103] Thus, when the terminal obtains the first interface data for rendering on the local area based on the control input, the terminal can select the user-specified image from the images stored in the terminal based on the image identifier in the control input, and use it as the first interface data for rendering on the local area.

[0104] In this application, the terminal can perform the steps of "obtaining first interface data for rendering on the local area according to the control input" and "sending a data acquisition request to the cloud according to the control input" in parallel.

[0105] In another embodiment of this application, when the terminal sends a data acquisition request to the cloud based on the control input, the terminal can send the data acquisition request to the cloud based on a long connection with the cloud.

[0106] In another embodiment of this application, when rendering the first interface data on a local area, a region can be selected on the terminal screen as the local area, and then the first image can be displayed on the selected local area.

[0107] When selecting a region on the terminal screen, a region can be randomly selected, or a region that does not obscure the currently displayed content can be selected, or a region can be selected in other ways. For details, please refer to the embodiments shown later, which will not be described in detail here.

[0108] In step S103, the cloud receives the data acquisition request sent by the terminal.

[0109] In one embodiment of this application, the cloud can receive the data acquisition request sent by the terminal based on a long connection between the cloud and the terminal.

[0110] In step S104, the cloud obtains at least the second interface data for rendering on the cloud area in the target application interface according to the data acquisition request.

[0111] For details of this step, please refer to the embodiments shown later, which will not be described in detail here.

[0112] In step S105, the cloud sends the second interface data to the terminal.

[0113] In one embodiment of this application, the cloud can send second interface data to the terminal based on a long connection with the terminal.

[0114] In step S106, the terminal receives the second interface data sent from the cloud.

[0115] In one embodiment of this application, the terminal can receive second interface data sent by the cloud based on a long connection with the cloud.

[0116] In step S107, the terminal renders at least the second interface data in the cloud region.

[0117] In this application, since the terminal has already rendered the first interface data on the local area in step S102, after the terminal renders the second interface data on the cloud area, it is possible to display the target application interface on the terminal screen, and display the first interface data and the second interface data on the target application interface for the user to view.

[0118] In this application, a terminal acquires control input for a cloud application. This control input is used to control changes in the target application interface of the cloud application displayed on the terminal's screen. The target application interface includes a local area and a cloud area. The local area is used to render data acquired by the terminal itself, and the cloud area is used to render data returned from the cloud. Based on the control input, the terminal acquires first interface data for rendering in the local area, renders the first interface data in the local area, and sends a data acquisition request to the cloud based on the control input. The cloud receives the data acquisition request, acquires at least second interface data for rendering in the cloud area of ​​the target application interface, and sends the second interface data to the terminal. The terminal receives the second interface data sent by the cloud and renders at least the second interface data in the cloud area.

[0119] This application enables users to control changes in the target application interface of a cloud application displayed on their terminal screen. Specifically, it allows the terminal to display first interface data acquired by itself in a local area of ​​the target application interface. Instead of sending the first interface data to the cloud and waiting for the cloud to render the target application interface containing the first interface data, the terminal can render the first interface data on its screen immediately after acquiring it. This allows the user to view the first interface data on the terminal screen immediately. Simultaneously, after waiting for the cloud to return second interface data for rendering in the cloud area of ​​the target application interface, at least the second interface data is rendered in the cloud area. This achieves the display of the target application interface on the terminal screen, as well as the display of both the first and second interface data on the target application interface for the user to view.

[0120] Thus, compared to existing technologies, in this application, the user can quickly view the first interface data automatically acquired by the terminal on the terminal screen after inputting the control input. This avoids the user having to wait a long time to view the first interface data automatically acquired by the terminal, thereby reducing the latency for the user to view the first interface data automatically acquired by the terminal and improving the user experience.

[0121] Furthermore, in this application, when the user needs to control the changes of the target application interface of the cloud application displayed on the terminal's screen, and the terminal displays the first interface data it has obtained itself in the local area of ​​the target application interface, the terminal can choose not to send the first interface data it has obtained itself to the cloud, thus saving network resources between the terminal and the server. Also, the terminal can avoid encoding the first interface data, thereby saving the terminal's computing resources.

[0122] Secondly, since the terminal can choose not to send the initial interface data to the cloud, in scenarios where the user views the initial interface data obtained by the terminal itself, the cloud can also refrain from processing the initial interface data, thereby saving cloud computing resources. For example, the cloud can avoid decoding the encoded interface data (obtained by encoding the initial interface data), thus saving cloud computing resources.

[0123] In one embodiment of this application, in step S104, when the cloud obtains at least the second interface data for rendering on the cloud area of ​​the target application interface according to the data acquisition request, it can obtain at least the original interface data for display on the cloud area of ​​the target application interface according to the data acquisition request, and then the original interface data can be used as the second interface data.

[0124] In another embodiment of this application, in step S104, when the cloud obtains second interface data for rendering on at least the cloud area of ​​the target application interface according to the data acquisition request, it can obtain original interface data for display on at least the cloud area of ​​the target application interface according to the data acquisition request. Then, the original interface data can be encoded to obtain the second interface data. The second interface data occupies less space than the original interface data; therefore, this embodiment can save network resources between the cloud and the terminal.

[0125] Accordingly, in step S107, when the terminal renders the second interface data in the cloud area, it can decode the second interface data to obtain the original interface data and render the original interface data in the cloud area.

[0126] In one embodiment of this application, after the terminal renders at least the second interface data in the cloud area in step S107, the target application interface is displayed on the terminal screen, and the first interface data and the second interface data are displayed on the target application interface, so that the user can view the first interface data and the second interface data on the target application interface.

[0127] However, in one possible scenario, while keeping the application interface of the cloud application continuously displayed on the terminal as the target application interface (without changing the application interface of the cloud application displayed on the terminal screen), the interface data that needs to be displayed in the local area of ​​the target application interface may change.

[0128] For example, if the interface data displayed in the local area of ​​the target application interface is an image captured by the camera of the terminal control terminal, the image captured by the camera will change as the terminal moves, the orientation of the camera changes, or the object being pointed at by the camera changes. Therefore, it is necessary to update the image in the local area of ​​the target application interface.

[0129] Specifically, if a fourth interface data is obtained for rendering on the local area without any control input on the terminal, the interface data rendered on the local area can be replaced by the fourth interface data instead of the first interface data. That is, the user will no longer see the first interface data on the local area of ​​the target application interface of the cloud application on the terminal screen, but will see the fourth interface data instead.

[0130] Through this embodiment, when it is necessary to update interface data in the local area of ​​the target application interface (for example, to replace the interface data rendered in the local area with the fourth interface data), the interface data rendered in the local area can be replaced with the fourth interface data on the terminal screen as soon as the terminal obtains the fourth interface data, so that the user can view the fourth interface data in the local area of ​​the target application interface of the cloud application.

[0131] Thus, compared to the prior art, in this application, the fourth interface data for rendering on the local area is obtained without any control input to the terminal. The user can quickly view the fourth interface data obtained by the terminal on the terminal screen. This avoids the user having to wait a long time to view the fourth interface data obtained by the terminal, thereby reducing the latency for the user to view the fourth interface data obtained by the terminal and improving the user experience.

[0132] In one embodiment of this application, step S104 includes:

[0133] 11) Based on the data acquisition request, obtain the interface data to be displayed in the cloud area of ​​the target application interface and the preset fill data to be filled in the local area.

[0134] In this application, the cloud application has multiple application interfaces. The cloud needs to determine the target application interface from among the multiple application interfaces in the cloud application based on the interface data, and then obtain the interface data to be displayed on the cloud area of ​​the target application interface and the preset fill data to be filled on the local area.

[0135] For example, suppose the input includes a user clicking a virtual button displayed on the terminal screen that is related to a cloud application. The virtual button contains a URL, which is the URL of the target application interface to which the user should navigate after clicking the virtual button. The URLs of different application interfaces within the cloud application can be different. Thus, the data retrieval request can include the URL contained in the virtual button. When the cloud platform determines the target application interface from among the multiple application interfaces based on this data retrieval request, it can extract the URL contained in the virtual button from the data retrieval request, and then determine the application interface corresponding to that URL as the target application interface.

[0136] For example, in another scenario, suppose the input includes: a user's handheld terminal changing its posture; different posture changes correspond to different posture change data; and different posture change data correspond to different application interfaces among multiple application interfaces in the cloud application. That is, different posture change data are used to navigate to different application interfaces among multiple application interfaces in the cloud application. Thus, the data acquisition request could include: posture change data of the user's handheld terminal changing its posture.

[0137] The cloud can pre-bind each attitude change data point to its corresponding application interface. The attitude change data can be obtained from the gyroscope built into the terminal, or from other feasible methods; this application does not limit this to any particular method.

[0138] In this way, when the cloud determines the target application interface among multiple application interfaces in the cloud application based on the data acquisition request, it can obtain the application interface that the attitude change data is bound to among the multiple application interfaces in the cloud application and use it as the target application interface.

[0139] For example, in another instance, suppose the input includes: a voice command input by the user to the terminal, which may carry the name of the target application interface to be navigated to. The names of different application interfaces within a cloud application can be different. Thus, the data retrieval request could include: a voice command input by the user to the terminal. For example, the name could include "main interface," "meeting interface," "video interface," and "photo editing interface," etc.

[0140] In this way, when the cloud determines the target application interface among multiple application interfaces in the cloud application based on the data acquisition request, it can extract the name of the target application interface that needs to be redirected in the data acquisition request, and then determine the target application interface based on the name among multiple application interfaces in the cloud application.

[0141] Specifically, it can obtain the initial interface data of the target application interface. The target application interface includes a local area; however, the initial interface data does not include the interface data of the local area, but includes the interface data of the area other than the local area (the cloud area) of the target application interface. Therefore, the initial interface data of the target application interface can be used as the interface data for display on the cloud area of ​​the target application interface.

[0142] The preset fill data is fill data pre-set in the cloud application, which may include data of pixels of a specific color, such as data of red pixels, white pixels, or blue pixels, etc., or may include other forms of data, which are not limited in this application.

[0143] 12) Obtain the second interface data based on the interface data to be displayed in the cloud area of ​​the target application interface and the preset fill data.

[0144] Specifically, preset fill data can be used as local area interface data to fill the local area in the initial interface data of the target application interface, thus obtaining the second interface data.

[0145] Accordingly, in one embodiment of this application, the second interface data includes preset fill data for filling the local area. Thus, in step S107, when the terminal renders at least the second interface data in the cloud area, the preset fill data in the second interface data can be replaced with the first interface data to obtain the third interface data. The third interface data is then rendered in the cloud area, thereby displaying the target application interface on the terminal screen, and displaying the first and second interface data on the target application interface for the user to view.

[0146] In this application, the location of the local area in the target application interface is often fixed, and the location of the target application interface rendered on the terminal screen is also often fixed. Thus, it can be concluded that the location of the local area in the target application interface rendered on the terminal screen is often fixed. If the location (local area) of the first interface data rendered on the terminal screen in step S102 is different from the location (local area) of the first interface data after at least the second interface data is rendered on the cloud area in step S107, then for the user, before and after step S107, the user will see the first interface data in different locations on the screen. That is, after step S107 is completed, the location of the first interface data on the screen undergoes a "hard switch" change, which will give the user a noticeable feeling of location switching, which may reduce the user experience.

[0147] Therefore, in order to avoid reducing the user experience as much as possible, in another embodiment of this application, the location area (local area) of the first interface data after rendering the second interface data on the cloud area can be used as a reference. When the terminal renders the first interface data on the local area in step S102, an area can be selected on the terminal screen as the local area based on this reference location area. For example, the reference location area can be used as the local area, and then the first interface data can be rendered on the selected local area.

[0148] In this way, before and after step S107, the user will see the first interface data in the same location area (the same local area) on the screen. That is, after step S107 is completed, the location area of ​​the first image on the screen will not change, thereby avoiding giving the user a noticeable feeling of location area switching and thus avoiding reducing the user experience.

[0149] In this application, for any one of multiple application interfaces in a cloud application, if the application interface includes a local area for displaying interface data acquired by the terminal itself, the identification information of the application interface can be obtained, as well as the position of the local area for displaying the interface data acquired by the terminal on the application interface. Based on the "position area of ​​the local area for displaying the interface data acquired by the terminal on the application interface" and the "rendering position area of ​​the application interface on the screen," the "position area of ​​the local area for displaying the interface data acquired by the terminal on the screen" is obtained. Then, the identification information of the application interface and the "position area of ​​the local area for displaying the interface data acquired by the terminal on the screen" can be combined to form a corresponding table entry and stored in the correspondence between identification information and position area. The same applies to each of the other application interfaces in the cloud application. The terminal can store the correspondence between identification information and position area in advance.

[0150] Thus, when the terminal determines the location of the local area in the target application interface on the screen, the terminal can search for the location area corresponding to the identification information of the target application interface in the correspondence between the identification information and the location area stored in the terminal, and use it as the location area of ​​the local area in the target application interface on the screen.

[0151] The identification information of the application interface can identify the URL or name of the application interface.

[0152] In one embodiment, there is a streaming system in the cloud that provides process services to the cloud, which in turn support the operation of virtual machines in the cloud.

[0153] In one approach, after receiving user input, the terminal can control the camera to capture an image, which is then used as the first image. This first image is then encoded to obtain an encoded image, which is then sent to the cloud. Encoding can employ formats such as H.264 (digital video compression format), but this application does not specify a particular encoding method.

[0154] The streaming service in the cloud receives the encoded image sent by the terminal. Typically, one operating mechanism of the streaming service is to decode the encoded image to obtain the first image, and then send the first image to the virtual machine where the cloud application resides.

[0155] Since the images received by the cloud application need to be encoded, after the virtual machine receives the first image sent by the streaming service, it needs to encode the first image to obtain the encoded image before sending the encoded image to the cloud application in the virtual machine.

[0156] The cloud application receives the encoded image sent by the virtual machine, decodes the encoded image to obtain the first image, adds the image data of the first image to the interface data of the application interface to be displayed on the terminal, encodes the interface data of the application interface with the first image added to obtain the encoded interface data, and then sends the encoded interface data to the terminal via the virtual machine and streaming service.

[0157] The terminal receives the encoded interface data, decodes the encoded interface data to obtain the interface data of the application interface with the first image added, and then renders the interface data of the application interface with the first image added on the terminal screen so that the user can view the first image on the screen.

[0158] However, this method involves three encoding processes and three decoding processes. One encoding process and one decoding process are executed by the terminal, while the remaining two encoding processes and two decoding processes are executed by the cloud. This will consume the computing resources of the terminal and the server respectively.

[0159] In another approach, after receiving user input, the terminal can control the camera to capture an image, which can then be used as the first image. This first image can be unencoded and not sent to the cloud; instead, it can be rendered locally on the target application's interface for the user to view. Furthermore, the terminal can send a data retrieval request to the cloud based on the input. This data retrieval request typically occupies less space than the encoded image.

[0160] The cloud receives the data retrieval request based on the streaming service, and then sends the data retrieval request to the virtual machine where the cloud application resides.

[0161] After receiving the data retrieval request, the virtual machine sends the data retrieval request to the cloud application within the virtual machine.

[0162] The cloud application receives the data acquisition request, acquires at least the second interface data used for rendering on the cloud area of ​​the target application interface, and then encodes the second interface data to obtain the encoded interface data. The encoded interface data is then sent to the terminal via a virtual machine and a streaming service.

[0163] The terminal receives the encoded interface data and decodes it to obtain at least the second interface data used for rendering on the cloud area of ​​the target application interface. Then, it can render at least the second interface data on the cloud area, thereby displaying the target application interface on the terminal screen and displaying the first image and the second interface data on the target application interface for the user to view.

[0164] In this method, since the terminal does not need to send the first image to the cloud, only one encoding process and one decoding process are involved, one of which is performed by the cloud and one of which is performed by the terminal.

[0165] Compared to the previous method, this method can save two encoding processes and two decoding processes. For example, it saves one encoding process on the terminal and two decoding processes and one encoding process on the cloud, thereby saving computing resources on both the terminal and the server.

[0166] Furthermore, in another embodiment of this application, the terminal may also send first interface data to the cloud, for example, encode the first interface data to obtain encoded interface data, and then send the encoded interface data obtained by encoding the first interface data to the cloud so that the cloud can apply the encoded interface data obtained by encoding the first interface data when needed.

[0167] For example, when a user uses a terminal to hold a video conference with others, the other users need to see the user's avatar on their terminals (the user's avatar collected by the user's terminal is the first interface data), so the terminal needs to send the user's avatar to the cloud, etc.

[0168] Reference Figure 3 This paper illustrates a structural block diagram of a data processing device based on a cloud computing system, wherein the cloud computing system includes a terminal and a cloud, a cloud application runs in the cloud, and the device is applied to the terminal. The device includes:

[0169] The first acquisition module 11 is used to acquire control input for the cloud application; the control input is used to control the changes of the target application interface of the cloud application displayed on the screen of the terminal; the target application interface includes a local area and a cloud area, the local area is used to render data acquired by the terminal itself, and the cloud area is used to render data returned by the cloud.

[0170] The second acquisition module 12 is used to acquire first interface data for rendering on the local area according to the control input; the first rendering module 13 is used to render the first interface data on the local area; and the first sending module 14 is used to send a data acquisition request to the cloud according to the control input, so that the cloud acquires at least second interface data for rendering on the cloud area in the target application interface according to the data acquisition request, and sends the second interface data to the terminal.

[0171] The first receiving module 15 is used to receive the second interface data sent by the cloud.

[0172] The second rendering module 16 is used to render at least the second interface data on the cloud area.

[0173] In one optional implementation, the second interface data includes preset fill data for filling the local area;

[0174] The second rendering module includes:

[0175] A replacement module is used to replace the preset fill data in the second interface data with the first interface data to obtain the third interface data;

[0176] The first rendering unit is used to render the third interface data on the cloud area.

[0177] In one optional implementation, the second interface data is interface data obtained by encoding the original interface data used for display on the cloud area in the target application interface by the cloud.

[0178] The second rendering module includes:

[0179] A decoding unit is used to decode the second interface data to obtain the original interface data;

[0180] The second rendering unit is used to render the original interface data on the cloud region.

[0181] In an alternative implementation, the apparatus further includes:

[0182] The replacement module is configured to replace the first interface data with the fourth interface data when the terminal does not receive the control input and a fourth interface data for rendering on the local area is obtained.

[0183] In one optional implementation, the second acquisition module includes:

[0184] A startup unit is used to activate the camera of the terminal according to the control input;

[0185] The acquisition unit is used to acquire image data based on the camera and use it as the first interface data.

[0186] In this application, a terminal acquires control input for a cloud application. This control input is used to control changes in the target application interface of the cloud application displayed on the terminal's screen. The target application interface includes a local area and a cloud area. The local area is used to render data acquired by the terminal itself, and the cloud area is used to render data returned from the cloud. Based on the control input, the terminal acquires first interface data for rendering in the local area, renders the first interface data in the local area, and sends a data acquisition request to the cloud based on the control input. The cloud receives the data acquisition request, acquires at least second interface data for rendering in the cloud area of ​​the target application interface, and sends the second interface data to the terminal. The terminal receives the second interface data sent by the cloud and renders at least the second interface data in the cloud area.

[0187] This application enables users to control changes in the target application interface of a cloud application displayed on their terminal screen. Specifically, it allows the terminal to display first interface data acquired by itself in a local area of ​​the target application interface. Instead of sending the first interface data to the cloud and waiting for the cloud to render the target application interface containing the first interface data, the terminal can render the first interface data on its screen immediately after acquiring it. This allows the user to view the first interface data on the terminal screen immediately. Simultaneously, after waiting for the cloud to return second interface data for rendering in the cloud area of ​​the target application interface, at least the second interface data is rendered in the cloud area. This achieves the display of the target application interface on the terminal screen, as well as the display of both the first and second interface data on the target application interface for the user to view.

[0188] Thus, compared to existing technologies, in this application, the user can quickly view the first interface data automatically acquired by the terminal on the terminal screen after inputting the control input. This avoids the user having to wait a long time to view the first interface data automatically acquired by the terminal, thereby reducing the latency for the user to view the first interface data automatically acquired by the terminal and improving the user experience.

[0189] Furthermore, in this application, when the user needs to control the changes of the target application interface of the cloud application displayed on the terminal's screen, and the terminal displays the first interface data it has obtained itself in the local area of ​​the target application interface, the terminal can choose not to send the first interface data it has obtained itself to the cloud, thus saving network resources between the terminal and the server. Also, the terminal can avoid encoding the first interface data, thereby saving the terminal's computing resources.

[0190] Secondly, since the terminal can choose not to send the initial interface data to the cloud, in scenarios where the user views the initial interface data obtained by the terminal itself, the cloud can also refrain from processing the initial interface data, thereby saving cloud computing resources. For example, the cloud can avoid decoding the encoded interface data (obtained by encoding the initial interface data), thus saving cloud computing resources.

[0191] Reference Figure 4 This paper illustrates a structural block diagram of a data processing device based on a cloud computing system, wherein the cloud computing system includes a terminal and a cloud, a cloud application runs in the cloud, and the device is applied to the cloud. The device includes:

[0192] The second receiving module 21 is used to receive a data acquisition request sent by the terminal to the cloud according to the control input. The control input is used to control the changes of the target application interface of the cloud application displayed on the screen of the terminal. The target application interface includes a local area and a cloud area. The local area is used to render the data acquired by the terminal itself, and the cloud area is used to render the data returned by the cloud.

[0193] The third acquisition module 22 is used to acquire, according to the data acquisition request, at least second interface data for rendering on the cloud area in the target application interface;

[0194] The second sending module 23 is used to send the second interface data to the terminal so that the terminal renders the second interface data on the cloud area.

[0195] In one optional implementation, the third acquisition module includes:

[0196] The first acquisition unit is used to acquire interface data for displaying on the cloud area in the target application interface and preset fill data for filling on the local area according to the data acquisition request.

[0197] The second acquisition unit is used to acquire the second interface data based on the interface data to be displayed on the cloud area in the target application interface and the preset fill data.

[0198] In one optional implementation, the third acquisition module includes:

[0199] The third acquisition unit is used to acquire, according to the data acquisition request, at least the original interface data to be displayed on the cloud area in the target application interface;

[0200] An encoding unit is used to encode the original interface data to obtain the second interface data.

[0201] In this application, a terminal acquires control input for a cloud application. This control input is used to control changes in the target application interface of the cloud application displayed on the terminal's screen. The target application interface includes a local area and a cloud area. The local area is used to render data acquired by the terminal itself, and the cloud area is used to render data returned from the cloud. Based on the control input, the terminal acquires first interface data for rendering in the local area, renders the first interface data in the local area, and sends a data acquisition request to the cloud based on the control input. The cloud receives the data acquisition request, acquires at least second interface data for rendering in the cloud area of ​​the target application interface, and sends the second interface data to the terminal. The terminal receives the second interface data sent by the cloud and renders at least the second interface data in the cloud area.

[0202] This application enables users to control changes in the target application interface of a cloud application displayed on their terminal screen. Specifically, it allows the terminal to display first interface data acquired by itself in a local area of ​​the target application interface. Instead of sending the first interface data to the cloud and waiting for the cloud to render the target application interface containing the first interface data, the terminal can render the first interface data on its screen immediately after acquiring it. This allows the user to view the first interface data on the terminal screen immediately. Simultaneously, after waiting for the cloud to return second interface data for rendering in the cloud area of ​​the target application interface, at least the second interface data is rendered in the cloud area. This achieves the display of the target application interface on the terminal screen, as well as the display of both the first and second interface data on the target application interface for the user to view.

[0203] Thus, compared to existing technologies, in this application, the user can quickly view the first interface data automatically acquired by the terminal on the terminal screen after inputting the control input. This avoids the user having to wait a long time to view the first interface data automatically acquired by the terminal, thereby reducing the latency for the user to view the first interface data automatically acquired by the terminal and improving the user experience.

[0204] Furthermore, in this application, when the user needs to control the changes of the target application interface of the cloud application displayed on the terminal's screen, and the terminal displays the first interface data it has obtained itself in the local area of ​​the target application interface, the terminal can choose not to send the first interface data it has obtained itself to the cloud, thus saving network resources between the terminal and the server. Also, the terminal can avoid encoding the first interface data, thereby saving the terminal's computing resources.

[0205] Secondly, since the terminal can choose not to send the initial interface data to the cloud, in scenarios where the user views the initial interface data obtained by the terminal itself, the cloud can also refrain from processing the initial interface data, thereby saving cloud computing resources. For example, the cloud can avoid decoding the encoded interface data (obtained by encoding the initial interface data), thus saving cloud computing resources.

[0206] This application also provides a non-volatile readable storage medium storing one or more modules (programs). When these modules are applied to a device, they enable the device to execute the instructions for the method steps in this application.

[0207] This application provides one or more machine-readable media storing instructions that, when executed by one or more processors, cause an electronic device to perform one or more of the methods described in the above embodiments. In this application, the electronic device includes servers, gateways, sub-devices, etc., with the sub-devices being devices such as Internet of Things (IoT) devices.

[0208] Embodiments of this disclosure can be implemented as an apparatus with any suitable hardware, firmware, software, or any combination thereof, configured as desired. This apparatus may include electronic devices such as servers (clusters) and terminal devices such as IoT devices.

[0209] Figure 5 An exemplary apparatus 1300 is schematically shown that can be used to implement the various embodiments described in this application.

[0210] In one embodiment, Figure 5An exemplary device 1300 is shown, which includes one or more processors 1302, a control module (chipset) 1304 coupled to at least one of the processors 1302, a memory 1306 coupled to the control module 1304, a non-volatile memory (NVM) / storage device 1308 coupled to the control module 1304, one or more input / output devices 1310 coupled to the control module 1304, and a network interface 1312 coupled to the control module 1306.

[0211] Processor 1302 may include one or more single-core or multi-core processors, and processor 1302 may include any combination of general-purpose processors or special-purpose processors (e.g., graphics processors, application processors, baseband processors, etc.). In some embodiments, device 1300 can serve as a server device such as a gateway as described in the embodiments of this application.

[0212] In some embodiments, apparatus 1300 may include one or more computer-readable media (e.g., memory 1306 or NVM / storage device 1308) having instructions 1314 and one or more processors 1302 that are combined with the one or more computer-readable media and configured to execute instructions 1314 to implement modules and thus perform the actions described in this disclosure.

[0213] In one embodiment, the control module 1304 may include any suitable interface controller to provide any suitable interface to at least one of the processors 1302 and / or any suitable device or component communicating with the control module 1304.

[0214] The control module 1304 may include a memory controller module to provide an interface to the memory 1306. The memory controller module may be a hardware module, a software module, and / or a firmware module.

[0215] Memory 1306 may be used, for example, to load and store data and / or instructions 1314 for device 1300. In one embodiment, memory 1306 may include any suitable volatile memory, such as suitable DRAM. In some embodiments, memory 1306 may include double data rate type quad synchronous dynamic random access memory (DDR4 SDRAM).

[0216] In one embodiment, the control module 1304 may include one or more input / output controllers to provide interfaces to the NVM / storage device 1308 and (one or more) input / output devices 1310.

[0217] For example, NVM / storage device 1308 may be used to store data and / or instructions 1314. NVM / storage device 1308 may include any suitable non-volatile memory (e.g., flash memory) and / or may include any suitable (one or more) non-volatile storage devices (e.g., one or more hard disk drives (HDDs), one or more optical disc drives (CDs), and / or one or more digital universal optical disc (DVD) drives).

[0218] NVM / storage device 1308 may include storage resources that are physically part of a device on which device 1300 is mounted, or that can be accessed by the device without needing to be part of the device. For example, NVM / storage device 1308 may be accessed via a network via one or more input / output devices 1310.

[0219] One or more input / output devices 1310 may provide an interface for device 1300 to communicate with any other suitable device. Input / output devices 1310 may include communication components, pinyin components, sensor components, etc. Network interface 1312 may provide an interface for device 1300 to communicate via one or more networks. Device 1300 may wirelessly communicate with one or more components of a wireless network according to any of one or more wireless network standards and / or protocols, such as accessing wireless networks based on communication standards, such as WiFi, 2G, 3G, 4G, 5G, etc., or combinations thereof.

[0220] In one embodiment, at least one of the processors 1302 may be logically packaged with one or more controllers (e.g., memory controller modules) of the control module 1304. In one embodiment, at least one of the processors 1302 may be logically packaged with one or more controllers of the control module 1304 to form a system-in-package (SiP). In one embodiment, at least one of the processors 1302 may be integrated with the logic of one or more controllers of the control module 1304 on the same die. In one embodiment, at least one of the processors 1302 may be integrated with the logic of one or more controllers of the control module 1304 on the same die to form a system-on-a-chip (SoC).

[0221] In various embodiments, device 1300 may be, but is not limited to, a server, desktop computing device, or mobile computing device (e.g., laptop computing device, handheld computing device, tablet computer, netbook, etc.). In various embodiments, device 1300 may have more or fewer components and / or different architectures. For example, in some embodiments, device 1300 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including a touchscreen display), a non-volatile memory port, multiple antennas, a graphics chip, an application-specific integrated circuit (ASIC), and a speaker.

[0222] This application provides an electronic device, including: one or more processors; and one or more machine-readable media having instructions stored thereon, which, when executed by the one or more processors, cause the electronic device to perform a data processing method based on a cloud computing system as described in one or more of this application.

[0223] As the device embodiment is basically similar to the method embodiment, the description is relatively simple, and relevant parts can be found in the description of the method embodiment.

[0224] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0225] This application describes embodiments with reference to flowchart illustrations and / or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable information processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable information processing terminal device, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0226] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable information processing terminal device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0227] These computer program instructions can also be loaded onto a computer or other programmable information processing terminal equipment, causing a series of operational steps to be performed on the computer or other programmable terminal equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable terminal equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0228] Although preferred embodiments of the present application have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including both the preferred embodiments and all changes and modifications falling within the scope of the embodiments of the present application.

[0229] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes said element.

[0230] The above provides a detailed description of a data processing method and apparatus based on a cloud computing system provided in this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and its core ideas. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A data processing method based on a cloud computing system, characterized in that, The cloud computing system includes a terminal and a cloud, wherein cloud applications run in the cloud, and the method is applied to the terminal, the method comprising: Obtain control input for the cloud application; the control input is used to control the changes of the target application interface of the cloud application displayed on the screen of the terminal; the target application interface includes a local area and a cloud area, the local area is used to render data obtained by the terminal itself, and the cloud area is used to render data returned by the cloud. The system acquires first interface data for rendering on the local area based on the control input, without sending the first interface data to the cloud, and renders the first interface data on the local area itself. In parallel, the system sends a data acquisition request to the cloud based on the control input and waits for the cloud to return second interface data. The data acquisition request enables the cloud to acquire at least the second interface data for rendering on the cloud area in the target application interface, and sends the second interface data to the terminal. The second interface data includes preset fill data for filling on the local area. Receive the second interface data sent from the cloud; Rendering at least the second interface data on the cloud region includes: replacing the preset fill data in the second interface data with the first interface data to obtain third interface data; and rendering the third interface data on the cloud region.

2. The method according to claim 1, characterized in that, The second interface data is interface data obtained by encoding the original interface data used for display in the cloud area of ​​the target application interface; Rendering at least the second interface data on the cloud region includes: The second interface data is decoded to obtain the original interface data; The original interface data is rendered on the cloud region.

3. The method according to claim 1, characterized in that, After rendering at least the second interface data on the cloud region, the method further includes: If a fourth interface data for rendering on the local area is obtained when the terminal does not receive the control input, the interface data rendered on the local area will be replaced by the fourth interface data instead of the first interface data.

4. The method according to claim 1, characterized in that, The step of obtaining first interface data for rendering on the local area based on the control input includes: The terminal's camera is activated based on the control input; Image data is acquired based on the camera and used as the first interface data.

5. A data processing method based on a cloud computing system, characterized in that, The cloud computing system includes a terminal and a cloud, wherein cloud applications run in the cloud, and the method is applied to the cloud, the method comprising: The receiving terminal sends a data acquisition request to the cloud based on the control input, which is used to control the changes of the target application interface of the cloud application displayed on the terminal's screen. The target application interface includes a local area and a cloud area. The local area is used to render the data acquired by the terminal itself, and the cloud area is used to render the data returned by the cloud. In parallel, the terminal acquires first interface data for rendering on the local area based on the control input, without sending the first interface data to the cloud, and renders the first interface data on the local area itself. Acquiring second interface data for rendering on the cloud region of the target application interface according to the data acquisition request includes: acquiring interface data for display on the cloud region of the target application interface and preset fill data for filling the local region according to the data acquisition request; acquiring the second interface data according to the interface data for display on the cloud region of the target application interface and the preset fill data; The second interface data is sent to the terminal so that the terminal renders the second interface data on the cloud area.

6. The method according to claim 5, characterized in that, The step of obtaining at least the second interface data for rendering on the cloud region in the target application interface according to the data acquisition request includes: According to the data acquisition request, at least the original interface data used for display on the cloud area in the target application interface is obtained; The original interface data is encoded to obtain the second interface data.

7. A data processing device based on a cloud computing system, characterized in that, The cloud computing system includes a terminal and a cloud, wherein cloud applications run in the cloud, and the device is applied to the terminal, the device comprising: The first acquisition module is used to acquire control input for the cloud application; the control input is used to control the changes of the target application interface of the cloud application displayed on the screen of the terminal; the target application interface includes a local area and a cloud area, the local area is used to render data acquired by the terminal itself, and the cloud area is used to render data returned by the cloud. The second acquisition module is used to acquire first interface data for rendering on the local area according to the control input. The first rendering module is used to render the first interface data on the local area without sending it to the cloud. In parallel, the first sending module is used to send a data acquisition request to the cloud according to the control input and wait for the cloud to return second interface data. The data acquisition request is used to enable the cloud to acquire at least the second interface data for rendering on the cloud area in the target application interface and send the second interface data to the terminal. The second interface data includes preset fill data for filling on the local area. The first receiving module is used to receive the second interface data sent by the cloud. The second rendering module is used to render at least the second interface data on the cloud area; the second rendering module includes: a replacement module, used to replace the preset fill data in the second interface data with the first interface data to obtain third interface data; and a first rendering unit, used to render the third interface data on the cloud area.

8. The apparatus according to claim 7, characterized in that, The second interface data is interface data obtained by encoding the original interface data used for display in the cloud area of ​​the target application interface; The second rendering module includes: A decoding unit is used to decode the second interface data to obtain the original interface data; The second rendering unit is used to render the original interface data on the cloud region.

9. The apparatus according to claim 7, characterized in that, The device further includes: The replacement module is configured to replace the first interface data with the fourth interface data when the terminal does not receive the control input and a fourth interface data for rendering on the local area is obtained.

10. The apparatus according to claim 7, characterized in that, The second acquisition module includes: A startup unit is used to activate the camera of the terminal according to the control input; The acquisition unit is used to acquire image data based on the camera and use it as the first interface data.

11. A data processing device based on a cloud computing system, characterized in that, The cloud computing system includes a terminal and a cloud, wherein cloud applications run in the cloud, and the device is applied to the cloud, the device comprising: The second receiving module is used to receive a data acquisition request sent by the terminal to the cloud according to the control input. The control input is used to control the changes of the target application interface of the cloud application displayed on the screen of the terminal. The target application interface includes a local area and a cloud area. The local area is used to render the data acquired by the terminal itself, and the cloud area is used to render the data returned by the cloud. In parallel, the terminal acquires the first interface data for rendering on the local area according to the control input, does not send the first interface data to the cloud, and renders the first interface data on the local area itself. The third acquisition module is configured to acquire, according to the data acquisition request, at least second interface data for rendering on the cloud area in the target application interface; the third acquisition module includes: a first acquisition unit, configured to acquire, according to the data acquisition request, interface data for display on the cloud area in the target application interface and preset fill data for filling on the local area; and a second acquisition unit, configured to acquire the second interface data according to the interface data for display on the cloud area in the target application interface and the preset fill data. The second sending module is used to send the second interface data to the terminal so that the terminal renders the second interface data on the cloud area.

12. The apparatus according to claim 11, characterized in that, The third acquisition module includes: The third acquisition unit is used to acquire, according to the data acquisition request, at least the original interface data to be displayed on the cloud area in the target application interface; An encoding unit is used to encode the original interface data to obtain the second interface data.

13. An electronic device, characterized in that, The electronic device includes: processor; Memory used to store processor-executable instructions; The processor is configured to perform the data processing method based on a cloud computing system as described in any one of claims 1-4.

14. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the data processing method based on a cloud computing system as described in any one of claims 1-4.

15. An electronic device, characterized in that, The electronic device includes: processor; Memory used to store processor-executable instructions; The processor is configured to perform the data processing method based on a cloud computing system as described in any one of claims 5-6.

16. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the data processing method based on a cloud computing system as described in any one of claims 5-6.

Images