Control processing method, device, system and storage medium

Abstract

The present application provides a control processing method, device, system, and storage medium. In the present application, the server of the cloud-side application can determine the target control to be displayed on the client from the controls associated with the cloud-side application and obtain the pre-configured UI configuration information of the target control. Then, based on the UI configuration information, the server can control the client to create the target control in the local window. This enables the cloud-side application to control the client's local control on the client, enables direct interaction between the cloud-side application and the client, and helps shorten the path for the cloud-side application to reach users.

Description

Technical Field

[0001] The present application relates to the field of cloud computing technology, and in particular to a control processing method, device, system and storage medium. Background Art

[0002] As cloud computing matures, the trend is shifting from relocating program modules originally hosted on devices to servers, minimizing the size of devices. This has led to the emergence of products like cloud desktops and cloud applications.

[0003] In traditional cloud desktops or cloud applications, cloud applications or applications running within cloud desktops run in the cloud environment. The application screens of cloud-side applications in the cloud environment are transmitted to the client via a streaming protocol. Cloud applications and applications running within cloud desktops are collectively referred to as cloud-side applications. Based on the received streaming data, the client displays the application screens and screen controls. The screens and controls displayed on the client are projections of the screens in the cloud environment.

[0004] In traditional cloud desktops or cloud applications, the screens and controls displayed on the client are projections of the screens in the cloud environment. Because the screens and controls are controlled by the server, when users operate the controls, the server needs to control the controls, resulting in a long path for cloud-side applications to reach users. Summary of the Invention

[0005] In view of the technical problems existing in the above-mentioned traditional cloud-side applications, multiple aspects of this application provide a control processing method, device, system and storage medium to enable the cloud-side application to control the client to create controls locally on the client, which helps to shorten the path for the cloud-side application to reach users.

[0006] The present invention provides a control processing method applicable to a server of a cloud-side application. The method includes:

[0007] Determining a target control to be displayed on a client of the cloud-side application from controls associated with the cloud-side application;

[0008] Obtaining pre-configured UI configuration information of the target control;

[0009] Based on the UI configuration information, the client is controlled to create the target control in the first window.

[0010] The present application also provides a control processing method applicable to a client of a cloud-side application, the method comprising:

[0011] Receive a control creation instruction sent by the server of the cloud-side application;

[0012] Obtaining user interface UI configuration information of the target control associated with the cloud-side application from the control creation instruction;

[0013] Based on the UI configuration information, the target control is created in the first window.

[0014] The embodiment of the present application further provides a data processing system, comprising: a client of a cloud-side application, and a server of the cloud-side application;

[0015] The client is used to execute the steps of the above-mentioned control processing method for the client of the cloud-side application;

[0016] The server is used to execute the steps in the above-mentioned control processing method for the server of the cloud-side application.

[0017] An embodiment of the present application further provides a computing device, comprising: a memory, a processor, and a communication component; wherein the memory is used to store a computer program;

[0018] The processor is coupled to the memory and the communication component, and is used to execute the computer program to execute the steps in the method executed by the client of the above-mentioned cloud-side application, and / or the steps in the method executed by the server of the above-mentioned cloud-side application.

[0019] An embodiment of the present application also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed by one or more processors, the one or more processors are caused to execute the steps in the method executed by the client of the above-mentioned cloud-side application, and / or the steps in the method executed by the server of the above-mentioned cloud-side application.

[0020] In an embodiment of the present application, the server of the cloud-side application can determine the target control to be displayed on the client from the controls associated with the cloud-side application, and obtain the UI configuration information of the pre-configured target control. Afterwards, based on the UI configuration information, it can control the client to create the target control in the local window, thereby enabling the cloud-side application to control the client's local control on the client, enabling the cloud-side application to interact directly with the client, and helping to shorten the path for the cloud-side application to reach users. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0022] Figure 1 Schematic diagram of the interaction process of the cloud desktop system or cloud application system provided by traditional solutions;

[0023] Figure 2A schematic diagram of the interaction flow of the data processing system provided in an embodiment of the present application;

[0024] Figure 3 A schematic diagram of the control display effect provided in an embodiment of the present application;

[0025] Figure 4 A schematic diagram of a flow chart of control processing performed by a data processing system provided in an embodiment of the present application;

[0026] Figure 5 A schematic diagram of another control display effect provided in an embodiment of the present application;

[0027] Figure 6 and Figure 7 A flowchart of a control processing method provided in an embodiment of the present application;

[0028] Figure 8 A schematic diagram of the structure of a computing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] To make the purpose, technical solutions, and advantages of this application more clear, the technical solutions of this application will be clearly and completely described below in conjunction with the specific embodiments of this application and the corresponding drawings. Obviously, the embodiments described are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0030] Figure 1 The interactive flow diagram of the data processing system provided by the traditional solution. The data processing system can be a cloud desktop system or a cloud application system. Figure 1 As shown, the data processing system may include: a client 10 of a cloud-side application, and a server 20 of a cloud-side application.

[0031] In this embodiment, cloud-side applications refer to applications deployed in a cloud environment. These can be cloud applications or applications running within a cloud desktop. Cloud applications are the embodiment of cloud computing technology at the application layer. The operating principle of cloud applications transforms the traditional "local installation and local computing" approach to software into a "ready-to-use" service. Clients do not need to install the corresponding software and can connect to and control remote service clusters via the internet or local area network to complete transaction logic or computing tasks.

[0032] Cloud desktop is based on the implementation of virtualization technology on computer hardware resources, so that they are virtualized into multiple virtual computers, and the desktop operating system without any modification can be directly run on the virtual computers. At the same time, the cloud desktop also provides an operating system that supports virtualization technology, and virtualized applications can run directly on this desktop operating system. The applications running in the cloud desktop refer to the applications running in the desktop operating system. The applications running in the cloud desktop can be applications with a user interface (UI), such as instant messaging applications, online shopping applications, social applications, and email applications, etc. Of course, the applications running in the cloud desktop can also be applications without UI, such as background scripts and system services running in the cloud desktop.

[0033] In the embodiments of the present application, the client 10 refers to an electronic device used by a user that has functions such as communication, and may be, for example, a mobile phone, tablet computer, personal computer, wearable device, or Internet of Things (IoT) device. Of course, the client 10 may also be a thin client such as a set-top box. The client 10 typically includes at least one processing unit and at least one memory. The client 10 also includes basic configurations such as a network card chip, an IO bus, audio and video components, and a display component. Optionally, depending on the implementation form of the client 10, it may also include some peripheral devices, such as a keyboard, a mouse, an input pen, a printer, etc. Generally, the client 10 includes a display component.

[0034] In the embodiment of the present application, the server 20 refers to a computer device that can provide cloud-side application services, and generally has the ability to undertake and guarantee services. The server 20 can respond to the service request of the client 10 and provide users with services related to cloud-side applications. The server 20 can be a single server device, a cloud-based server array, or a virtual machine (VM) running in a cloud-based server array. In addition, the server 20 can also refer to other computing devices with corresponding service capabilities, such as computers and other terminal devices (running service programs), etc.

[0035] The connection between the client 10 and the server 20 may be wireless or wired. Optionally, the client 10 can be connected to the server 20 through a mobile network. Accordingly, the network standard of the mobile network can be any one of 2G (such as Global System for Mobile Communications (GSM)), 2.5G (such as General Packet Radio Service (GPRS)), 3G (such as Wideband Code Division Multiple Access (WCDMA), Time Division-Synchronous Code Division Multiple Access (TD-SCDMA), Code Division Multiple Access 2000 (CDMA2000), Universal Mobile Telecommunications System (UTMS)), 4G (such as Long Term Evolution (LTE)), 4G+ (such as upgraded version of Long Term Evolution (LTE-Advanced, LTE-A)), 5G, World Interoperability for Microwave Access (WiMax), etc. Optionally, the client 10 may also be connected to the server 20 via Bluetooth, Wireless Fidelity (WiFi), infrared, or the like.

[0036] like Figure 1 As shown, for the cloud desktop system, the server 20 is deployed with cloud desktop applications and other applications running in the cloud desktop. There may be one or more applications running in the cloud desktop. Multiple refers to two or more. Multiple applications can be deployed on the same physical machine or on different physical machines. For the cloud application system, the server 20 is deployed with cloud application applications. There may also be one or more cloud application applications. In the embodiments of the present application, the implementation form of the cloud application is not limited. Optionally, the cloud application may be a web page, client software, an application (Application, APP) or a mini-program, etc.

[0037] In a traditional solution, whether it is an application running in a cloud desktop or a cloud application, when using it, the user can request the cloud-side application service through the client 10. Specifically, the client 10 can respond to the user's start operation for the cloud-side application and initiate a start request to the server 20, which is used to request to start the cloud-side application.

[0038] The server 20 can start the cloud-side application in response to the start request, render the cloud-side application screen locally, and then send the cloud-side application screen to the client 10 through streaming technology. The client 10 displays the cloud-side application screen based on the obtained streaming data.

[0039] In real-world applications, cloud-side application screens are associated with controls. Controls are user interface (UI) controls that allow users to interact with the client. For example, controls can be buttons, text boxes, and file upload controls.

[0040] In the traditional solution, for any screen A, the cloud-side application on the server 20 side can display screen A on the server 20 and determine the controls associated with screen A. Then, based on the control configuration information of the controls associated with screen A, the controls associated with screen A can be created on the server 20 ( Figure 1 In step 1 ("Create controls, display controls in the cloud environment"), screen A and its associated controls are displayed in the cloud environment of server 20. The target control is a physical control, specifically a specific UI layout. Specifically, the cloud-side application on server 20 displays screen A in the cloud environment and creates controls, so that the screen and controls are displayed in the cloud environment.

[0041] When the control associated with screen A needs to be transmitted to the client 10, the server 20 can send screen A and the target control of screen A to the client 10 through the streaming technology ( Figure 1 Step 2: “Streaming the screen A and the controls”. The server 20 provides a streaming service that streams the screen A and the target controls to the client 10 using streaming media technology.

[0042] Specifically, the streaming service in the server 20 can compress the screen A and the target control of the screen A through data compression technology, and send the compressed screen and target control to the client 10 through streaming technology.

[0043] The client 10 can locally display the screen A and the target control of the screen A ( Figure 1Step 3: "Displaying Screen A and Controls"). Screen A and the target controls are actually drawn on the server 20. Screen A and the target controls displayed on the client 10 are a projection of the screen and controls displayed on the server 20. Typically, the client 10 receives compressed streaming data of the screen and the target controls. Therefore, the resolution of the screen and controls displayed on the client 10 is relatively low.

[0044] On the other hand, since the screen and controls are controlled on the server side, when the user zooms in or out of the screen, the projection of the control on the client may be moved outside the display window of the client 10, causing the user to be unable to operate the target control, resulting in a poor user experience.

[0045] In order to solve the technical problems existing in the above-mentioned traditional solutions, in some embodiments of the present application, the server of the cloud-side application can determine the target control to be displayed on the client from the controls associated with the cloud-side application, and obtain the UI configuration information of the pre-configured target control. After that, based on the UI configuration information, the server can control the client to create the target control in the local window, thereby realizing that the cloud-side application controls the client's local control on the client, and realizing that the cloud-side application can interact directly with the client, which helps to shorten the path for the cloud-side application to reach users.

[0046] Since the controls are drawn directly on the client rather than projected in the cloud, this helps improve the resolution and clarity of the controls displayed on the client.

[0047] Since the controls are drawn locally on the client, users operate the controls directly on the client, which shortens the link from the cloud-side application triggering the user and helps reduce the response delay of subsequent control operations.

[0048] The following describes in detail the technical solutions provided by various embodiments of the present application in conjunction with the accompanying drawings.

[0049] It should be noted that the same reference numerals denote the same objects in the following drawings and embodiments, and therefore, once an object is defined in one drawing or embodiment, it does not need to be further discussed in the subsequent drawings and embodiments.

[0050] Figure 2 This is a schematic diagram of the interaction process of the cloud-side application system provided in the embodiment of the present application. Figure 1 The relevant content will not be repeated here.

[0051] In this embodiment, to decouple the screen and controls of the cloud-side application, in some embodiments, the cloud-side application developer can configure associated controls for the cloud-side application during the cloud-side application development phase. The controls configured for the cloud-side application can be controls for operating the cloud-side application, such as a start control, exit control, or stop control for the cloud-side application. The start control is used to start the cloud-side application. The exit control is used to exit the cloud-side application. The stop control is used to stop the cloud-side application.

[0052] Of course, the controls associated with the cloud-side application can also be controls configured for the screen of the cloud-side application, that is, controls associated with the screen. For example, Figure 3 The middle screen is a QR code screen; the control associated with this screen is "Save QR Code", which is used to guide the user to save the content "QR Code" on the screen.

[0053] A control has UI-related information, such as its style, display location, and content. The control's style may include its icon, shape, color, and size. In some embodiments, during the cloud-side application development phase, cloud-side application developers may write the cloud-side application's associated controls and their UI configuration information into the cloud-side application. This UI configuration information describes the control's UI layout and may include its style, display location, and displayed content.

[0054] The cloud-side application can store the control identifier and the UI configuration information of the control. In this way, when the server 20 runs the cloud-side application, the server 20 can obtain the control identifier and the UI configuration information of the control.

[0055] Since the control is used for human-computer interaction with the user of the cloud-side application, when the user triggers the control, the response operation associated with the control will be triggered. The developer of the cloud-side application can also configure the response behavior data of the control. Among them, the response behavior data of the control is used to describe the response operation caused by the control being triggered. For example, the above Figure 3 For example, the response action for the "Save QR Code" control in the middle is: trigger the "Save QR Code" control to save the QR code on the screen. For another example, the response action for the "Launch Control" corresponding to the cloud-side application is: trigger the launch control to launch the cloud-side application, and so on.

[0056] Based on this, the developer of the cloud-side application can also write the identifier of the control configured by the cloud-side application and the response behavior data of the control into the cloud-side application. When the server 20 runs the cloud-side application, the identifier of the control and the response behavior data of the control can be obtained from the cloud-side application.

[0057] In an embodiment of configuring a control for a certain page or screen of a cloud-side application, the developer of the cloud-side application can configure the control for the cloud-side application, configure UI configuration information and response behavior data for the control, and write the identifier of the target page, the identifier of the control configured for the page, the UI configuration information and response behavior data of the control into the cloud-side application. When the server 20 runs the cloud-side application, it can obtain the identifier of the target page, the identifier of the control on the target page, the UI configuration information and response behavior data of the control, etc. from the cloud-side application.

[0058] For cloud-side application developers, the previous inability to perceive the cloudification of their applications, which limited them to using the capabilities of the cloud operating system, has now enabled them to utilize both the computing power of the cloud environment and the capabilities of the user's local system. This optimizes the interactive experience and gives applications greater freedom. Cloud-oriented applications or desktops can leverage the computing power of the cloud system while adapting to the client-side system layout.

[0059] Based on the pre-configured controls and UI configuration information of the controls in the above embodiment, the embodiment of the present application provides a solution for drawing controls on the client side of the cloud application in a cloud side application scenario. Figure 2 An exemplary description is given.

[0060] like Figure 2 and Figure 4 As shown, the server 20 runs a cloud-side application. For the server 20, the target control (corresponding to the target control to be displayed on the client 10 of the cloud-side application) can be determined from the controls associated with the cloud-side application. Figure 2 Step 1 and Figure 4 Step 1) Specifically, the cloud-side application in the server 20 may determine a target control to be displayed on the client 10 of the cloud-side application from controls associated with the cloud-side application.

[0061] In some embodiments, the target control is a control that operates the cloud-side application itself, such as a start control, an exit control, and a stop control. Accordingly, the cloud-side application in the server 20 can use the identifier of the cloud-side application to determine a control that represents the operation of the cloud-side application from the controls associated with the cloud-side application as the target control. For example, Figure 5 In FIG, the “ball” control represents a control for starting an anti-virus software. When the control is triggered, the anti-virus software can be started to perform a security check on the client 10.

[0062] In other embodiments, the target control may be a control associated with the screen of the cloud-side application, such as a control for operating the screen of the cloud-side application, or a control for guiding the operation of the screen of the cloud-side application, etc. Figure 3The "Save QR Code" control for saving the "QR Code" of the screen content is shown in FIG. In this embodiment, the cloud application in the server 20 can determine the screen to be transmitted based on the running process of the cloud-side application on the local side. The screen to be transmitted refers to the screen to be transmitted to the client 10, generally the screen to be displayed by the cloud-side application. Furthermore, based on the identifier of the screen to be transmitted, the control associated with the screen to be transmitted can be determined from the controls associated with the cloud-side application as the target control.

[0063] Optionally, according to the identifier of the screen to be transmitted, a pre-configured control for guiding the operation of the screen to be transmitted may be determined from controls associated with the cloud-side application as the target control.

[0064] After determining the target control, the server 20 can obtain the pre-configured UI configuration information of the target control. Specifically, the cloud-side application in the server 20 can obtain the pre-configured UI configuration information of the target control. For the process of configuring UI information for the control, please refer to the relevant content of the above embodiment and will not be repeated here.

[0065] Accordingly, the server 20 can obtain the UI configuration information of the target control (corresponding to Figure 2 Step 2) Specifically, the cloud-side application in the server 20 can obtain the control corresponding to the running process according to its own running process as the target control, and obtain the UI configuration information of the target control.

[0066] Furthermore, the server 20 can control the client 10 to create a target control (corresponding to Figure 2 In steps 3 and 4, the target control created by the client 10 is a UI entity control. The client 10 can display the target control.

[0067] In this embodiment, to enable the server 20 to control the client 10 in drawing controls, an application programming interface (API) related to control processing can be added to the server 20. This API is an interface for controlling the client 10. In this embodiment, the API can be an API in the client operating system (Guest Operating System, Guest OS) of the cloud environment. The Guest OS can be the operating system installed on the virtual machine of the server 20.

[0068] Based on the above API, the cloud-side application in the server 20 can call the above API to control the client 10 to create a display window, enabling the cloud-side application to directly interact with the client, which helps shorten the path for the cloud-side application to reach users.

[0069] Specifically, the server 20 may encapsulate the UI configuration information of the target control into a control creation instruction according to a network transmission protocol. The network transmission protocol may be the Transmission Control Protocol (TCP) or the Hypertext Transfer Protocol (HTTP). Furthermore, the server 20 may send the control creation instruction to the client 10.

[0070] Specifically, if Figure 4 As shown in steps 3 and 4, the cloud-side application in the server 20 can call the API of the above embodiment, encapsulate the UI configuration information of the target control into a control creation instruction according to the network transmission protocol; and send the control creation instruction to the client 10 through the API.

[0071] The client 10 may receive the control creation instruction and obtain the UI configuration information of the target control from the control creation instruction. Further, the client 10 may create the target control in the local first window based on the UI configuration information ( Figure 4 Step 5).

[0072] In this embodiment, the cloud-side application server can determine the target control to be displayed on the client from the controls associated with the cloud-side application and obtain the pre-configured UI configuration information of the target control. Based on the UI configuration information, it can then control the client to create the target control in the local window. This allows the cloud-side application to control the client's local control, enabling direct interaction between the cloud-side application and the client, helping to shorten the path for the cloud-side application to reach users. Because the control is drawn directly on the client, rather than projected in the cloud environment, it helps improve the resolution and clarity of the control displayed on the client.

[0073] Since the controls are drawn locally on the client, users operate the controls directly on the client, which shortens the link from the cloud-side application triggering the user and helps reduce the response delay of subsequent control operations.

[0074] In embodiments where the target control is a control associated with a screen to be transmitted in a cloud-side application, the server 20 may also use streaming media technology to send the screen to be transmitted to the client 10. Specifically, the cloud-side application in the server 20 may locally display the screen to be transmitted; the server 20 may compress the screen to be transmitted to obtain a compressed screen to be transmitted; and then, using streaming media technology, the compressed screen to be transmitted may be sent to the client 10. The client 10 may display the screen to be transmitted in a local display window.

[0075] The display window and the target control's display window are independent windows. The display window of the image to be transferred is defined as the second window, while the display window of the target control is defined as the first window. The first and second windows are independent windows. The first window can float above the second window. Because the display window of the image and the control are independent, user operations on the image to be transferred do not affect the display of the target control.

[0076] For example, a user may adjust the size of the image to be transmitted, such as by enlarging or reducing it. In response to an operation event on the image to be transmitted, the client 10 may obtain operation behavior data associated with the operation event. This operation behavior data may include the operation type of the operation event, the window location of the operation event, and so on. The operation type of the operation event can be understood as the form of window manipulation performed by the user, such as a right-click, a double-click, keyboard input, or zooming in or out. Furthermore, the client 10 may provide the operation data to the server 20. Based on the operation data, the server 20 may adjust the image to be transmitted to obtain an adjusted image to be transmitted. Furthermore, the server 20 may transmit the adjusted image to the client 10 using streaming media technology. The client 10 may display the adjusted image to be transmitted. During the zooming and resizing of the image to be transmitted, the display window of the target control on the client 10 does not change as the image to be transmitted is resized. This prevents the target control from moving outside the display window due to the user's zooming operation, thereby reducing the probability or risk of the user being unable to operate the target control.

[0077] Since the target control is a human-computer interaction control, it is generally used for human-computer interaction with the user of the cloud-side application. When the user operates the control, the response operation associated with the control will be triggered. Figure 1 In the conventional solution shown, the user operates the control (corresponding to Figure 1 Step 4), the client 10 can obtain the operation event for the target control and send the operation event to the server 20 (corresponding to Figure 1 Step 5) The operation event may include: operation behavior data of the target control. For a description of the operation behavior data, please refer to the relevant content of the above embodiment, which will not be repeated here.

[0078] At the server 20, the streaming service receives the operation event and transmits the operation event to the cloud-side application (corresponding to Figure 1 Step 6). The cloud-side application in the server 20 can respond to the operation event and obtain the operation behavior data for the target control; and based on the operation behavior data, respond to the operation event of the target control and obtain the response result data (corresponding to Figure 1Step 7 "response operation event"), and transmit the response result data to the client 10 (corresponding to the response result data) through the streaming service in the server 20 through the streaming technology. Figure 1 Steps 8 and 9). The client 10 may output the response result data (corresponding to Figure 1 Step 10).

[0079] For example, the target control is the launch control corresponding to the cloud-side application. Operation behavior data may include, for example, a left-click of the mouse and the click location being the target control. Accordingly, server 20 may launch the cloud-side application based on the left-click and click location being the target control, and display the cloud-side application's homepage. Furthermore, server 20 may use streaming technology to send the cloud-side application's homepage to client 10. Client 10 may then display the cloud-side application's homepage.

[0080] In the above Figure 1 In the traditional embodiment shown, after the user operates the target control, the operation event needs to be sent to the cloud environment through the network before the cloud-side application in the server 20 can respond. After the server 20 responds, the response result is sent to the client 10, resulting in a large delay in the operation response of the target control.

[0081] In order to solve this technical problem, Figure 2 As shown, in this embodiment, the developer of the cloud-side application can also pre-configure the response behavior data of the target control and write the response behavior data of the target control into the cloud-side application. For the specific implementation of this part, please refer to the relevant content of the above embodiment and will not be repeated here.

[0082] Based on the above pre-configured control response behavior data, the server 20 can also obtain the pre-configured target control response behavior data ( Figure 4 Step 2); and based on the response behavior data, control the client 10 to configure the response operation of the operation event management of the target control.

[0083] Specifically, the cloud-side application in the server 20 can also encapsulate the UI configuration information and response behavior data of the target control into a control creation instruction; and send the control creation instruction to the client 10 (corresponding to Figure 4 Step 3 and step 4). Specifically, Figure 4 As shown in steps 3 and 4, the cloud-side application can call an API to send a control creation instruction to the client 10 via a network transmission protocol.

[0084] The client 10 can receive the control creation instruction and obtain the UI configuration information and response behavior data of the target control from the control creation instruction. Afterwards, the client 10 can create the target control in the local window based on the UI configuration information; and configure the response operation (corresponding to the response behavior data) for the target control based on the response behavior data. Figure 4 Step 5). In this way, when the target control is operated by the user (corresponding to Figure 4 Step 6), the client 10 can respond to the operation event for the target control, execute the corresponding response operation of the target control and output the response result (corresponding to Figure 4 Step 7). In this way, users can directly operate the local client controls, and the client responds to the control operation events, which can shorten the response chain of control operation events and further reduce the response delay time in cloud-side application scenarios, helping to improve user experience.

[0085] Further, if Figure 4 As shown in steps 8 and 9, the client 10 can also send the operation event for the target control to the server 20. The server 20 can receive the operation event through the API and transmit the operation event to the cloud-side application. The cloud-side application can respond to the operation event and execute subsequent interaction logic, etc. (corresponding to Figure 4 Step 10).

[0086] Of course, in this embodiment, it is also possible not to configure a response operation for the target control's operation event. In this embodiment, the client 10 can respond to the operation event for the target control, determine the operation behavior data for the operation event management, and return the operation behavior data to the server 20. The server 20 can obtain the operation behavior data for the target control and respond to the operation event of the target control based on the operation behavior data.

[0087] In addition to the above-mentioned system embodiment, the embodiment of the present application also provides a control processing method. The control processing method provided by the embodiment of the present application is exemplarily described below.

[0088] Figure 6 This is a flow chart of the control processing method provided in the embodiment of the present application. This method is applicable to the server of the cloud-side application. Figure 6 As shown, the control processing method mainly includes:

[0089] 601. Determine a target control to be displayed on a client of the cloud-side application from controls associated with the cloud-side application.

[0090] 602. Obtain UI configuration information of a pre-configured target control.

[0091] 603. Based on the UI configuration information, the control client creates a target control in the first window.

[0092] In this embodiment, the cloud-side application developer pre-configures the associated controls for the cloud-side application. A control has UI-related information, such as the control's style, display location, and content. The control's style may include its icon, shape, color, and size. Based on this, the cloud-side application developer can pre-write the controls associated with the cloud-side application and their UI configuration information into the cloud-side application. This UI configuration information refers to information describing the control's UI layout, and may include the control's style, display location, and displayed content.

[0093] Because controls are used for human-computer interaction with cloud-side application users, triggering a control triggers the control's associated response action. Cloud-side application developers can also configure control response behavior data. During the cloud-side application development phase, control response behavior data can be written to the cloud-side application. Control response behavior data describes the response action caused by the control being triggered.

[0094] In the embodiment of configuring a control for a certain page or screen of a cloud-side application, the cloud-side application developer may also specify a target page, configure a control for that page, and configure UI configuration information and response behavior data for the control. Accordingly, the cloud-side application developer may also pre-write the identifier of the selected target page, the identifier of the control configured for that page, and the UI configuration information and response behavior data of the control into the cloud-side application.

[0095] Based on the pre-configured controls and UI configuration information of the controls in the above embodiment, the embodiment of the present application provides a solution for drawing controls on the client side of the cloud application in a cloud side application scenario. Figure 6 An exemplary description is given.

[0096] exist Figure 6 In the example, a cloud-side application is running on the server. In step 601, the server may determine a target control to be displayed on the client of the cloud-side application from the controls associated with the cloud-side application. Specifically, the cloud-side application on the server may determine a target control to be displayed on the client of the cloud-side application from the controls associated with the cloud-side application.

[0097] In some embodiments, the target control is a control that operates the cloud-side application itself, such as a start control, an exit control, or a stop control. Accordingly, based on the identifier of the cloud-side application, a control representing the operation on the cloud-side application can be determined from controls associated with the cloud-side application as the target control.

[0098] In other embodiments, the target control may be a control associated with a screen of a cloud-side application, such as a control for operating a screen of a cloud-side application, or a control for guiding operations on a screen of a cloud-side application. In this embodiment, the screen to be transmitted may be determined based on the running process of the local cloud-side application. The screen to be transmitted refers to the screen to be transmitted to the client, generally the screen to be displayed by the cloud-side application. Furthermore, based on the identifier of the screen to be transmitted, a control associated with the screen to be transmitted may be determined from the controls associated with the cloud-side application as the target control.

[0099] Optionally, according to the identifier of the screen to be transmitted, a pre-configured control for guiding the operation of the screen to be transmitted may be determined from controls associated with the cloud-side application as the target control.

[0100] After determining the target control, the pre-configured UI configuration information of the target control may be obtained in step 602. Specifically, the cloud-side application may determine the target control corresponding to the running process based on its own running process and obtain the UI configuration information of the target control.

[0101] Furthermore, in step 603, based on the UI configuration information, the control client may create a target control in the display window (defined as the first window). The target control is a UI entity control and may be displayed.

[0102] In this embodiment, to enable the server to control the client's control drawing, an API related to control processing can be added to the server. This API is an interface for controlling the client. Based on this API, the server's cloud-side application can call the API to control the client's creation of a display window, enabling direct interaction between the cloud-side application and the client, which helps shorten the path for the cloud-side application to reach users.

[0103] Specifically, the UI configuration information of the target control can be encapsulated into a control creation instruction according to a network transmission protocol. The network transmission protocol can be TCP or HTTP. Further, the control creation instruction can be sent to the client.

[0104] Specifically, the cloud-side application can call the API of the above embodiment and send the control creation instruction to the client through the API.

[0105] For the client, you can execute the following Figure 7 The control processing method shown is used to create the target control. Figure 7 The control processing method shown is applicable to the client of the cloud side application. Figure 7 As shown, the method mainly includes:

[0106] 701. Receive a control creation instruction sent by a cloud-side application server.

[0107] 702. Obtain UI configuration information of the target control associated with the cloud-side application from the control creation instruction.

[0108] 703. Create a target control in the first window based on the UI configuration information.

[0109] exist Figure 7 In step 701, the client may receive a control creation instruction, and obtain UI configuration information of a target control from the control creation instruction in step 702. Further, in step 703, the target control may be created in a local first window based on the UI configuration information.

[0110] In this embodiment, the cloud-side application server can determine the target control to be displayed on the client from the controls associated with the cloud-side application and obtain the pre-configured UI configuration information of the target control. Based on the UI configuration information, it can then control the client to create the target control in the local window. This allows the cloud-side application to control the client's local control, enabling direct interaction between the cloud-side application and the client, helping to shorten the path for the cloud-side application to reach users. Because the control is drawn directly on the client, rather than projected in the cloud environment, it helps improve the resolution and clarity of the control displayed on the client.

[0111] Since the controls are drawn locally on the client, users operate the controls directly on the client, which shortens the link from the cloud-side application triggering the user and helps reduce the response delay of subsequent control operations.

[0112] For embodiments where the target control is a control associated with a screen to be transmitted in a cloud-side application, the server can also use streaming media technology to send the screen to be transmitted to the client. Specifically, the cloud-side application on the server can locally display the screen to be transmitted; the streaming service on the server can compress the screen to be transmitted to obtain a compressed screen to be transmitted; then, the compressed screen to be transmitted can be sent to the client using streaming media technology. The client can display the screen to be transmitted in a local display window.

[0113] The display window and the target control's display window are independent windows. The display window of the image to be transferred is defined as the second window, while the display window of the target control is defined as the first window. The first and second windows are independent windows. The first window can float above the second window. Because the display window of the image and the control are independent, user operations on the image to be transferred do not affect the display of the target control.

[0114] For example, the user can adjust the size of the picture to be transmitted, such as enlarging or reducing the picture to be transmitted. The client can obtain the operation behavior data associated with the operation event in response to the operation event on the picture to be transmitted. Further, the client can provide the operation data to the server. The server can adjust the picture to be transmitted based on the operation data to obtain an adjusted picture to be transmitted. Furthermore, the adjusted picture to be transmitted can be transmitted to the client through streaming media technology. The client can display the adjusted picture to be transmitted. During the scaling adjustment process of the picture to be transmitted, the display window of the target control of the client does not change with the scaling of the picture to be transmitted, which can avoid the target control moving outside the display window due to the user's scaling operation on the picture, thereby reducing the probability or risk of the user being unable to operate the target control.

[0115] Since the target control is a human-computer interaction control, and is generally used for human-computer interaction with users of cloud-side applications, user operation of the control triggers the response operation associated with the control. In traditional solutions, when a user operates a control, the client can obtain an operation event for the target control and send the operation event to the server. The operation event may include: operation behavior data for the target control. For a description of the operation behavior data, please refer to the relevant content of the above embodiment and will not be repeated here.

[0116] On the server side, the streaming service receives the operation event and transmits it to the cloud-side application server. The cloud-side application on the server side can respond to the operation event and obtain the operation behavior data for the target control. Based on the operation behavior data, it responds to the operation event of the target control, obtains the response result data, and transmits the response result data to the client through the streaming service on the server side using streaming media technology. The client can then output the response result data.

[0117] In the above-mentioned traditional embodiment, after the user operates the target control, the operation event needs to be sent to the cloud environment through the network before the cloud-side application in the server can respond. After the server responds, the response result is sent to the client, resulting in a large delay in the operation response of the target control.

[0118] In order to solve this technical problem, in this embodiment, the developer of the cloud-side application can also pre-configure the response behavior data of the target control. For the specific implementation of this part, please refer to the relevant content of the above embodiment and will not be repeated here.

[0119] Based on the above pre-configured control response behavior data, the server can also obtain the pre-configured target control response behavior data when sending a control creation instruction; and based on the response behavior data, control the client to configure the response operation of the target control's operation event management.

[0120] Specifically, the server can also encapsulate the UI configuration information and response behavior data of the target control into a control creation instruction, and send the control creation instruction to the client via a network transmission protocol. Specifically, the cloud-side application can call an API to send the control creation instruction to the client via a network transmission protocol.

[0121] The client can receive the control creation instruction and obtain the UI configuration information and response behavior data of the target control from the control creation instruction. Afterwards, the target control can be created in the local window based on the UI configuration information; and the response operation can be configured for the target control based on the response behavior data. In this way, when the target control is operated by the user, the client can respond to the operation event for the target control, execute the response operation corresponding to the target control, and output the response result. The user can directly operate the local control of the client, and the client responds to the operation event of the control, which can shorten the response link of the control operation event, thereby reducing the response delay time in the cloud-side application scenario, which helps to improve user experience.

[0122] Furthermore, the client can send action events for the target control to the server. The server can receive the action events through the API and transmit them to the cloud-side application. The cloud-side application can respond to the action events and execute subsequent interaction logic.

[0123] Of course, in this embodiment, it is also possible not to configure a response operation for the target control's operation event. In this embodiment, the client can respond to the operation event for the target control, determine the operation behavior data managed by the operation event, and return the operation behavior data to the server. The server can obtain the operation behavior data for the target control and respond to the operation event of the target control based on the operation behavior data.

[0124] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0125] It should be noted that the execution entity of each step of the method provided in the above embodiment can be the same device, or the method can be executed by different devices. For example, the execution entity of steps 601 and 602 can be device A; for another example, the execution entity of step 601 can be device A, and the execution entity of step 602 can be device B; and so on.

[0126] In addition, some of the processes described in the above embodiments and the accompanying drawings include multiple operations that appear in a specific order. However, it should be clearly understood that these operations may not be executed in the order in which they appear in this document or may be executed in parallel. The sequence numbers of the operations, such as 601, 602, etc., are merely used to distinguish between different operations and do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed sequentially or in parallel.

[0127] Accordingly, an embodiment of the present application also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed by one or more processors, the one or more processors are caused to execute the steps in the above-mentioned control processing methods.

[0128] Figure 8 This is a schematic diagram of the structure of the computing device provided in the embodiment of the present application. Figure 8 As shown, the computing device includes: a memory 80a, a processor 80b and a communication component 80c. The memory 80a is used to store computer programs.

[0129] In some embodiments, the computing device can be implemented as a server of a cloud-side application. Accordingly, the processor 80b is coupled to the memory 80a and the communication component 80c and is configured to execute a computer program to: determine a target control to be displayed on a client of the cloud-side application from controls associated with the cloud-side application; obtain pre-configured user interface (UI) configuration information of the target control; and control the client, via the communication component 80c, to create the target control in a first window based on the UI configuration information.

[0130] Optionally, when the processor 80b determines the target control to be displayed on the client of the cloud-side application from the controls associated with the cloud-side application, it is specifically used to: determine the screen to be transmitted of the cloud-side application according to the running process of the cloud-side application; determine the control associated with the screen to be transmitted from the controls associated with the cloud-side application according to the identification of the screen to be transmitted as the target control; or determine the control used to represent the operation on the cloud-side application from the controls associated with the cloud-side application according to the identification of the cloud-side application.

[0131] Furthermore, the processor 80b is further configured to: send the image to be transmitted to the client via streaming media technology, so that the client can display the image to be transmitted in the second window; and the first window is suspended above the second window.

[0132] In some embodiments, when the processor 80b controls the client to create a target control in the second window based on the UI configuration information of the target control, it is specifically used to: the cloud-side application sends a control creation instruction to the client; the control creation instruction includes UI configuration information, so that the client responds to the control creation instruction and creates the target control in the first window based on the UI configuration information.

[0133] Optionally, the processor 80b is also used to: obtain pre-configured response behavior data of the target control; based on the response behavior data, control the client to configure the response operation associated with the operation event of the target control, so that the client responds to the triggering of the target control and executes the response operation corresponding to the target control.

[0134] In some embodiments, the processor 80b is further configured to: receive, via the communication component 80c, operation behavior data for the target control returned by the client; and respond to an operation event of the target control based on the operation behavior data.

[0135] In some embodiments of the present application, processor 80b may be implemented as a client of a cloud-side application. Accordingly, processor 80b is coupled to memory 80a and communication component 80c and is configured to execute a computer program to: receive a control creation instruction sent by the cloud-side application server via communication component 80c; obtain, from the control creation instruction, user interface (UI) configuration information of a target control associated with the cloud-side application; and create the target control in a first window based on the UI configuration information. Processor 80b is further configured to display the target control via display component 80d.

[0136] Optionally, the processor 80b is further configured to: obtain response behavior data of the target control from the control creation instruction; configure a response operation for the target control based on the response behavior data; and execute a response operation in response to an operation event for the target control.

[0137] Optionally, the processor 80b is also used to: determine the operation behavior data associated with the operation event in response to the operation event for the target control; return the operation behavior data to the server through the communication component 80c, so that the server can respond to the operation behavior of the target control based on the operation behavior data.

[0138] Optionally, the processor 80b is further configured to: receive, via the communication component 80c, a picture to be transmitted from the server via streaming technology, and display the picture to be transmitted in the second window; and the first window is suspended above the second window.

[0139] In some optional embodiments, such as Figure 8 As shown, the computing device may further include optional components such as a power supply component 80e and an audio component 80f. Figure 8Only some components are shown schematically, and it does not mean that the computing device must include Figure 8 The components shown do not necessarily mean that the computing device can only include Figure 8 Components shown.

[0140] In this embodiment, the server of the cloud-side application can determine the target control to be displayed on the client from the controls associated with the cloud-side application, and obtain the pre-configured UI configuration information of the target control. Afterwards, based on the UI configuration information, it can control the client to create the target control in the local window, thereby enabling the cloud-side application to control the client's local control on the client, enabling the cloud-side application to interact directly with the client, and helping to shorten the path for the cloud-side application to reach users.

[0141] In an embodiment of the present application, the memory is used to store computer programs and can be configured to store various other data to support operations on the device where it is located. The processor can execute the computer program stored in the memory to implement the corresponding control logic. The memory can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random-access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0142] In the embodiment of the present application, the processor can be any hardware processing device that can execute the logic of the above method. Optionally, the processor can be a central processing unit (CPU), a graphics processing unit (GPU) or a microcontroller unit (MCU); it can also be a programmable device such as a field programmable gate array (FPGA), a programmable array logic device (PAL), a general array logic device (GAL), a complex programmable logic device (CPLD); or an application specific integrated circuit (ASIC) chip; or an advanced reduced instruction set (RISC) processor (Advanced RISC Machines, ARM) or a system on chip (SoC), etc., but is not limited thereto.

[0143] In an embodiment of the present application, the communication component is configured to facilitate wired or wireless communication between the device in which it is located and other devices. The device in which the communication component is located can access a wireless network based on a communication standard, such as Wireless Fidelity (WiFi), 2G or 3G, 4G, 5G or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component can also be implemented based on near field communication (NFC) technology, radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra wide band (UWB) technology, Bluetooth (BT) technology or other technologies.

[0144] In an embodiment of the present application, the display component may include a liquid crystal display (LCD) and a touch panel (TP). If the display component includes a touch panel, the display component may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

[0145] In embodiments of the present application, a power supply assembly is configured to provide power to various components of the device in which it is located. The power supply assembly may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device in which the power supply assembly is located.

[0146] In an embodiment of the present application, the audio component may be configured to output and / or input audio signals. For example, the audio component includes a microphone (MIC), and when the device where the audio component is located is in an operating mode, such as call mode, recording mode, and voice recognition mode, the microphone is configured to receive external audio signals. The received audio signal may be further stored in a memory or sent via a communication component. In some embodiments, the audio component further includes a speaker for outputting audio signals. For example, for a device with a language interaction function, voice interaction with the user can be achieved through the audio component.

[0147] It should be noted that the descriptions such as "first" and "second" in this article are used to distinguish different messages, devices, modules, etc., and do not represent the order of precedence, nor do they limit "first" and "second" to different types.

[0148] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, compact disc read-only memory (Compact Disc Read-Only Memory, CD-ROM), optical storage, etc.) that contain computer-usable program code.

[0149] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (or systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0150] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0151] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0152] In a typical configuration, a computing device includes one or more processors (such as a CPU, etc.), input / output interfaces, network interfaces, and memory.

[0153] Memory may include non-permanent storage in a computer-readable medium, random-access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0154] Computer storage media is readable storage media, also known as readable media. Readable storage media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random-access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. According to the definition in this article, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0155] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, commodity, or apparatus comprising the aforementioned elements.

[0156] The above contents are merely embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should all be included within the scope of the claims of the present application.

Claims

1. A control processing method, applicable to a server of a cloud-side application, characterized in that: The method comprises: Determining a target control to be displayed on a client of the cloud-side application from controls associated with the cloud-side application; Obtaining pre-configured UI configuration information of the target control; Based on the UI configuration information, controlling the client to create the target control in the first window specifically includes: The cloud-side application sends a control creation instruction to the client; the control creation instruction includes the UI configuration information, so that the client responds to the control creation instruction and creates the target control in the first window based on the UI configuration information; The control creation instruction also includes pre-configured response behavior data of the target control; Controlling the client to configure a response operation associated with the operation event of the target control based on the response behavior data, so that the client responds to the triggering of the target control and executes the response operation corresponding to the target control; The controls are used to operate cloud-side applications, including start controls, exit controls, and stop controls.

2. The method according to claim 1, characterized in that The determining, from the controls associated with the cloud-side application, a target control to be displayed on the client of the cloud-side application, includes: Determine, according to the running process of the cloud-side application, a screen to be transmitted of the cloud-side application; and determine, according to the identifier of the screen to be transmitted, a control associated with the screen to be transmitted from controls associated with the cloud-side application as the target control; or, According to the identifier of the cloud-side application, a control used to represent an operation on the cloud-side application is determined from controls associated with the cloud-side application as the target control.

3. The method according to claim 2, characterized in that Also includes: Sending the image to be transmitted to the client through streaming technology, so that the client displays the image to be transmitted in a second window; The first window floats above the second window.

4. The method according to any one of claims 1 to 3, characterized in that Also includes: Receiving operation behavior data for the target control returned by the client; Based on the operation behavior data, respond to the operation event of the target control.

5. A control processing method, applicable to a client of a cloud-side application, characterized in that: The method comprises: Receive a control creation instruction sent by the server of the cloud-side application; Obtaining user interface UI configuration information of the target control associated with the cloud-side application from the control creation instruction; Based on the UI configuration information, create the target control in the first window; The method further comprises: Acquire pre-configured response behavior data of the target control from the control creation instruction; Controlling the client to configure a response operation associated with the operation event of the target control based on the response behavior data, so that the client responds to the triggering of the target control and executes the response operation corresponding to the target control; The controls are used to operate cloud-side applications, including start controls, exit controls, and stop controls.

6. The method according to claim 5, characterized in that Also includes: Acquire response behavior data of the target control from the control creation instruction; Based on the response behavior data, configuring a response operation for the target control; In response to the operation event for the target control, the response operation is performed.

7. The method according to claim 6, characterized in that Also includes: In response to an operation event on the target control, determining operation behavior data associated with the operation event; The operation behavior data is returned to the server, so that the server can respond to the operation behavior of the target control based on the operation behavior data.

8. The method according to any one of claims 5 to 7, characterized in that: Also includes: Receiving the picture to be transmitted sent by the server through the streaming technology, and displaying the picture to be transmitted in the second window; The first window floats above the second window.

9. A data processing system, characterized in that: include: The client and server of cloud-side applications; The client is used to perform the steps in the method according to any one of claims 1 to 4; The server is used to execute the steps in the method according to any one of claims 5 to 8.

10. A computing device, characterized in that include: Memory, processor and communication component; wherein the memory is used to store computer programs; The processor is coupled to the memory and the communication component, and is configured to execute the computer program to perform the steps of the method performed by the client in claim 9 and / or the steps of the method performed by the server in claim 9.

11. A computer-readable storage medium storing computer instructions, characterized in that: When the computer instructions are executed by one or more processors, the one or more processors are caused to execute the steps of the method executed by the client in claim 9 and / or the steps of the method executed by the server in claim 9.

Images