Control display method and related device

Abstract

The embodiment of the invention discloses a control display method and a related device, and the method comprises the steps: displaying a first interface of a cloud computer through a cloud computer application, and displaying a virtual operation control deployed based on a first control scheme in the first interface; the first interface is a display interface corresponding to a first process in the cloud computer, and the first control scheme corresponds to the first process; in response to a process switching operation triggered by the cloud computer application, displaying a second interface of the cloud computer, and displaying a virtual operation control deployed based on a second control scheme in the second interface; the second interface is a display interface corresponding to a second process indicated by the process switching operation, the second control scheme is a control scheme corresponding to the second process and determined on the basis of a target mapping relation, and the target mapping relation is used for indicating control schemes corresponding to various processes respectively. Through the control display method disclosed by the embodiment of the invention, the switching efficiency of the control scheme can be improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a control display method and related devices. Background Art

[0002] Cloud PC is an overall service solution that includes cloud resources, transmission protocols and cloud terminals. Cloud PC can bring the powerful computing power of remote cloud devices to low-configuration terminals (such as mobile phones, etc.) through the network. In this way, users can use low-configuration terminals to experience high-quality, complex applications (such as game programs that require a high operating environment, etc.) without having to purchase expensive high-end equipment.

[0003] In the related art, users can install cloud computer applications on their own terminals, and then access their personal cloud computer desktops, cloud computer data, and applications on the cloud computer through the cloud computer applications. However, when using the cloud computer applications, users need to manually switch the control scheme on the cloud computer applications according to the switching of processes on the cloud computer, so as to adjust the virtual operation controls applicable to the process before the switching to the virtual operation controls applicable to the process after the switching.

[0004] It can be seen that the control schemes on cloud computer applications cannot be switched intelligently at present, and the operations required for users to manually switch the control schemes on cloud computer applications are cumbersome and complicated, with low switching efficiency and poor operating experience. Summary of the invention

[0005] The embodiments of the present application provide a control display method and related devices, which can improve the switching efficiency of control solutions.

[0006] In view of this, the first aspect of the present application provides a control display method, the method comprising:

[0007] Displaying a first interface of the cloud computer through a cloud computer application, and displaying a virtual operation control deployed based on a first control scheme in the first interface; the first interface is a display interface corresponding to a first process in the cloud computer, and the first control scheme corresponds to the first process;

[0008] In response to a process switching operation triggered by the cloud computer application, a second interface of the cloud computer is displayed, and virtual operation controls deployed based on a second control scheme are displayed in the second interface; the second interface is a display interface corresponding to the second process indicated by the process switching operation, and the second control scheme is a control scheme corresponding to the second process determined based on a target mapping relationship, and the target mapping relationship is used to indicate the control schemes corresponding to multiple processes.

[0009] A second aspect of the present application provides a control display device, the device comprising:

[0010] A first display module, used to display a first interface of the cloud computer through a cloud computer application, and to display virtual operation controls deployed based on a first control scheme in the first interface; the first interface is a display interface corresponding to a first process in the cloud computer, and the first control scheme corresponds to the first process;

[0011] A second display module is used to respond to a process switching operation triggered by the cloud computer application, display a second interface of the cloud computer, and display virtual operation controls deployed based on a second control scheme in the second interface; the second interface is a display interface corresponding to the second process indicated by the process switching operation, and the second control scheme is a control scheme corresponding to the second process determined based on a target mapping relationship, and the target mapping relationship is used to indicate the control schemes corresponding to multiple processes.

[0012] A third aspect of the present application provides a computer device, the device comprising a processor and a memory:

[0013] The memory is used to store computer programs;

[0014] The processor is used to execute the steps of the control display method as described in the first aspect according to the computer program.

[0015] A fourth aspect of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, and the computer program is used to execute the steps of the control display method described in the first aspect above.

[0016] In a fifth aspect, the present application provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the steps of the control display method described in the first aspect above.

[0017] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0018] The embodiment of the present application provides a control display method, which displays the first interface of the cloud computer through a cloud computer application, and the first interface is a display interface corresponding to the first process in the cloud computer. In the first interface, a virtual operation control deployed based on a first control scheme is displayed, and the first control scheme corresponds to the first process; when the process in the cloud computer is switched, in response to the process switching operation triggered by the cloud computer application, the second interface of the cloud computer is displayed, and the second interface is a display interface corresponding to the second process indicated by the process switching operation, and the virtual operation control deployed based on the second control scheme is displayed in the second interface, and the second control scheme is a control scheme corresponding to the second process determined based on a target mapping relationship, and the target mapping relationship is used to indicate the control schemes corresponding to multiple processes. In the embodiment of the present application, after the currently running process in the cloud computer is switched, the control scheme corresponding to the process to be switched can be found from the target mapping relationship, so that the control scheme corresponding to the process to be switched is automatically matched in response to the process switching operation; and then, in the display interface corresponding to the switched process, the virtual operation control deployed based on the automatically matched control scheme is displayed, and the automatic switching of the control scheme is further realized. Compared with the implementation method in the related art in which the user manually switches the control scheme, the embodiment of the present application does not require the user to manually switch the control scheme on the cloud computer application after switching the process, which simplifies the operation steps for the user when using the cloud computer application, thereby improving the switching efficiency of the control scheme and optimizing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 An operation diagram of a manual switching control solution provided for related technologies;

[0020] Figure 2 A schematic diagram of an application scenario of the control display method provided in an embodiment of the present application;

[0021] Figure 3 A method flow chart of a control display method provided in an embodiment of the present application;

[0022] Figure 4 A display effect diagram of a control solution set provided in an embodiment of the present application;

[0023] Figure 5 A schematic diagram of the control solution creation process provided in the embodiment of the present application;

[0024] Figure 6 A control switching prompt information display effect diagram provided in an embodiment of the present application;

[0025] Figure 7 Another control switching prompt information display effect diagram provided in an embodiment of the present application;

[0026] Figure 8A schematic diagram of the process overview operation response effect provided in an embodiment of the present application;

[0027] Fig. 9 A schematic diagram of the command interaction between the terminal, client server and cloud computer server provided in the embodiment of the present application scenario;

[0028] Fig.10 A schematic diagram of the interface display provided for the embodiment of the present application scenario;

[0029] Fig.11 A schematic diagram of the structure of a control display device provided in an embodiment of the present application;

[0030] Fig.12 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application;

[0031] Fig.13 A schematic diagram of the structure of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0032] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0033] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0034] Cloud technology refers to a hosting technology that unifies hardware, software, network and other resources within a wide area network or local area network to achieve data computing, storage, processing and sharing.

[0035] Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model. It can form a resource pool, which can be used on demand and is flexible and convenient. Cloud computing technology will become an important support. The backend services of the technical network system require a large amount of computing and storage resources, such as video websites, picture websites and more portal websites. With the rapid development and application of the Internet industry, in the future, each item may have its own identification mark, which needs to be transmitted to the backend system for logical processing. Data of different levels will be processed separately. All kinds of industry data need strong system backing support, which can only be achieved through cloud computing.

[0036] The solution provided in the embodiments of the present application involves cloud technology, which is specifically described by the following embodiments:

[0037] When using cloud computer applications, users will configure different controls for different processes in the cloud computer so that users can use the corresponding control solutions and use the applications installed on the cloud computer through terminal devices. Among them, a process refers to an ongoing process or a task being executed in the cloud computer. When switching the process running in the cloud computer, the control solution on the cloud computer application cannot currently achieve intelligent switching with the process. Users are also required to manually switch the control solution displayed on the cloud computer application according to the process after switching, so as to adjust the virtual operation control applicable to the process before switching to the virtual operation control applicable to the process after switching.

[0038] See also Figure 1 , Figure 1 An operation diagram of a manual switching control solution provided for related technologies.

[0039] When running process A in the cloud computer, the terminal device displays the interface 110 of process A and the control scheme 120 configured for process A in the cloud computer application; when performing a process switching operation on the process in the cloud computer to switch process A to process B, by responding to process B indicated in the process switching operation, the content displayed by the cloud computer application switches from the interface 110 of process A to the interface 130 of process B, but since the control scheme 120 is the control scheme corresponding to process A and is not applicable to process B, in order to switch the control scheme displayed by the cloud computer application to the control scheme corresponding to process B, the user needs to manually click the entry control 140 of the switch control scheme, open the switch interface 150 of the control scheme through the entry control 140 of the switch control scheme, select the control scheme 160 used by process B, and then adjust the virtual operation control applicable to process A to the virtual operation control applicable to process B. It can be seen that the control scheme on the cloud computer application in the related art needs to be manually switched by the user, the operation is cumbersome and the switching efficiency is low, which brings a poor operation experience to the user.

[0040] In order to solve the above technical problems, the embodiment of the present application provides a control display method, which displays the first interface of the cloud computer through the cloud computer application, and the first interface is the display interface corresponding to the first process in the cloud computer. The virtual operation control deployed based on the first control scheme is displayed in the first interface, and the first control scheme corresponds to the first process; when the process in the cloud computer is switched, the second interface of the cloud computer is displayed in response to the process switching operation triggered by the cloud computer application, and the second interface of the cloud computer is displayed. The second interface is the display interface corresponding to the second process indicated by the process switching operation, and the virtual operation control deployed based on the second control scheme is displayed in the second interface. The second control scheme is the control scheme corresponding to the second process determined based on the target mapping relationship, and the target mapping relationship is used to indicate the control schemes corresponding to multiple processes. In the embodiment of the present application, after the currently running process in the cloud computer is switched, the control scheme corresponding to the process to be switched can be found from the target mapping relationship, so that the control scheme corresponding to the process to be switched is automatically matched in response to the process switching operation; and then, in the display interface corresponding to the switched process, the virtual operation control deployed based on the automatically matched control scheme is displayed, and the automatic switching of the control scheme is further realized.

[0041] A cloud computer is a computer in the cloud. Generally, applications installed on the computer need to be controlled through peripherals connected to the computer, such as a mouse, keyboard, etc.; but when running a cloud computer application on a terminal device such as a mobile phone, the terminal device may not be able to connect to peripherals to control the applications in the cloud computer through the cloud computer application. In order to facilitate users to use the applications in the cloud computer through the cloud computer application installed on the terminal device, it is necessary to set virtual operation controls in the interface of the cloud computer application displayed on the terminal device. These virtual operation controls correspond to the peripherals connected to the computer. When the user triggers the corresponding operation based on the virtual operation controls on the display screen of the terminal device, the same functions as the peripherals connected to the computer can be achieved, thereby allowing the user to use the virtual operation controls displayed in the terminal device to control the applications in the cloud computer and realize normal use of the applications in the cloud computer on the terminal device.

[0042] There are many kinds of applications installed in the computer, and different applications may require different control functions. Take game applications as an example. Different game applications have different ways of playing. Some game applications may only require the corresponding click and move functions of the mouse when controlling, while some game applications may require different keys on the keyboard. Correspondingly, when starting the cloud computer application on the terminal device and using each application in the cloud computer, the virtual operation controls required by each application are also different. How to provide virtual operation controls suitable for terminal devices to control each application in the cloud computer is currently a major technical problem.

[0043] In the embodiment of the present application, a process is an ongoing process or a task being executed in a computer. In a computer system, an application is a whole composed of one or more processes. When an application is started in a cloud computer, one or more processes corresponding to the application will be started. In order to facilitate users to use applications in cloud computers in terminal devices, corresponding control schemes are configured for each process according to the control functions required by each process in each application, and the embodiment of the present application can identify the switching of processes in the cloud computer. When the process is switched, the corresponding virtual operation control is deployed in the interface of the cloud computer based on the control scheme corresponding to the switched process, realizing the convenient switching of the control scheme when the process is switched.

[0044] However, in the related art, different applications or different processes are not combined to set corresponding control schemes for different applications or different processes. When users use different applications in terminal devices, they need to manually configure the corresponding control schemes according to their own needs. Otherwise, they can only be controlled through the same virtual operation controls, and the differences in control requirements between different applications are not considered. Similarly, due to the differences in control requirements between different applications, the convenience of using the same virtual operation controls to control different applications is low, and it is impossible to bring a good user experience to users. In addition, since the related art does not respond to the process switching in the cloud computer, it is impossible to switch the control scheme when the process is switched, and the control scheme can only be switched by the user manually. Therefore, compared with the implementation method of manually switching the control scheme by the user in the related art, the embodiment of the present application does not require the user to manually switch the control scheme on the cloud computer application after switching the process, which simplifies the operation steps of the user when using the cloud computer application, thereby improving the switching efficiency of the control scheme and optimizing the user experience.

[0045] It is understandable that in the specific implementation of this application, related data such as user accounts are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0046] The control display method provided in the embodiment of the present application can be implemented by a computer device, which can be a terminal device. The terminal device includes but is not limited to a mobile phone, a computer, an intelligent voice interaction device, an intelligent home appliance, a vehicle-mounted terminal, etc. The terminal device and the server can be directly or indirectly connected via wired or wireless communication, and the present application does not limit this.

[0047] In order to facilitate understanding of the control display method provided in the embodiment of the present application, the application scenario of the control display method is exemplarily introduced below by taking the execution subject of the control display method as a terminal device as an example.

[0048] See also Figure 2 , Figure 2 A schematic diagram of an application scenario of the control display method provided in an embodiment of the present application. Figure 2 In the scenario shown, the terminal device 200 is taken as an example for explanation as the computer device used to execute the control display method provided in the embodiment of the present application.

[0049] See also Figure 2 As shown, after the cloud computer application is installed in the terminal device 200, the user can access the personal cloud computer desktop, cloud computer data and applications on the cloud computer through the cloud computer application in the terminal device 200. In order to facilitate the user to control the application on the cloud computer through the terminal device, the embodiment of the present application provides a target mapping relationship, in which the control schemes corresponding to various processes in the cloud computer application are recorded, that is, the correspondence between each process and each control scheme. After determining the process currently running in the cloud computer, the control scheme corresponding to the process can be found from the target mapping relationship, and the control scheme is displayed in the cloud computer application interface. At this time, the process screen currently running in the cloud computer can be controlled by responding to the operation of each control in the control scheme. In computer programming, a control is a graphical user interface element, and the arrangement of the information displayed can be changed by the user. For example, the input box, button, radio button, check box, etc. in the web page are all a control; in the embodiment of the present application, the control scheme refers to the control layout scheme formed by setting the type, quantity, size, arrangement and other parameters of the control deployed in the cloud computer application interface.

[0050] After the cloud computer application is started in the terminal device 200, taking the cloud computer desktop as the first interface of the cloud computer as an example, the control scheme corresponding to the cloud computer desktop is found from the target mapping relationship, and the cloud computer desktop 210 and the desktop control scheme 220 are displayed through the cloud computer application; the desktop control scheme 220 is configured with a joystick control 221 and a mouse control 222, the joystick control 221 is used to control the movement of the mouse cursor position in the cloud computer application interface, and the mouse control 222 is used to control the mouse cursor to perform single-click, double-click and other operations. The joystick control 221 and the mouse control 222 can be used to realize the selection and movement of various elements in the cloud computer desktop.

[0051] When a process switching operation is triggered in a cloud computer application, the second process corresponding to the process switching is indicated in the process switching operation, that is, the second process. Figure 2In the scenario shown, the second process can be exemplarily a process of a game application, or a process of other types of applications. The cloud computer switches the currently running process in the cloud computer to the second process by responding to the process switching operation. At this time, the second interface of the cloud computer, that is, the second process interface 230, is displayed in the cloud computer application interface. Correspondingly, in order to facilitate the user to manipulate the various elements in the second process interface 230 through the terminal device 200, it is also necessary to display the control scheme corresponding to the second process in the cloud computer application interface. The cloud computer finds the second control scheme 240 corresponding to the second process in the target mapping relationship by responding to the process switching operation, and displays the second control scheme 240 correspondingly in the second process interface 230. In this way, the second process can be controlled through the virtual operation controls in the second control scheme 240.

[0052] That is to say, in the process of using the cloud computer application, by responding to the process switching operation triggered by the cloud computer application, not only can the interface corresponding to the cloud computer application be switched to the second process interface corresponding to the second process indicated in the process switching operation, but the second control scheme corresponding to the second process can also be determined in the target mapping relationship, and the desktop control scheme displayed in the original cloud computer desktop is switched to the second control scheme, thereby realizing process-based control scheme matching and automatic switching of control schemes based on process switching, simplifying the operating steps of users when using cloud computers and improving the switching efficiency of control schemes.

[0053] It should be understood that Figure 2 The application scenarios shown are only examples. In actual applications, the control display method provided in the embodiments of the present application can also be applied to other scenarios. For example, it can be applied to the switching of various application processes such as social applications, shopping applications, audio playback applications, video playback applications, etc. The embodiments of the present application do not impose any limitations on this.

[0054] See also Figure 3 , Figure 3 A method flow chart of a control display method provided in an embodiment of the present application, the method specifically comprises the following steps:

[0055] Step 301: Displaying a first interface of a cloud computer through a cloud computer application, and displaying a virtual operation control deployed based on a first control solution in the first interface.

[0056] Among them, cloud computer is an overall service solution including cloud resources, transmission protocols and cloud terminals. It can bring the powerful computing power on remote cloud devices to low-configuration terminals (such as mobile phones, etc.) through the network. After the user installs the cloud computer application on the terminal he uses, he can access his personal cloud computer desktop, cloud computer data and applications on the cloud computer through the cloud computer application, thereby realizing the experience of high-quality and complex applications (such as game programs with high requirements for the operating environment) on low-configuration terminals. The first interface is the display interface corresponding to the first process in the cloud computer, and the first control scheme corresponds to the first process. In the embodiment of the present application, the first process is the application process that the cloud computer is running when responding to the process switching operation; the first interface is a content display interface generated by running the first process. In order to facilitate the manipulation of various elements in the first interface, one or more virtual operation controls are also deployed in the first interface based on the first control scheme; the first control scheme is the control layout scheme corresponding to the virtual operation control in the first interface, and the control type, quantity, size, position, arrangement method and other parameters of the virtual operation control in the first interface are all determined by the first control scheme.

[0057] For different application processes, the corresponding control schemes correspond to the functions in the process. For example, for the picture and text reading application in the cloud computer, the corresponding picture and text reading process can be configured with joystick controls and mouse controls, where the joystick control is used to control the movement of the mouse cursor position in the cloud computer application interface, and the mouse control is used to control the mouse cursor to perform single-click, double-click and other operations, so as to achieve the selection and switching of the picture and text content; for the game application in the cloud computer, the game has a variety of ways to play, and the corresponding game process may be configured with joystick controls, skill controls, equipment controls, etc., where the joystick control can be used to control the movement of the game character in the game scene, the skill control can be used to control the game character to release skills in the game scene, and the equipment control can be used to control the game character to purchase and use equipment in the game scene.

[0058] Step 302: In response to a process switching operation triggered by the cloud computer application, a second interface of the cloud computer is displayed, and a virtual operation control deployed based on a second control solution is displayed in the second interface.

[0059] Among them, the second interface is the display interface corresponding to the second process indicated by the process switching operation. In the embodiment of the present application, the second process is the application process indicated in the process switching operation and to be run after the process switching is completed; the process switching operation is used to instruct the cloud computer to switch from running the first process to running the second process. The second interface is a content display interface generated by running the second process. When the cloud computer responds to the process switching operation triggered by the cloud computer application, after parsing the second process indicated in the process switching operation from the process switching operation, the cloud computer generates the second interface by running the second process, and then switches the first interface displayed by the cloud computer application to the second interface.

[0060] Correspondingly, in order to facilitate the manipulation of each element in the second interface, one or more virtual operation controls need to be deployed in the second interface based on the second control scheme; the second control scheme is the control layout scheme corresponding to the virtual operation controls in the second interface, and the control type, quantity, size, position, arrangement and other parameters of the virtual operation controls in the second interface are all determined by the second control scheme corresponding to the second process. The second control scheme is a control scheme corresponding to the second process determined based on the target mapping relationship. The target mapping relationship is used to indicate the control schemes corresponding to multiple processes. After the second process indicated in the process switching operation is parsed by the cloud computer, the second control scheme corresponding to it can be found from the target mapping relationship based on the second process, and the corresponding control layout can be generated in the second interface according to the second control scheme, thereby realizing the switching of the control scheme.

[0061] In the cloud computer, in order to facilitate the manipulation of the elements in the display interface corresponding to each process, corresponding control schemes are set for multiple processes, and the corresponding relationship between multiple processes and their corresponding control schemes is saved in the target mapping relationship. When the first process is running in the cloud computer, the first control scheme corresponding to the first process can be found from the target mapping relationship. The first control scheme stores the control layout scheme for manipulating each element in the first interface. By displaying the controls in the first control scheme in the first interface, the control of each element in the first interface can be realized through the terminal device. Similarly, when the cloud computer responds to the process switching operation and switches the currently running process from the first process to the second process, it is necessary not only to switch the cloud computer application interface from the first interface to the second interface, but also to switch the first control scheme before responding to the process switching operation to the control scheme corresponding to the second process. In other words, when the process is switched in the cloud computer, the corresponding control scheme can be directly determined from the target mapping relationship according to the switched process and the control scheme is switched, and then the corresponding control scheme is automatically switched based on the process switching, which effectively improves the switching efficiency of the control scheme.

[0062] It can be seen that, using a control display method provided in an embodiment of the present application, the first interface of the cloud computer is displayed through a cloud computer application, the first interface is a display interface corresponding to the first process in the cloud computer, and the virtual operation control deployed based on the first control scheme is displayed in the first interface, and the first control scheme corresponds to the first process; when the process in the cloud computer is switched, in response to the process switching operation triggered by the cloud computer application, the second interface of the cloud computer is displayed, the second interface is a display interface corresponding to the second process indicated by the process switching operation, and the virtual operation control deployed based on the second control scheme is displayed in the second interface, and the second control scheme is a control scheme corresponding to the second process determined based on the target mapping relationship, and the target mapping relationship is used to indicate the control schemes corresponding to multiple processes. In an embodiment of the present application, a process is a process running in a computer or a task being executed; an application is a whole composed of one or more processes, and when an application is started in a cloud computer, one or more processes corresponding to the application will be started. After the currently running process in the cloud computer is switched, the control scheme corresponding to the process to be switched can be found from the target mapping relationship, so that the control scheme corresponding to the process to be switched is automatically matched in response to the process switching operation; then, in the display interface corresponding to the switched process, the virtual operation control deployed based on the automatically matched control scheme is displayed, further realizing the automatic switching of the control scheme. Compared with the implementation method of manually switching the control scheme by the user in the related art, the embodiment of the present application does not require the user to manually switch the control scheme on the cloud computer application after switching the process, which simplifies the operation steps of the user when using the cloud computer application, thereby improving the switching efficiency of the control scheme and optimizing the user experience.

[0063] Specifically, in the process of responding to the process switching operation triggered by the cloud computer application, the second control scheme corresponding to the second process can be found in the following way:

[0064] Step 11: Obtain process information on the cloud computer;

[0065] Step 12: Determine the second process running in the foreground of the cloud computer according to the process information.

[0066] A process is an ongoing process or a task being executed in a computer. In response to a process switching operation triggered by a cloud computer application, the server obtains all currently running processes on the cloud computer and generates process information of the cloud computer based on this. In the process information, the foreground process currently in the cloud computer application is determined by analyzing the window title, key process attributes and other information corresponding to each process. Among them, the key process attributes are used to describe whether each process belongs to a foreground process or a background process. The foreground process is a process that occupies a control terminal and runs in the foreground of the computer system and is used by the user. The corresponding window is often displayed at the forefront of all windows. Since the foreground process usually needs to interact with the user, it requires a higher response speed and a higher processing priority; the background process is a process that runs in the background of the computer system. Most of them do not need to interact with the user and have a lower processing priority. In an embodiment of the present application, by reading the key process attribute information corresponding to each process in the process information, the foreground process in the cloud computer is determined from multiple processes. When responding to the process switching operation indicating the second process, the foreground process is the second process running in the foreground of the cloud computer.

[0067] Step 13: Determine the target application corresponding to the second process according to the process-application mapping relationship in the target mapping relationship.

[0068] In an embodiment of the present application, the target mapping relationship includes a process-application mapping relationship, in which the correspondence between the process and the application is recorded. In a computer system, an application is a whole composed of one or more processes. When an application is started in a cloud computer, one or more processes corresponding to the application are started. After determining the second process running in the foreground of the cloud computer, the embodiment of the present application can search for the correspondence including the second process from the process-application mapping relationship, and determine the target application corresponding to the second process based on the correspondence.

[0069] Step 14: Determine the second control solution corresponding to the target application according to the information control mapping relationship in the target mapping relationship and the target application description information corresponding to the target application.

[0070] In an embodiment of the present application, the target mapping relationship also includes an information control mapping relationship, and the information control mapping relationship records the correspondence between the application description information and the control scheme. After the target application corresponding to the second process is determined from the process application mapping relationship, the target description information corresponding to the target application is obtained. The target description information is characteristic information used to describe the target application, which may include characteristic information such as the application type and application name used to describe the target application. According to the target description information corresponding to the target application, the correspondence including the target description information can be found from the information control mapping relationship, and the second control scheme corresponding to the target application can be determined based on the correspondence relationship. The second control scheme is a control layout scheme deployed for the target application in the cloud computer.

[0071] Specifically, the information control mapping relationship records the correspondence between the description keywords and the control schemes; the above step 14 can be implemented in the following way:

[0072] Step 1401: Determine a target keyword corresponding to the target application according to target application description information corresponding to the target application through a semantic analysis model.

[0073] Semantic analysis is to establish multi-level models such as vocabulary, grammar and semantics through in-depth analysis of natural language sentences and their contexts, so as to achieve the purpose of automatic understanding and intelligent processing of text. The semantic analysis method is a text analysis method that combines natural language processing and machine learning technology, and the semantic analysis model is a machine learning model for natural language processing. The target application description information includes at least one of the application name of the target application, the application introduction content, and the key object introduction content in the target application; the target application description information corresponding to the target application is input into the semantic analysis model, and the semantic analysis model outputs one or more target keywords extracted from the target application description information. The target keywords can be keywords extracted from the application name of the target application, the application introduction content, and the key object introduction content in the target application, or keywords summarized by semantic analysis. Taking the game application as an example, the target keyword can be a keyword obtained by semantic analysis of the introduction content related to the game application, or it can be a keyword corresponding to the game object, game character, etc. in the game application.

[0074] Step 1402: Determine a control scheme corresponding to the target keyword according to the information control mapping relationship as the second control scheme corresponding to the target application.

[0075] When determining the second control scheme corresponding to the target application, based on the target keyword corresponding to the target application, you can find the corresponding relationship including the target keyword from the information control mapping relationship, and then determine the control scheme corresponding to the target keyword from the corresponding relationship. This control scheme is the second control scheme corresponding to the target application.

[0076] In this way, after responding to the process switching operation triggered by the cloud computer application, the second process running in the foreground of the cloud computer is determined through the process information on the cloud computer, and the second control solution is gradually found according to the process application mapping relationship and the information control mapping relationship in the target mapping relationship, thereby improving the accuracy of determining the control solution based on the process. In addition, recording the correspondence between keywords and control solutions can manage various control solutions more efficiently, reduce the data required to be recorded to a certain extent, and save data storage space.

[0077] In a possible implementation, multiple control schemes may be determined in the information control mapping relationship according to the target keyword. In this case, the above step 14 may be implemented as follows:

[0078] Step 21: If the target object currently logging into the cloud computer application uses the target application for the first time, determine the control scheme with the most historical uses among the multiple control schemes corresponding to the target application as the second control scheme.

[0079] Among them, the target object is the user account that uses the target application in the cloud computer application. It should be noted that in the embodiment of the present application, the information control mapping relationship stores all control schemes of all users of the cloud computer application when using various applications in the cloud computer. In other words, the information control mapping relationship is equivalent to a shared data set. When the target object uses the target application for the first time in its personal cloud computer, it can obtain the control scheme set for the target application by other users who use the target user from the shared data set of the information control mapping relationship based on the target application description information, which saves the process of the target object setting the control scheme for the target application and improves the target object's user experience for the target application.

[0080] Taking the game application in the cloud computer as an example, user M can set one or more personalized control schemes for the game application according to his own operating habits. At the same time, the control scheme set by user M will be recorded in the information control mapping relationship. When user N logs in to the game application in his own cloud computer, he can obtain the control schemes set by other users for the game application from the information control mapping relationship according to the description information corresponding to the game application. That is, user N can also obtain the control scheme set by user M for the game application from the information control mapping relationship. When user N and user M have similar control habits for the game application, user N can directly use the control scheme set by user M for the game application without having to regenerate a new control scheme by himself, thereby improving user N's ​​usage experience in the game application.

[0081] It should be noted that in the embodiment of the present application, the control scheme stored in the information control mapping relationship can be either a user-defined setting or a pre-set setting of the cloud computer, and the embodiment of the present application does not make any specific limitation on this.

[0082] In an embodiment of the present application, for a target object that uses the target application for the first time, firstly, a plurality of control schemes corresponding to the target application are screened out from the information control mapping relationship, and then the control scheme with the most historical usage times is determined from the plurality of control schemes, and is provided to the target object as the second control scheme. Since the information control mapping relationship stores a plurality of control schemes set by all users for the target application, and these control schemes correspond to the control habits of the users to which they correspond, when the target object uses the target application for the first time, there is no control habit data of the target object for the target application in the cloud computer application, and the number of historical usage times corresponding to the control scheme in the information control mapping relationship can reflect its applicability to most people, therefore, the control scheme with the most historical usage times reflects that it is applicable to most users of the target application, then providing the control scheme with the most historical usage times as the second control scheme to the target object is more likely to bring the target object a good user experience.

[0083] Step 22: If it is not the first time for the target object to use the target application, determine the control scheme used by the target object when using the target application last time as the second control scheme; or determine the control scheme used most times by the target object among multiple control schemes corresponding to the target application as the second control scheme.

[0084] If the target object is not using the target application for the first time, the cloud computer should store the control habit data of the target object for the target application. Through the control habit data, the control schemes that the target object has used in the target application can be obtained. When the target object uses the target application, the control habit data can be used to analyze the control habit of the target object for the target application, and then the control scheme that the target object has used the most times for the target application can be selected as the second control scheme for the target object to use in the target application.

[0085] Alternatively, since the target object's manipulation habits for the same application may change, the embodiment of the present application also provides another method for determining a control scheme for a target object that is not using the target application for the first time, that is, selecting the control scheme used by the target object when it last used the target application from the manipulation habit data, and providing it to the target object as the second control scheme. This method of determining the control scheme has a high timeliness and can better meet the target object's usage habits for the target application at the current stage.

[0086] By sharing control solutions through information control mapping relationships, multiple control solutions can be provided to users for the same application to meet the diverse control needs of different users. At the same time, more suitable control solutions can be provided to users based on their control habits, which can improve the user experience.

[0087] In a possible implementation, the target mapping relationship in the above embodiment can be determined in the following manner:

[0088] Step 31: For applications supported by the cloud computer, a model is generated through a pre-trained control solution, and a control solution corresponding to the application is determined based on at least one reference information of the application type to which the application belongs, the usage rules corresponding to the application, and the functions provided by the application.

[0089] Among them, the control solution generation model is a machine learning model that is trained based on training samples and can automatically generate control solutions. The labels in the training samples include the application type to which the application belongs, the corresponding usage rules of the application, and the functions provided by the application. The application type is a classification label set for the application according to the functions it has, such as game applications, shopping applications, social applications and other application types; the corresponding usage rules of the application are the usage methods set for the application based on the functions it has. Taking game applications as an example, the corresponding usage rules may include how to control the movement of game characters, how to release skills, etc.; the functions provided by the application refer to the experience brought about during the use of the application, such as the experience of character resurrection and character skill activation in game applications. After being trained, the control solution generation model can use at least one of the application type, usage rules, and functions provided by the application as reference information to generate a corresponding control solution for the application.

[0090] Step 32: For the applications supported by the cloud computer, determine the application description information corresponding to the application; and establish a corresponding relationship between the application description information and the control scheme corresponding to the application.

[0091] In cloud computers, semantic analysis models can be used to perform semantic analysis on the introduction information corresponding to each application, and then extract the application description information corresponding to the application from the introduction information corresponding to each application. After determining the application description information, the corresponding relationship between the application description information and the control scheme of the same application is established based on the control scheme corresponding to the application.

[0092] Step 33: Record the correspondence between the application description information and the control scheme, and the correspondence between the application and the process into the target mapping relationship.

[0093] After obtaining the correspondence between the application description information and the control scheme, the correspondence between the application and each process is obtained, and both are recorded in the target mapping relationship. Specifically, the correspondence between the application description information and the control scheme can be saved in the information control mapping relationship in the target mapping relationship, and the correspondence between the application and the process can be saved in the process application mapping relationship in the target mapping relationship.

[0094] Training the control solution generation model through machine learning can effectively improve the efficiency and accuracy of control solution generation. Recording the control solutions generated by the control solution generation model and its corresponding processes into the target mapping relationship can improve the generation efficiency and accuracy of the target mapping relationship, thereby improving the accuracy of control solution matching during use.

[0095] In a possible implementation, the embodiment of the present application supports the user to view the control scheme displayed in the current interface, which is specifically implemented in the following manner:

[0096] In response to the triggered control solution viewing operation, a control solution set is displayed, and a target control solution corresponding to the virtual operation control in the current interface of the cloud computer is highlighted in the control solution set.

[0097] In the cloud computer application, the control schemes configured for each process are all saved in a control scheme set, which includes a variety of control schemes for controlling the cloud computer. When a user needs to view all control schemes in the cloud computer, a control scheme viewing operation can be triggered. For example, the user can trigger a control scheme viewing operation by clicking on a floating control in the cloud computer application (such as a floating ball displayed in a floating manner on the cloud computer application interface). The cloud computer application responds to the control scheme viewing operation and displays all control schemes corresponding to all processes in the cloud computer in the form of a control scheme set, and highlights the target control scheme corresponding to the virtual operation control in the current interface of the cloud computer in the control scheme set. For example, when the current interface displayed in the cloud computer is the first interface, the target control scheme corresponding to the virtual operation control in the current interface of the cloud computer is the first control scheme corresponding to the first interface; when the current interface displayed in the cloud computer is the second interface, the target control scheme is the second control scheme.

[0098] See also Figure 4 , Figure 4 A control scheme set display effect diagram provided for the embodiment of the present application. Taking the current interface of the cloud computer as the first interface as an example, if the control scheme viewing operation is triggered at this time, the control scheme set will be displayed. In the control scheme set, the names of each control scheme are displayed in the form of a horizontal list, such as the first control scheme, the second control scheme, and the target control scheme displayed in the current interface, that is, the first control scheme displayed in the first interface, is highlighted in the control scheme set, highlighting the correspondence between the first control scheme and the first interface. Figure 4 In the embodiment, the highlighted control scheme can also be previewed in the display interface of the control scheme set to show the user the specific layout of each virtual operation control in the control scheme.

[0099] In the control scheme collection display interface, you can also create a new control scheme by selecting the Create Scheme control. Figure 5 As shown, Figure 5A schematic diagram of the control scheme creation process provided for an embodiment of the present application. By responding to the user's selection operation on the create scheme control 510 in the control scheme collection display interface 500, the create scheme interface 520 is opened to create a new control scheme for the currently running process in the cloud computer. In the create scheme interface 520, including a control layout editing area 521 and a control scheme name editing area 522, the user can set the type, quantity, size, arrangement and other parameters of the virtual operation controls in the control scheme in the control layout editing area 521, and select the name corresponding to the control scheme in the control scheme name editing area 522, such as the "Beginner's Guide" control scheme. When the "Beginner's Guide" control scheme is created, the user can find the "Beginner's Guide" control scheme in the control scheme collection display interface 500 and preview the control layout therein.

[0100] By responding to a control scheme viewing operation and displaying a control scheme collection including multiple control schemes, the various control schemes stored in the cloud computer can be intuitively displayed to the user; at the same time, the target control scheme in the current interface is highlighted in the control scheme collection, intuitively showing the user the correspondence between the target control scheme and the current interface.

[0101] Furthermore, when viewing the currently displayed control through the control solution set, the control solution switching can also be triggered based on the displayed control solution set, which is specifically implemented in the following manner:

[0102] In response to a control scheme selection operation triggered based on the control scheme set, the virtual operation control deployed based on the target control scheme in the current interface is switched to a virtual operation control deployed based on a fourth control scheme.

[0103] The fourth control scheme is the control scheme selected by the control scheme selection operation, and the fourth control scheme may be any control scheme in the control scheme set except the target control scheme corresponding to the current interface.

[0104] The control scheme selection operation triggered by the user in the display interface of the control scheme set includes a selected fourth control scheme; when responding to the control scheme selection operation, the cloud computer application parses the corresponding fourth control scheme therefrom, and based on the control scheme selection operation, switches the target control scheme displayed in the current interface to the fourth control scheme, and deploys the corresponding virtual operation controls in the current interface according to the fourth control scheme, and then switches the virtual operation controls deployed in the current interface based on the target control scheme to virtual operation controls deployed based on the fourth control scheme.

[0105] By triggering a control scheme selection operation in the control scheme collection display interface, the target control scheme in the current interface of the cloud computer is switched to the fourth control scheme selected in the control scheme selection operation. A control scheme switching method is provided in the control scheme collection display interface, so that when viewing the control scheme, the user can also switch the control scheme directly based on the control scheme collection, thereby improving the flexibility and convenience of the control scheme switching method in the cloud computer application, thereby improving the user experience when using the cloud computer application.

[0106] It should be noted that in the embodiment of the present application, the above-mentioned control scheme viewing operation can be triggered in various interfaces of the cloud computer, and can be applicable to the first interface and the second interface, as well as to interfaces corresponding to other processes in the cloud computer; correspondingly, the control scheme selection operation triggered based on the control scheme set after the control viewing operation can also be applicable to various interfaces in the cloud computer.

[0107] As an embodiment, when the virtual operation control deployed based on the second control solution is displayed in the second interface, it can be implemented in the following manner:

[0108] Step 41: Display control switching prompt information.

[0109] In order to further improve the user experience, after responding to the process switching operation triggered by the cloud computer application, the control switching prompt information can also be displayed in the cloud computer interface, and the control switching prompt information can be used to let the user confirm whether to switch the control. Among them, the control switching prompt information is used to indicate the prompt information of the second control scheme to be switched. Based on the control switching prompt information, the user can understand that after the process is switched, the control scheme displayed in the second interface will be the second control scheme. Taking the current process running in the cloud computer as the first process as an example, in response to the process switching operation triggered by the cloud computer application, the current process running in the cloud computer is switched from the first process to the second process, and the control switching prompt information will be displayed in the cloud computer interface at the same time, prompting the user that the control scheme displayed in the cloud computer interface will also be automatically switched from the first control scheme to the second control scheme corresponding to the second process with the process switching.

[0110] It should be noted that, in an embodiment of the present application, the control switching prompt information may only include a confirmation control for performing a confirmation switching operation, allowing the user to only perform a confirmation switching operation on the control switching prompt information; it may also include the confirmation control and a rejection control for performing a rejection switching operation, allowing the user to perform a confirmation switching operation and a rejection switching operation on the control switching prompt information. The embodiment of the present application does not make any specific limitations on this.

[0111] Step 42: If a confirmation switching operation triggered by the control switching prompt information is received, a virtual operation control deployed based on the second control solution is displayed in the second interface.

[0112] When receiving a confirmation switching operation triggered by the control switching prompt information, it is considered that the user expects to automatically switch the control scheme after the process is switched, and the virtual operation controls are deployed in the second interface according to the second control scheme corresponding to the second process, that is, the user expects to use the second control scheme corresponding to the second process in the second interface. Therefore, the cloud computer application executes the control scheme switching according to the confirmation switching operation, and displays the virtual operation controls deployed based on the second control scheme in the second interface, and the user can control each element in the second interface through each control in the second control scheme.

[0113] See also Figure 6 , Figure 6 This is a diagram showing the effect of the control switching prompt information provided in the embodiment of the present application. Figure 6 When switching from the cloud computer desktop interface to the second interface corresponding to the game process, the virtual operation controls displayed in the second interface are still the control scheme corresponding to the cloud computer desktop, but the second interface is displayed with a control switching prompt message 610 and a confirmation control 620. When the user triggers the confirmation switching operation based on the confirmation control 620, the control scheme displayed in the second interface is switched to the second control scheme corresponding to the game process.

[0114] By displaying the control switching prompt information in the cloud computer interface, and then confirming the switching operation triggered by the control switching prompt information, it is finally determined to display the virtual operation control corresponding to the second control scheme in the second interface, which intuitively shows the user the control scheme matching process based on process switching, thereby improving the user experience.

[0115] When the control switching prompt information includes a rejection control, the user can trigger the rejection switching automatic matching control scheme based on the rejection control. On this basis, the user can choose to keep the original control scheme without switching, or choose to manually select the control to be switched.

[0116] In a possible implementation, when the control switching prompt information includes a rejection control, the user can trigger a rejection switching operation for the automatically matched control scheme based on the rejection control. On the basis of the rejection switching, the control scheme after the switch can be determined by manual selection by the user, which is specifically implemented in the following manner:

[0117] Step 51: If a rejection switching operation is received based on the control switching prompt information, a control solution set is displayed.

[0118] The control scheme set includes a variety of control schemes for controlling the cloud computer; when receiving a rejection switch operation triggered by the control switch information, it is considered that the user does not expect to automatically switch the control scheme after the process switch, or the user does not expect to switch to the control scheme automatically matched by the second process. At this time, in response to the rejection switch operation, the control scheme set can be displayed in the cloud computer application interface so that the user can manually select the control scheme to switch to in the control scheme set.

[0119] Step 52: In response to a control scheme selection operation triggered based on the control scheme set, displaying a virtual operation control deployed based on a third control scheme in the second interface.

[0120] The third control scheme is the control scheme selected by the control scheme selection operation. When the control scheme selection operation is triggered in the control scheme set of the user's cloud computer application interface, the control scheme selected by the user through the control scheme selection operation, that is, the third control scheme mentioned above, is included in the control scheme selection operation. By responding to the control selection operation, the control scheme is switched, and the virtual operation controls deployed based on the third control scheme are displayed in the second interface. The user can control each element in the second interface through each control in the third control scheme.

[0121] In another possible implementation, when a rejection switch operation is received based on the control switch prompt information, the original control scheme can be retained without switching. For example, two different image and text browsing processes have the same functions, and the control schemes used in the two processes can also be the same. In this case, the user can choose not to switch the control scheme to improve the efficiency of process switching.

[0122] See also Figure 7 , Figure 7 Another control switching prompt information display effect diagram provided in an embodiment of the present application. Figure 7 In the second interface, control switching prompt information, confirmation control and rejection control 710 are displayed. The user can not only trigger the confirmation switching operation based on the confirmation control, but also trigger the rejection switching operation based on the rejection control 710.

[0123] A rejection control is set in the control switching prompt information, allowing the rejection switching operation for the automatically matched control scheme to be triggered based on the rejection control, respecting the user's choice of control scheme and improving the user experience.

[0124] As an embodiment, step 302 may be implemented as follows:

[0125] In response to the process switching operation triggered by the cloud computer application, a first sub-interface of the target application in the cloud computer is displayed, and a virtual operation control deployed based on a first sub-control scheme is displayed in the first sub-interface.

[0126] The target application is an application corresponding to the second process, and the first sub-control scheme is a control scheme included in the second control scheme and corresponding to the first sub-interface.

[0127] In the cloud computer application, when a process is running, the interface corresponding to it may also include multiple sub-interfaces. When the functions corresponding to the multiple sub-interfaces are different, the control schemes corresponding to the sub-interfaces may be different. In the embodiment of the present application, the second interface corresponding to the second process may also include multiple sub-interfaces, so the second control scheme corresponding to the second process also includes multiple sub-control schemes. There is a corresponding relationship between the sub-interfaces and the sub-control schemes. When the sub-interfaces in the second process are switched, the sub-control schemes will also switch accordingly according to the corresponding relationship between the sub-interfaces and the sub-control schemes.

[0128] After responding to the process switching operation, when the first sub-interface corresponding to the target application is displayed in the cloud computer application interface, in order to facilitate the manipulation of each element in the first sub-interface, the control scheme will be switched to the first sub-control scheme corresponding to the first sub-interface in the second control scheme, and the virtual operation control corresponding to the first sub-control scheme will be deployed in the first sub-interface. The first sub-control scheme is the control layout scheme corresponding to the virtual operation control in the first sub-interface, and the control type, quantity, size, position, arrangement and other parameters of the virtual operation control in the first sub-interface are all determined by the first sub-control scheme.

[0129] By setting corresponding sub-control schemes for different sub-interfaces in the same process and refining the sub-control schemes corresponding to different sub-interfaces in the same process, the targetedness of the virtual operation control layout is improved, and the adaptability between the virtual operation control layout and the sub-interface is improved, thereby improving the user experience of applications in cloud computers.

[0130] Furthermore, when the sub-interface in the second process is switched, the following steps may also be included:

[0131] In response to an interface switching operation for the target application triggered by the cloud computer application, a second sub-interface of the target application is displayed, and a virtual operation control deployed based on a second sub-control scheme is displayed in the second sub-interface.

[0132] Among them, the second sub-control scheme is a control scheme included in the second control scheme and corresponding to the second sub-interface. In the interface switching operation for the target application triggered by the cloud computer application, the second sub-interface to be switched to in the target application is indicated, so after responding to the interface switching operation, the first sub-interface of the target application displayed in the cloud computer application interface is switched to the second sub-interface of the target application. In order to facilitate the manipulation of each element in the second sub-interface, the first sub-control scheme is correspondingly switched to the second sub-control scheme corresponding to the second sub-interface in the second control scheme, and the virtual operation control corresponding to the second sub-control scheme is deployed in the second sub-interface. The second sub-control scheme is a control layout scheme corresponding to the virtual operation control in the second sub-interface, and the control type, quantity, size, position, arrangement and other parameters of the virtual operation control in the second sub-interface are all determined by the second sub-control scheme.

[0133] Taking the target application as a game application in a cloud computer as an example, in the game application, multiple different game sub-interfaces may be generated, such as a game character selection sub-interface, a game scene sub-interface, etc. In different game sub-interfaces, the control schemes used are not the same, so the second control scheme corresponding to the game application includes multiple different control schemes deployed for multiple different game sub-interfaces, with the game character selection sub-interface as the first sub-interface in the game application, and the game scene sub-interface as the second sub-interface. In the first sub-interface, only selection controls and confirmation controls are required, so the first sub-control scheme corresponding to the first sub-interface in the second control scheme only includes selection controls and confirmation controls; while in the second sub-interface, it is necessary to deploy a joystick control for controlling the position of the game character, a posture selection control for controlling the posture of the game character, a skill release control for controlling the release of skills by the game character, an equipment configuration control for controlling the configuration of equipment for the game character, etc., so the second sub-control scheme corresponding to the second sub-interface in the second control scheme includes the above-mentioned joystick control, posture selection control, skill release control, equipment configuration control, etc. After the user completes the game character selection in the first sub-interface, the interface switching operation for the target application is triggered based on the confirmation control in the first sub-interface, and the second sub-interface in the target application is entered, and the first sub-control scheme is switched to the second sub-control scheme corresponding to the second sub-interface, and the joystick control, posture selection control, skill release control, equipment configuration control and other virtual operation controls required for the game are deployed in the second sub-interface, so that the user can control the game character in the game scene based on the virtual operation controls displayed in the second sub-interface.

[0134] By responding to the interface switching operation for the target application, automatic matching and switching of sub-control schemes are achieved based on changes in the sub-interfaces in the target application, thereby further improving the flexibility of switching control schemes.

[0135] In a possible implementation, the above step 302 may also be implemented in the following manner:

[0136] Step 61: In response to a process overview operation triggered by the cloud computer application, a process list of the cloud computer is displayed.

[0137] Among them, the process list includes each process on the cloud computer and its corresponding control scheme; through the process overview operation, the process list in the current cloud computer can be quickly opened to realize the display of the process list of the cloud computer.

[0138] Step 62: In response to a process selection operation triggered based on the process list, the second interface corresponding to the second process indicated by the process selection operation is displayed, and the virtual operation control deployed based on the second control scheme is displayed in the second interface.

[0139] After the process list of the cloud computer is displayed in the cloud computer application interface, a process selection operation can be further triggered based on the process list, and the process switching in the cloud computer is realized through the process selection operation. In the process selection operation, the second process corresponding to this process switching is indicated, and in response to the process selection operation, the second interface corresponding to the second process is displayed in the cloud computer application interface, and based on the second control scheme corresponding to the second process, the corresponding virtual operation control is deployed in the second interface.

[0140] See also Figure 8 As shown, Figure 8 A schematic diagram of the process overview operation response effect provided in an embodiment of the present application. In the cloud computer application interface, the user can trigger the process overview operation by selecting the entry control 810 for switching the control scheme to display the process list of the current cloud computer. The process list includes the names of each process on the current cloud computer and the control scheme corresponding to each process, such as Figure 8 In the process list, the user can trigger a process selection operation by selecting the second process and its corresponding second control solution. Based on the second process indicated by the process selection operation, the second interface corresponding to the second process is displayed in the cloud computer application interface, and based on the second control solution corresponding to the second process, the virtual operation control 820 in the second control solution is deployed in the second interface.

[0141] By responding to the process overview operation to display the process list of the cloud computer, and based on the process list, the process can be quickly switched, thereby improving the efficiency of process switching in the cloud computer.

[0142] In a possible implementation, displaying the virtual operation control deployed based on the second control solution in the second interface may be implemented in the following manner:

[0143] Step 71: According to the display attribute information of the target terminal carrying the cloud computer application, the second control scheme is adjusted to obtain a target second control scheme.

[0144] The target terminal is the terminal device based on which the user uses the cloud computer application. It can be a mobile phone, computer, intelligent voice interaction device, smart home appliance, car terminal, etc. The cloud computer application is installed in the target terminal, and the user can use the cloud computer application in the target terminal. The display attribute information is the attribute information corresponding to the display screen in the target terminal, such as the screen size, resolution, border size and other attribute information of the display screen. Since the display attribute information of different terminal devices may be different, in order to make the control scheme adapt to the display attribute information of the target terminal and be able to fully display the control scheme in the target terminal, when displaying the second control scheme in the target terminal, it is necessary to adjust the second control scheme according to the display attribute information of the target terminal, and then obtain the target second control scheme. Among them, the target second control scheme is a control layout scheme suitable for the display screen of the target terminal obtained after adjusting the second control scheme according to the display attribute information of the target terminal.

[0145] In the embodiment of the present application, the adjustment of the second control scheme may specifically be the adjustment of the size, position and spacing between virtual operation controls in the second control scheme. Specifically, the layout of the virtual operation controls in the second control scheme may be scaled according to the proportional relationship between the screen size of the target terminal and the screen size corresponding to the second control scheme, so that the obtained target second control scheme can be suitable for the display screen of the target terminal.

[0146] Step 72: Displaying virtual operation controls deployed based on the target second control solution in the second interface.

[0147] After obtaining the target second control scheme, the corresponding virtual operation controls are deployed and displayed in the second interface based on the target second control scheme, so that all virtual operation controls in the target second control scheme can be displayed on the display screen of the target terminal, thereby allowing the user to control each element in the second interface through each control in the target second control scheme.

[0148] It should be noted that the above-mentioned adaptive adjustment method for the second control scheme is also applicable to the adjustment of other control schemes (such as the first control scheme, the third control scheme, the fourth control scheme, etc.) in the embodiments of the present application.

[0149] When displaying the virtual operation controls deployed based on the second control scheme in the second interface, the display attribute information such as the screen size and border of the target terminal is considered, and the display of the virtual operation controls in the control scheme is adaptively adjusted based on these display attribute information, thereby improving the adaptability and flexibility of the virtual operation controls in the terminal device, thereby improving the user's visual experience when using cloud computer applications in the terminal device.

[0150] In a possible implementation, displaying the virtual operation control deployed based on the second control solution in the second interface may be implemented in the following manner:

[0151] Step 81: Acquire the target object's operation habit information when using the reference application;

[0152] Step 82: adjusting the second control scheme according to the operation habit information to obtain a target second control scheme;

[0153] Step 83: Displaying a virtual operation control deployed based on the target second control solution in the second interface.

[0154] Among them, the target object is the current login object of the cloud computer application, the reference application and the target application corresponding to the second process are the same type of applications; the operation habit information is the prediction information for the target application obtained based on the summary analysis of the historical usage information of the reference application by the target object.

[0155] In the embodiment of the present application, the target second control scheme is a control layout scheme that is obtained by adjusting the second control scheme based on the operation habit information and conforms to the operation habits of the target object. Since the reference application and the target application are the same type of applications, the operation habits of the target object for the target application can be predicted based on the historical usage information of the reference application in the operation habit information, and then when the virtual operation controls deployed based on the second control scheme are displayed on the second interface, the second control scheme matched to the second process can be adjusted according to the operation habit information, such as adjusting the size, position, spacing and other parameters of the virtual operation controls, so that the adjusted target second control scheme is more in line with the operation habits of the target object, and improves the target object's use experience for the target application.

[0156] In a possible implementation, after the virtual operation control deployed based on the second control solution is displayed in the second interface, the following steps may also be included:

[0157] If the target object triggers a target error operation more than a preset number of times at the target position in the second interface, the second control scheme is adjusted based on the operation intention corresponding to the target error operation and the target position, and a virtual operation control corresponding to the operation intention is deployed at the target position to obtain a target second control scheme;

[0158] Among them, the target object is the current login object of the cloud computer application; the operation intention corresponding to the target error operation is determined by analyzing the current operation scenario of the target object and the operation triggered by the target object within a preset time period.

[0159] Taking a game application as an example, if it is detected that the target object triggers an operation multiple times at the target position in the second interface of the game application, but the game application does not respond to the operation, the operation is considered to be a target error operation. After the target error operation is determined, the operation performed by the target object after the target error operation is analyzed. If the target object performs the same operation multiple times after the target error operation, then the operation intention corresponding to the target error operation can be determined based on the same operation. For example, after performing the target error operation, the target object performs the operation of controlling the movement of the game character through the joystick control multiple times. Based on this, it can be analyzed that the operation intention of the target object to perform the target error operation at the target position is to control the movement of the game character. Then, according to the operation intention, a remote sensing control for controlling the movement of the game character can be deployed at the target position to adjust the second control scheme and obtain the target second control scheme. In this way, the next time the target object triggers the target error operation at the target position, the operation intention corresponding to the target error operation can be realized.

[0160] By analyzing the triggered target error operation, the operation intention corresponding to the target error operation is obtained, and the deployment of virtual operation controls in the second control scheme is adjusted accordingly, thereby improving the flexibility of the deployment of each virtual operation control in the second control scheme and improving the user experience of the target object.

[0161] In a possible implementation, the method may further include:

[0162] S1: For the second control solution, based on usage of each virtual operation control deployed based on the second control solution by multiple users, usage information of each virtual operation control in the second control solution is determined.

[0163] In the cloud computer application, the operation records of multiple users when using the second control scheme can also be obtained, and the usage of each virtual operation control in the second control scheme by multiple users can be counted based on the operation records, and then the usage information of each virtual operation control in the second control scheme by multiple users can be determined based on the usage. In the embodiment of the present application, the usage information is information used to describe the usage of the virtual operation control by the user, which may include the number of times each virtual control is used, the frequency of use, the usage scenario, and other information.

[0164] S2: adjusting the second control scheme according to the usage information of each virtual operation control in the second control scheme to obtain a target second control scheme.

[0165] After obtaining the usage information of each virtual operation control in the second control scheme, each virtual operation control in the second control scheme is adjusted according to the usage information. For example, the usage frequency of each virtual operation control can be obtained according to the usage information of each virtual operation control in the second control scheme. If the usage frequency of a virtual operation control is low, the second control scheme can be adjusted accordingly to delete the virtual operation control with low usage frequency to simplify the layout of the virtual operation controls corresponding to the second control scheme in the second interface. Of course, the second control scheme can also be adjusted by adjusting the size of the virtual operation controls to appropriately reduce the size of the virtual operation controls with low usage frequency.

[0166] It should be noted that the embodiments of the present application do not limit the method for adjusting the virtual operation controls in the second control scheme, and the number, size, layout and other information of the virtual operation controls in the second control scheme can be adjusted according to the usage of each virtual operation control deployed by the second control scheme.

[0167] By counting usage of each virtual operation control in the second control solution by the user, the second control solution is adjusted, thereby improving the adaptability of the second control solution.

[0168] Specifically, the above step S2 can be implemented in the following way:

[0169] S21: for each virtual operation control deployed in the high-frequency operation area in the second control scheme, determine whether the usage frequency of the virtual operation control is higher than a first frequency threshold; if so, keep the virtual operation control deployed in the high-frequency operation area; if not, adjust the virtual operation control to be deployed in the low-frequency operation area;

[0170] S22: For each virtual operation control deployed in the low-frequency operation area in the second control scheme, determine whether the usage frequency of the virtual operation control is higher than a second frequency threshold; if so, adjust the virtual operation control to be deployed in the high-frequency operation area; if not, keep the virtual operation control deployed in the low-frequency operation area.

[0171] In the embodiment of the present application, the high-frequency operation area and the low-frequency operation area are preset areas set by analyzing the operation records of a large number of users, wherein the high-frequency operation area is an area with a high frequency of triggering operation in the user operation record. When analyzing the user's operation record, the number of times the triggering operation is performed in each area of ​​the second interface is counted, and the frequency of the user's triggering operation in each area is calculated according to the number of times the triggering operation is performed. When the user has a high frequency of triggering operation in a certain area, the area is set as the high-frequency operation area; correspondingly, the low-frequency operation area is an area with a low frequency of triggering operation in the user operation record. When it is determined that the user has a low frequency of triggering operation in a certain area after analyzing the user's operation record, the area is set as the low-frequency operation area. For example, in a multiplayer online tactical competitive game (MOBA), when the user holds the terminal device, he is accustomed to using the two side areas in the terminal device display screen to perform game operations, then the two side areas of the game interface displayed in the terminal device can be set as the high-frequency operation area, and the central area of ​​the game interface can be set as the low-frequency operation area.

[0172] It should be noted that in the embodiment of the present application, the high-frequency operation area and the low-frequency operation area are determined according to the user's operating habits. When the user's operating habits change, the settings of the high-frequency operation area and the low-frequency operation area can be readjusted according to the operation records.

[0173] When analyzing the user's operation records, in addition to analyzing the operation frequencies corresponding to different areas in the second interface, the operation frequencies corresponding to the virtual operation controls in different areas can also be analyzed, and the virtual operation controls with higher operation frequencies can be set in the high-frequency operation area, and the virtual operation controls with lower operation frequencies can be set in the low-frequency operation area to adapt to the user's operation habits.

[0174] By analyzing the user's operation records, the operation frequency statistics of each virtual operation control in the second control scheme are divided into regions. For a virtual operation control in a high-frequency operation region, if its usage frequency is higher than the first frequency threshold, the virtual operation control is continuously deployed in the high-frequency operation region; otherwise, the position of the virtual operation control is adjusted to the low-frequency operation region. For a virtual operation control in a low-frequency operation region, if its usage frequency is higher than the second frequency threshold, the deployment position of the virtual operation control is adjusted to the high-frequency operation region; otherwise, the virtual operation control is continuously deployed in the low-frequency operation region.

[0175] It should be noted that in the embodiment of the present application, the first frequency threshold and the second frequency threshold can be adjusted according to the application requirements in the actual application scenario. The first frequency threshold and the second frequency threshold can be equal or different. The present application does not specifically limit the specific numerical values ​​of the first frequency threshold and the second frequency threshold.

[0176] By setting high-frequency operation areas and low-frequency operation areas in the second interface and counting the usage frequency of virtual operation controls to adjust the corresponding deployment positions in the second interface, the adaptability and flexibility of the layout of virtual operation controls in the second control scheme are improved.

[0177] In a possible implementation, after the virtual operation control deployed based on the second control solution is displayed in the second interface, the following steps may also be included:

[0178] Step 91: In response to the triggered control scheme editing operation, edit and adjust the second control scheme to obtain a target second control scheme;

[0179] Step 92: Displaying virtual operation controls deployed based on the target second control solution in the second interface.

[0180] In the embodiment of the present application, it is also supported that the user manually triggers the control scheme editing operation. By responding to the control scheme editing operation, the user can manually adjust the type, quantity, size, arrangement and other parameters of the virtual operation controls in the second control scheme, and save the control scheme after the manual adjustment as the target second control scheme. Based on the target second control scheme, the corresponding virtual operation controls are deployed in the second interface, so that the user can control each element in the second interface according to each virtual operation control in the target second control scheme.

[0181] Specifically, in an embodiment of the present application, the user can trigger the control scheme editing operation by long pressing a virtual operation control in the second control scheme; of course, the control scheme editing operation can also be triggered by other methods, and the embodiment of the present application does not specifically limit this.

[0182] By responding to control scheme editing operations, users are supported to manually trigger adjustments to the currently used control scheme, which can enable the control layout in the control scheme to better meet the user's control needs, improve the flexibility and adaptability of the control scheme settings, and thus improve the user experience.

[0183] Furthermore, the method based on the above embodiment may also include the following steps:

[0184] The correspondence between the target second control scheme and the second process is recorded in the target mapping relationship, so that the next time the use operation for the second process triggered by the target object is received, the virtual operation control deployed based on the target second control scheme is displayed in the second interface.

[0185] Among them, the target object is the current login object of the cloud computer application. After the adjustment described in the above embodiment is made to the second control scheme, a target second control scheme adjusted based on the second control scheme is obtained, and the target second control scheme is adapted to the target terminal used by the target object and the operating habits of the target object. Therefore, the correspondence between the target second control scheme and the second process can be directly recorded in the target mapping relationship. Then, when the use operation for the second process triggered by the target object is received next time, the target second control scheme corresponding to the second process can be directly searched in the target mapping relationship, and the target second control scheme matching the display properties of the target terminal, the user's operating habits, etc. can be directly used to deploy the corresponding virtual operation control in the second interface, which saves the process of adjusting the second control scheme, improves the deployment efficiency of the virtual operation control in the second interface, and thus improves the process switching efficiency and control scheme switching efficiency in the cloud computer.

[0186] The solution provided in the embodiment of the present application relates to cloud gaming in cloud technology. Cloud gaming, which can also be called gaming on demand, is an online gaming technology based on cloud computing technology. Cloud gaming technology enables thin clients with relatively limited graphics processing and data computing capabilities to run high-quality games. In a cloud gaming scenario, the game is not run on the player's game terminal, but on a cloud server, and the cloud server renders the game scene as a video and audio stream, which is transmitted to the player's game terminal over the network. The player's game terminal does not need to have powerful graphics computing and data processing capabilities, but only needs to have basic streaming media playback capabilities and the ability to obtain player input commands and send them to the cloud server. This is specifically described through the following embodiments:

[0187] See also Fig. 9 , Fig.10 ,in, Fig. 9 A schematic diagram of the command interaction between the terminal, the client server and the cloud computer server provided in the embodiment of the present application scenario, Fig.10 The following is a schematic diagram of the interface display corresponding to the embodiment of this scenario. When the user starts the cloud computer application in the terminal device, the terminal device sends the cloud computer startup instruction to the cloud computer server. After receiving the instruction, the cloud computer server controls the cloud computer to start, and renders the cloud computer desktop interface and sends it to the terminal device for display. Fig.10 As shown in (a), Fig.10 In (a), a cloud computer desktop interface 1010 is displayed, and a virtual operation control 1020 deployed based on the cloud computer desktop control solution is displayed in the desktop interface 1010.

[0188] When the user triggers a process switching operation through the cloud computer application in the terminal device, the terminal device sends the operation instruction corresponding to the process switching operation to the cloud computer server, wherein the first process corresponding to this process switching is indicated in the process switching operation. After receiving the operation instruction, the cloud computer server renders the first interface corresponding to the first process, and sends the first interface to the terminal device for display; the cloud computer server also uploads the first process to the client server, and the client server matches the control scheme in the target mapping relationship based on the first process, determines the first control scheme corresponding to the first process, and sends a message to the terminal device indicating that the first control scheme matches successfully. Among them, the first interface displayed in the terminal device is as follows: Fig.10 (b) shows that Fig.10 In (b), a first interface 1030 is displayed, and a virtual operation control 1040 deployed based on the first control solution is displayed in the first interface 1030.

[0189] When the user triggers the process switching operation again through the cloud computer application in the terminal device in the first interface, the terminal device sends the operation instruction corresponding to the process switching operation to the cloud computer server, wherein the second process corresponding to this process switch is indicated in the process switching operation. After receiving the operation instruction, the cloud computer server renders the second interface corresponding to the second process, and sends the second interface to the terminal device for display; the cloud computer server also uploads the second process to the client server, and the client server matches the control scheme in the target mapping relationship based on the second process, determines the second control scheme corresponding to the second process, and sends a message to the terminal device indicating that the second control scheme has been successfully matched. Among them, the second interface displayed in the terminal device is as follows: Fig.10 (c) shows that Fig.10 In (c), a second interface 1050 is displayed, and a virtual operation control 1060 deployed based on the second control solution is displayed in the second interface 1050.

[0190] See also Fig.11 , Fig.11 A schematic diagram of a control display device 1100 provided in an embodiment of the present application, the device comprising:

[0191] The first display module 1101 is used to display a first interface of the cloud computer through the cloud computer application, and to display virtual operation controls deployed based on the first control scheme in the first interface; the first interface is a display interface corresponding to a first process in the cloud computer, and the first control scheme corresponds to the first process;

[0192] The second display module 1102 is used to respond to the process switching operation triggered by the cloud computer application, display the second interface of the cloud computer, and display the virtual operation controls deployed based on the second control scheme in the second interface; the second interface is the display interface corresponding to the second process indicated by the process switching operation, and the second control scheme is a control scheme corresponding to the second process determined based on the target mapping relationship, and the target mapping relationship is used to indicate the control schemes corresponding to multiple processes.

[0193] Optionally, the second display module 1102 is specifically used for:

[0194] Display control switching prompt information; the control switching prompt information is used to indicate the second control scheme to be switched;

[0195] If a confirmation switching operation triggered by the control switching prompt information is received, a virtual operation control deployed based on the second control solution is displayed in the second interface.

[0196] Optionally, the device further comprises a third display unit, configured to:

[0197] If a rejection switch operation is received based on the control switch prompt information, a control solution set is displayed; the control solution set includes a plurality of control solutions for controlling the cloud computer;

[0198] In response to a control scheme selection operation triggered based on the control scheme set, a virtual operation control deployed based on a third control scheme is displayed in the second interface; the third control scheme is the control scheme selected by the control scheme selection operation.

[0199] Optionally, the device further comprises a fourth display unit, configured to:

[0200] In response to the triggered control scheme viewing operation, a control scheme set is displayed, in which a target control scheme corresponding to a virtual operation control in a current interface of the cloud computer is highlighted; the control scheme set includes a plurality of control schemes for operating the cloud computer.

[0201] Optionally, the fourth display module is further used for:

[0202] In response to a control scheme selection operation triggered based on the control scheme set, the virtual operation control deployed based on the target control scheme in the current interface is switched to a virtual operation control deployed based on a fourth control scheme; the fourth control scheme is the control scheme selected by the control scheme selection operation.

[0203] Optionally, the second display module 1102 is specifically used for:

[0204] In response to the process switching operation triggered by the cloud computer application, a first sub-interface of the target application in the cloud computer is displayed, and a virtual operation control deployed based on a first sub-control scheme is displayed in the first sub-interface; the target application is an application corresponding to the second process, and the first sub-control scheme is a control scheme included in the second control scheme and corresponding to the first sub-interface.

[0205] Optionally, the second display module 1102 is further used for:

[0206] In response to an interface switching operation for the target application triggered by the cloud computer application, a second sub-interface of the target application is displayed, and a virtual operation control deployed based on a second sub-control scheme is displayed in the second sub-interface; the second sub-control scheme is a control scheme included in the second control scheme and corresponding to the second sub-interface.

[0207] Optionally, the second display module 1102 is specifically used for:

[0208] In response to a process overview operation triggered by the cloud computer application, a process list of the cloud computer is displayed; the process list includes each process on the cloud computer and its corresponding control scheme;

[0209] In response to a process selection operation triggered based on the process list, the second interface corresponding to the second process indicated by the process selection operation is displayed, and a virtual operation control deployed based on the second control scheme is displayed in the second interface.

[0210] Optionally, the second control scheme is determined in the following manner:

[0211] Obtaining process information on the cloud computer;

[0212] Determining the second process running in the foreground of the cloud computer according to the process information;

[0213] Determining a target application corresponding to the second process according to a process-application mapping relationship in the target mapping relationship; the process-application mapping relationship records a correspondence between a process and an application;

[0214] The second control scheme corresponding to the target application is determined according to the information control mapping relationship in the target mapping relationship and the target application description information corresponding to the target application; the information control mapping relationship records the correspondence between the application description information and the control scheme.

[0215] Optionally, the information control mapping relationship records the correspondence between description keywords and control schemes, and the second display module 1102 is specifically used to:

[0216] Determine, by a semantic analysis model, a target keyword corresponding to the target application according to target application description information corresponding to the target application; the target application description information includes at least one of an application name of the target application, application introduction content, and key object introduction content in the target application;

[0217] According to the information control mapping relationship, a control scheme corresponding to the target keyword is determined as the second control scheme corresponding to the target application.

[0218] Optionally, when a plurality of corresponding control schemes are determined for the target application, the second display module 1102 is specifically used for:

[0219] If the target object currently logging into the cloud computer application uses the target application for the first time, determining the control scheme with the largest number of historical uses among the multiple control schemes corresponding to the target application as the second control scheme;

[0220] If it is not the first time that the target object uses the target application, the control scheme used by the target object when using the target application last time is determined as the second control scheme; or the control scheme used most times by the target object is determined among multiple control schemes corresponding to the target application as the second control scheme.

[0221] Optionally, the target mapping relationship is determined in the following manner:

[0222] For the applications supported by the cloud computer, a control solution corresponding to the application is determined by generating a model through a pre-trained control solution, according to at least one reference information of the application type to which the application belongs, the usage rules corresponding to the application, and the functions provided by the application;

[0223] For an application supported by the cloud computer, determining application description information corresponding to the application; establishing a correspondence between the application description information and a control scheme corresponding to the application;

[0224] The correspondence between the application description information and the control scheme, and the correspondence between the application and the process are recorded in the target mapping relationship.

[0225] Optionally, the second display module 1102 is specifically used for:

[0226] According to the display attribute information of the target terminal carrying the cloud computer application, the second control scheme is adjusted to obtain a target second control scheme;

[0227] A virtual operation control deployed based on the target second control solution is displayed in the second interface.

[0228] Optionally, the second display module 1102 is specifically used for:

[0229] Acquire operation habit information of a target object when using a reference application; the target object is a current login object of the cloud computer application, and the reference application and the target application corresponding to the second process are applications of the same type;

[0230] According to the operation habit information, the second control scheme is adjusted to obtain a target second control scheme;

[0231] A virtual operation control deployed based on the target second control solution is displayed in the second interface.

[0232] Optionally, the device further comprises an editing and adjusting unit, configured to:

[0233] If the target object triggers a target error operation more than a preset number of times at the target position in the second interface, the second control scheme is adjusted based on the operation intention corresponding to the target error operation and the target position, and a virtual operation control corresponding to the operation intention is deployed at the target position to obtain a target second control scheme;

[0234] Among them, the target object is the current login object of the cloud computer application; the operation intention corresponding to the target erroneous operation is determined by analyzing the current operation scenario of the target object and the historical operations triggered by the target object within a preset time period.

[0235] The Edit Adjustment Unit can also be used to:

[0236] In response to the triggered control scheme editing operation, the second control scheme is edited and adjusted to obtain a target second control scheme;

[0237] A virtual operation control deployed based on the target second control solution is displayed in the second interface.

[0238] Optionally, the editing and adjusting unit is further used for:

[0239] For the second control scheme, based on usage of each virtual operation control deployed based on the second control scheme by multiple users, determining usage information of each virtual operation control in the second control scheme;

[0240] According to the usage information of each virtual operation control in the second control solution, the second control solution is adjusted to obtain a target second control solution.

[0241] Optionally, the editing and adjusting unit is specifically used for:

[0242] For each virtual operation control deployed in the high-frequency operation area in the second control scheme, determine whether the usage frequency of the virtual operation control is higher than a first frequency threshold, if so, keep the virtual operation control deployed in the high-frequency operation area, if not, adjust the virtual operation control to be deployed in the low-frequency operation area;

[0243] For each virtual operation control deployed in the low-frequency operation area in the second control scheme, determine whether the usage frequency of the virtual operation control is higher than the second frequency threshold. If so, adjust the virtual operation control to the high-frequency operation area for deployment; if not, keep the virtual operation control deployed in the low-frequency operation area.

[0244] Optionally, the device further comprises a recording unit, configured to:

[0245] The correspondence between the target second control scheme and the second process is recorded in the target mapping relationship, so that the next time the use operation for the second process triggered by the target object is received, the virtual operation control deployed based on the target second control scheme is displayed in the second interface, and the target object is the current login object of the cloud computer application.

[0246] The embodiment of the present application also provides a computer device, which may specifically be a terminal device or a server. The terminal device and server provided in the embodiment of the present application will be introduced below from the perspective of hardware entity.

[0247] See also Fig.12 , Fig.12 Schematic diagram of the structure of the terminal device provided in the embodiment of the present application. Fig.12 For the sake of convenience, only the parts related to the embodiments of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiments of the present application. The terminal can be any terminal device including a mobile phone, a tablet computer, a personal digital assistant (PDA), a point of sales (POS), a car computer, etc., taking the terminal as a computer as an example:

[0248] Fig.12 FIG. 1 is a block diagram showing a partial structure of a computer related to a terminal provided in an embodiment of the present application. Fig.12The computer includes: a radio frequency (RF) circuit 1210, a memory 1220, an input unit 1230 (including a touch panel 1231 and other input devices 1232), a display unit 1240 (including a display panel 1241), a sensor 1250, an audio circuit 1260 (which is connected to a speaker 1261 and a microphone 1262), a wireless fidelity (WiFi) module 1270, a processor 1280, and a power supply 1290. Those skilled in the art will understand that Fig.12 The computer structure shown in the figure does not constitute a limitation of the computer, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0249] The memory 1220 can be used to store software programs and modules. The processor 1280 executes various functional applications and data processing of the computer by running the software programs and modules stored in the memory 1220. The memory 1220 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the computer (such as audio data, a phone book, etc.), etc. In addition, the memory 1220 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0250] The processor 1280 is the control center of the computer, which uses various interfaces and lines to connect various parts of the entire computer, and executes various functions of the computer and processes data by running or executing software programs and / or modules stored in the memory 1220, and calling data stored in the memory 1220. Optionally, the processor 1280 may include one or more processing units; preferably, the processor 1280 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 1280.

[0251] In the embodiment of the present application, the processor 1280 included in the terminal also has the following functions:

[0252] Displaying a first interface of the cloud computer through a cloud computer application, and displaying a virtual operation control deployed based on a first control scheme in the first interface; the first interface is a display interface corresponding to a first process in the cloud computer, and the first control scheme corresponds to the first process;

[0253] In response to a process switching operation triggered by the cloud computer application, a second interface of the cloud computer is displayed, and virtual operation controls deployed based on a second control scheme are displayed in the second interface; the second interface is a display interface corresponding to the second process indicated by the process switching operation, and the second control scheme is a control scheme corresponding to the second process determined based on a target mapping relationship, and the target mapping relationship is used to indicate the control schemes corresponding to multiple processes.

[0254] Optionally, the processor 1280 is further used to execute the steps of any implementation method of the control display method provided in the embodiments of the present application.

[0255] See also Fig.13 , Fig.13 A schematic diagram of the structure of a server 1300 provided for an embodiment of the present application. The server 1300 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 1322 (for example, one or more processors) and a memory 1332, and one or more storage media 1330 (for example, one or more mass storage devices) storing application programs 1342 or data 1344. Among them, the memory 1332 and the storage medium 1330 may be temporary storage or permanent storage. The program stored in the storage medium 1330 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the central processing unit 1322 may be configured to communicate with the storage medium 1330 to execute a series of instruction operations in the storage medium 1330 on the server 1300.

[0256] The server 1300 may also include one or more power supplies 1326, one or more wired or wireless network interfaces 1350, one or more input and output interfaces 1358, and / or one or more operating systems, such as Windows Server 2003. TM , Mac OS X TM , Unix TM ,Linux TM , FreeBSD TM etc.

[0257] The steps performed by the server in the above embodiment can be based on the Fig.13 The server structure shown.

[0258] The CPU 1322 is used to execute the following steps:

[0259] Displaying a first interface of the cloud computer through a cloud computer application, and displaying a virtual operation control deployed based on a first control scheme in the first interface; the first interface is a display interface corresponding to a first process in the cloud computer, and the first control scheme corresponds to the first process;

[0260] In response to a process switching operation triggered by the cloud computer application, a second interface of the cloud computer is displayed, and virtual operation controls deployed based on a second control scheme are displayed in the second interface; the second interface is a display interface corresponding to the second process indicated by the process switching operation, and the second control scheme is a control scheme corresponding to the second process determined based on a target mapping relationship, and the target mapping relationship is used to indicate the control schemes corresponding to multiple processes.

[0261] Optionally, the CPU 1322 may also be used to execute steps of any implementation of the control display method provided in the embodiments of the present application.

[0262] An embodiment of the present application also provides a computer-readable storage medium for storing a computer program, wherein the computer program is used to execute any one of the implementation methods of a control display method described in the aforementioned embodiments.

[0263] The embodiment of the present application also provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes any one of the implementations of the control display method described in the above embodiments.

[0264] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0265] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0266] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0267] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0268] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store computer programs.

[0269] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0270] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A control display method, characterized in that: The method comprises: Displaying a first interface of the cloud computer through a cloud computer application, and displaying a virtual operation control deployed based on a first control scheme in the first interface; the first interface is a display interface corresponding to a first process in the cloud computer, and the first control scheme corresponds to the first process; In response to a process switching operation triggered by the cloud computer application, a second interface of the cloud computer is displayed, and virtual operation controls deployed based on a second control scheme are displayed in the second interface; the second interface is a display interface corresponding to the second process indicated by the process switching operation, and the second control scheme is a control scheme corresponding to the second process determined based on a target mapping relationship, and the target mapping relationship is used to indicate the control schemes corresponding to multiple processes.

2. The method according to claim 1, characterized in that The displaying of the virtual operation control deployed based on the second control solution in the second interface includes: Display control switching prompt information; the control switching prompt information is used to indicate the second control scheme to be switched; If a confirmation switching operation triggered by the control switching prompt information is received, a virtual operation control deployed based on the second control solution is displayed in the second interface.

3. The method according to claim 2, characterized in that The method further comprises: If a rejection switch operation is received based on the control switch prompt information, a control solution set is displayed; the control solution set includes a plurality of control solutions for controlling the cloud computer; In response to a control scheme selection operation triggered based on the control scheme set, a virtual operation control deployed based on a third control scheme is displayed in the second interface; the third control scheme is the control scheme selected by the control scheme selection operation.

4. The method according to claim 1, characterized in that: The method further comprises: In response to the triggered control scheme viewing operation, a control scheme set is displayed, in which a target control scheme corresponding to a virtual operation control in a current interface of the cloud computer is highlighted; the control scheme set includes a plurality of control schemes for operating the cloud computer.

5. The method according to claim 4, characterized in that The method further comprises: In response to a control scheme selection operation triggered based on the control scheme set, the virtual operation control deployed based on the target control scheme in the current interface is switched to a virtual operation control deployed based on a fourth control scheme; the fourth control scheme is the control scheme selected by the control scheme selection operation.

6. The method according to claim 1, characterized in that The step of responding to the process switching operation triggered by the cloud computer application, displaying a second interface of the cloud computer, and displaying a virtual operation control deployed based on a second control scheme in the second interface, includes: In response to the process switching operation triggered by the cloud computer application, a first sub-interface of the target application in the cloud computer is displayed, and a virtual operation control deployed based on a first sub-control scheme is displayed in the first sub-interface; the target application is an application corresponding to the second process, and the first sub-control scheme is a control scheme included in the second control scheme and corresponding to the first sub-interface.

7. The method according to claim 6, characterized in that The method further comprises: In response to an interface switching operation for the target application triggered by the cloud computer application, a second sub-interface of the target application is displayed, and a virtual operation control deployed based on a second sub-control scheme is displayed in the second sub-interface; the second sub-control scheme is a control scheme included in the second control scheme and corresponding to the second sub-interface.

8. The method according to claim 1, characterized in that The step of responding to the process switching operation triggered by the cloud computer application, displaying a second interface of the cloud computer, and displaying a virtual operation control deployed based on a second control scheme in the second interface, includes: In response to a process overview operation triggered by the cloud computer application, a process list of the cloud computer is displayed; the process list includes each process on the cloud computer and its corresponding control scheme; In response to a process selection operation triggered based on the process list, the second interface corresponding to the second process indicated by the process selection operation is displayed, and a virtual operation control deployed based on the second control scheme is displayed in the second interface.

9. The method according to claim 1, characterized in that: The second control scheme is determined by: Obtaining process information on the cloud computer; Determining the second process running in the foreground of the cloud computer according to the process information; Determining a target application corresponding to the second process according to a process-application mapping relationship in the target mapping relationship; the process-application mapping relationship records a correspondence between a process and an application; The second control scheme corresponding to the target application is determined according to the information control mapping relationship in the target mapping relationship and the target application description information corresponding to the target application; the information control mapping relationship records the correspondence between the application description information and the control scheme.

10. The method according to claim 9, characterized in that The information control mapping relationship records the correspondence between description keywords and control schemes; the determining the second control scheme corresponding to the target application according to the information control mapping relationship in the target mapping relationship and the target application description information corresponding to the target application includes: Determine, by a semantic analysis model, a target keyword corresponding to the target application according to target application description information corresponding to the target application; the target application description information includes at least one of an application name of the target application, application introduction content, and key object introduction content in the target application; According to the information control mapping relationship, a control scheme corresponding to the target keyword is determined as the second control scheme corresponding to the target application.

11. The method according to claim 9 or 10, characterized in that: In the case where multiple corresponding control schemes are determined for the target application, determining the second control scheme corresponding to the target application according to the information control mapping relationship in the target mapping relationship and the target application description information corresponding to the target application includes: If the target object currently logging into the cloud computer application uses the target application for the first time, determining the control scheme with the largest number of historical uses among the multiple control schemes corresponding to the target application as the second control scheme; If it is not the first time that the target object uses the target application, the control scheme used by the target object when using the target application last time is determined as the second control scheme; or the control scheme used most times by the target object is determined among multiple control schemes corresponding to the target application as the second control scheme.

12. The method according to claim 1 or 9, characterized in that: The target mapping relationship is determined in the following manner: For the applications supported by the cloud computer, a control solution corresponding to the application is determined by generating a model through a pre-trained control solution, according to at least one reference information of the application type to which the application belongs, the usage rules corresponding to the application, and the functions provided by the application; For an application supported by the cloud computer, determining application description information corresponding to the application; Establishing a correspondence between the application description information and a control scheme corresponding to the application; recording the correspondence between the application description information and the control scheme, and the correspondence between the application and the process into the target mapping relationship.

13. The method according to claim 1, characterized in that The displaying of the virtual operation control deployed based on the second control solution in the second interface includes: According to the display attribute information of the target terminal carrying the cloud computer application, the second control scheme is adjusted to obtain a target second control scheme; A virtual operation control deployed based on the target second control solution is displayed in the second interface.

14. The method according to claim 1, characterized in that The displaying of the virtual operation control deployed based on the second control solution in the second interface includes: Acquire operation habit information of a target object when using a reference application; the target object is a current login object of the cloud computer application, and the reference application and the target application corresponding to the second process are applications of the same type; According to the operation habit information, the second control scheme is adjusted to obtain a target second control scheme; A virtual operation control deployed based on the target second control solution is displayed in the second interface.

15. The method according to claim 1, characterized in that After displaying the virtual operation control deployed based on the second control solution in the second interface, the method further includes: If the target object triggers a target error operation more than a preset number of times at the target position in the second interface, the second control scheme is adjusted based on the operation intention corresponding to the target error operation and the target position, and a virtual operation control corresponding to the operation intention is deployed at the target position to obtain a target second control scheme; Among them, the target object is the current login object of the cloud computer application; the operation intention corresponding to the target error operation is determined by analyzing the current operation scenario of the target object and the operation triggered by the target object within a preset time period.

16. The method according to claim 1, characterized in that The method further comprises: For the second control scheme, based on usage of each virtual operation control deployed based on the second control scheme by multiple users, determining usage information of each virtual operation control in the second control scheme; According to the usage information of each virtual operation control in the second control solution, the second control solution is adjusted to obtain a target second control solution.

17. The method according to claim 16, characterized in that The adjusting the second control scheme according to the usage information of each virtual operation control in the second control scheme includes: For each virtual operation control deployed in the high-frequency operation area in the second control scheme, determine whether the usage frequency of the virtual operation control is higher than a first frequency threshold, if so, keep the virtual operation control deployed in the high-frequency operation area, if not, adjust the virtual operation control to be deployed in the low-frequency operation area; For each virtual operation control deployed in the low-frequency operation area in the second control scheme, determine whether the usage frequency of the virtual operation control is higher than the second frequency threshold. If so, adjust the virtual operation control to the high-frequency operation area for deployment; if not, keep the virtual operation control deployed in the low-frequency operation area.

18. The method according to any one of claims 13 to 17, characterized in that The method further comprises: The correspondence between the target second control scheme and the second process is recorded in the target mapping relationship, so that the next time an operation for the second process triggered by the target object is received, the operation control deployed based on the target second control scheme is displayed in the second interface, and the target object is the current login object of the cloud computer application.

19. A control display device, characterized in that: The device comprises: A first display module, used to display a first interface of the cloud computer through a cloud computer application, and to display virtual operation controls deployed based on a first control scheme in the first interface; the first interface is a display interface corresponding to a first process in the cloud computer, and the first control scheme corresponds to the first process; A second display module is used to respond to a process switching operation triggered by the cloud computer application, display a second interface of the cloud computer, and display virtual operation controls deployed based on a second control scheme in the second interface; the second interface is a display interface corresponding to the second process indicated by the process switching operation, and the second control scheme is a control scheme corresponding to the second process determined based on a target mapping relationship, and the target mapping relationship is used to indicate the control schemes corresponding to multiple processes.

20. A computer device, characterized in that: The device includes a processor and a memory; The memory is used to store computer programs; The processor is used to execute the control display method according to any one of claims 1 to 18 according to the computer program.

21. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store a computer program, and when the computer program is executed by a computer device, the control display method according to any one of claims 1 to 18 is implemented.

22. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the control display method according to any one of claims 1 to 18 is implemented.

Images