Cloud terminal client control method and device, computer equipment, readable storage medium and program product

Abstract

The invention relates to a cloud terminal client control method and device, computer equipment, a readable storage medium and a program product, and is applied to the technical field of big data. A target display component, belonging to a preset terminal, on a cloud terminal display interface of the cloud terminal client is displayed, the preset terminal is a terminal deployed with the cloud terminal client, and a target function component, belonging to the cloud terminal client, on the cloud terminal display interface is in a hidden state; if a component triggering operation for the target display component is detected, generating component triggering event data in the preset terminal; and forwarding the component triggering event data to the cloud terminal client through the preset terminal, and responding to the component triggering operation based on the component triggering event data through the cloud terminal client. By adopting the method, the control accuracy of the cloud terminal client can be improved.

Description

Technical Field

[0001] The present application relates to the field of big data technology, and in particular to a cloud terminal client control method, device, computer equipment, computer-readable storage medium and computer program product. Background Art

[0002] Cloud terminal technology refers to an operating system virtualized on a server. It has the function of a virtual terminal and can realize the cloud operation of the physical terminal corresponding to the cloud terminal client by controlling the cloud terminal client. Cloud terminal technology combines virtualization, cloud computing, network optimization, video encoding and security technologies, making the application of cloud terminal technology more and more extensive.

[0003] A cloud terminal client is usually deployed on a terminal. When a user uses the cloud terminal client, it is easy for the user to misoperate the cloud terminal because the user may not be familiar with the cloud terminal client, resulting in low control accuracy of the cloud terminal client. Summary of the invention

[0004] Based on this, it is necessary to provide a cloud terminal client control method, device, computer equipment, computer readable storage medium and computer program product that can improve the control accuracy of the cloud terminal client in response to the above technical problems.

[0005] In a first aspect, the present application provides a cloud terminal client control method, comprising:

[0006] In the case where it is detected that the cloud terminal client is in a connected state, displaying a target display component belonging to a preset terminal on a cloud terminal display interface of the cloud terminal client, wherein the preset terminal is a terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state;

[0007] If a component triggering operation for the target display component is detected, generating component triggering event data in the preset terminal;

[0008] The component triggering event data is forwarded to the cloud terminal client through the preset terminal, and the component triggering operation is responded to based on the component triggering event data through the cloud terminal client.

[0009] In a second aspect, the present application also provides a cloud terminal client control device, including:

[0010] A display module is used to display a target display component belonging to a preset terminal on a cloud terminal display interface of the cloud terminal client when it is detected that the cloud terminal client is in a connected state, wherein the preset terminal is a terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state;

[0011] A generating module, configured to generate component triggering event data in the preset terminal if a component triggering operation for the target display component is detected;

[0012] The response module is used to forward the component trigger event data to the cloud terminal client through the preset terminal, and respond to the component trigger operation based on the component trigger event data through the cloud terminal client.

[0013] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0014] In the case where it is detected that the cloud terminal client is in a connected state, displaying a target display component belonging to a preset terminal on a cloud terminal display interface of the cloud terminal client, wherein the preset terminal is a terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state;

[0015] If a component triggering operation for the target display component is detected, generating component triggering event data in the preset terminal;

[0016] The component triggering event data is forwarded to the cloud terminal client through the preset terminal, and the component triggering operation is responded to based on the component triggering event data through the cloud terminal client.

[0017] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0018] In the case where it is detected that the cloud terminal client is in a connected state, displaying a target display component belonging to a preset terminal on a cloud terminal display interface of the cloud terminal client, wherein the preset terminal is a terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state;

[0019] If a component triggering operation for the target display component is detected, generating component triggering event data in the preset terminal;

[0020] The component triggering event data is forwarded to the cloud terminal client through the preset terminal, and the component triggering operation is responded to based on the component triggering event data through the cloud terminal client.

[0021] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0022] In the case where it is detected that the cloud terminal client is in a connected state, displaying a target display component belonging to a preset terminal on a cloud terminal display interface of the cloud terminal client, wherein the preset terminal is a terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state;

[0023] If a component triggering operation for the target display component is detected, generating component triggering event data in the preset terminal;

[0024] The component triggering event data is forwarded to the cloud terminal client through the preset terminal, and the component triggering operation is responded to based on the component triggering event data through the cloud terminal client.

[0025] The above-mentioned cloud terminal client control method, device, computer equipment, computer-readable storage medium and computer program product, by displaying the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client when it is detected that the cloud terminal client is in a connected state, wherein the preset terminal is a terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state; if a component triggering operation for the target display component is detected, component triggering event data is generated in the preset terminal; the component triggering event data is forwarded to the cloud terminal client through the preset terminal, and the cloud terminal client responds to the component triggering operation based on the component triggering event data, and when the cloud terminal client is in a connected state, the target display component belonging to the cloud terminal client on the cloud terminal display interface is hidden, and the target display component belonging to the preset terminal on the cloud terminal display interface is displayed, at this time, the user can perform a component triggering operation on the target display component still displayed on the cloud terminal display interface, thereby avoiding misoperation of the cloud terminal client and improving the control accuracy of the cloud terminal client. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0027] Figure 1 An application environment diagram of a cloud terminal client control method in an embodiment;

[0028] Figure 2 A schematic diagram of a flow chart of a cloud terminal client control method in one embodiment;

[0029] Figure 3 This is a schematic diagram of display interfaces of two terminals in a scenario in an embodiment;

[0030] Figure 4 This is a schematic diagram of a display interface of a cloud terminal in a scenario in an embodiment;

[0031] Figure 5 A schematic diagram of a flow chart of a target display component determination step in one embodiment;

[0032] Figure 6 A schematic diagram of a flow chart of steps for generating component trigger event data in a preset terminal in one embodiment;

[0033] Figure 7 It is a structural block diagram of a cloud terminal client control device in one embodiment;

[0034] Figure 8 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0036] It should be noted that the information and data involved in this application (including but not limited to data for analysis, stored data, displayed data, etc.) are all information and data authorized by the user or fully authorized by all parties, and the acquisition, transmission, storage, use and processing of relevant data are in compliance with the relevant provisions of national laws and regulations. For content pushed to users (for example, the first display layout of the cloud terminal, etc.), users can refuse or conveniently refuse content push, etc. In the embodiments of this application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of the implementation of the technical solution of this application, but it does not mean that the applicant has or will necessarily use the solution.

[0037] The cloud terminal client control method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Among them, the terminal 102 communicates with the server 104 through the network. The data storage system can store the data that the terminal 102 needs to process. The data storage system can be integrated on the server 104, or it can be placed on the cloud or other network servers. When the terminal 102 detects that the cloud terminal client is in a connected state, the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client is displayed, wherein the preset terminal is a terminal deployed with a cloud terminal client, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state; if a component trigger operation for the target display component is detected, component trigger event data is generated in the preset terminal; the component trigger event data is forwarded to the cloud terminal client through the preset terminal, and the component trigger operation is responded to based on the component trigger event data through the cloud terminal client. Among them, the terminal 102 can be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, Internet of Things devices and portable wearable devices, and the Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, projection devices, etc. Portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc. The head mounted device may be a virtual reality (VR) device, an augmented reality (AR) device, smart glasses, etc. The server 104 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services.

[0038] In an exemplary embodiment, Figure 2 As shown, a cloud terminal client control method is provided, which is applied to Figure 1 The terminal 102 in the example is used as an example to illustrate, including the following steps 202 to 206. Among them:

[0039] Step 202, when it is detected that the cloud terminal client is in a connected state, the target display component belonging to the preset terminal is displayed on the cloud terminal display interface of the cloud terminal client, wherein the preset terminal is a terminal deployed with the cloud terminal client, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state.

[0040] The target display component in step 202 includes at least one of a navigation bar display component, a virtual keyboard display component, a gesture display component, and an application display component.

[0041] Exemplarily, displaying a target display component belonging to a preset terminal on a cloud terminal display interface of a cloud terminal client includes: selecting a target display component from the cloud terminal display interface of the cloud terminal client; detecting a target display component belonging to a preset terminal on the cloud terminal display interface of the cloud terminal client, and detecting a target display component belonging to the cloud terminal client on the cloud terminal display interface of the cloud terminal client; displaying a target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client; and hiding a target display component belonging to the cloud terminal client on the cloud terminal display interface of the cloud terminal client.

[0042] Further, as an embodiment, selecting a target display component from a cloud terminal display interface of a cloud terminal client includes: selecting as the target display component a display component that corresponds to the preset terminal and the cloud terminal client on the cloud terminal display interface, for example, display component A corresponds to display component a belonging to the preset terminal and display component b belonging to the cloud terminal client on the cloud terminal display interface (in this case, display component a and display component b are both display component A); display component B corresponds to display component c belonging to the preset terminal on the cloud terminal display interface, and there is no display component belonging to the cloud terminal client (in this case, display component c is also display component B); display component C corresponds to display component d belonging to the cloud terminal client on the cloud terminal display interface, and there is no display component belonging to the preset terminal (in this case, display component d is also display component C), then, display component A is selected as the target display component.

[0043] Step 204: if a component triggering operation for a target display component is detected, component triggering event data is generated in a preset terminal.

[0044] The component triggering operation in step 204 includes but is not limited to a component clicking operation and a component gesture action, and the component gesture action includes at least one of a component dragging gesture action and a component sliding gesture action.

[0045] As an embodiment, generating component triggering event data in a preset terminal includes: generating component triggering event data through the preset terminal according to the triggering event logic of the component triggering operation in the preset terminal.

[0046] As an embodiment, step 204 includes: obtaining a first component trigger file corresponding to a preset terminal, wherein the first component trigger file includes a correspondence between each preset trigger operation and preset trigger event data; according to the component trigger operation, querying the first component trigger file to obtain the component trigger event data.

[0047] Furthermore, according to the component trigger event data, the first component trigger file is queried to obtain the component trigger event data, including: obtaining the first matching degree between the component trigger operation and each preset trigger operation in the first component trigger file, selecting the target trigger operation with the corresponding first matching degree that satisfies the first preset matching degree condition from each preset trigger operation in the first component trigger file, and determining the preset trigger event data corresponding to the target trigger operation as the component trigger event data.

[0048] Specifically, the first matching degree between the component trigger operation and each preset trigger operation in the first component trigger file can be the first similarity between the component trigger operation and each preset trigger operation in the first component trigger file, or can be determined by the first similarity between the component trigger operation and each preset trigger operation in the first component trigger file, wherein the higher the first similarity, the higher the first matching degree.

[0049] Furthermore, the first preset matching degree condition may be a maximum value among the first matching degrees corresponding to all preset triggering operations, or may be greater than a first preset matching degree threshold, which is not limited here.

[0050] Step 206: forward the component triggering event data to the cloud terminal client via the preset terminal, and respond to the component triggering operation based on the component triggering event data via the cloud terminal client.

[0051] Exemplarily, responding to a component triggering operation based on component triggering event data through a cloud terminal client includes: executing the component triggering event data through a cloud terminal client to respond to the component triggering operation.

[0052] It is understandable that the same control operation may be implemented differently in different terminals. Figure 3 , Figure 3The order of components of the navigation bar components in the display interface of terminal A and terminal B is different. Then, for the component triggering operation of clicking the component in the middle of the navigation bar component, the home page interface is opened in terminal A, while the return operation is performed in terminal B. In this case, the display interface of the cloud terminal client may be set as follows: Figure 3 As shown in the terminal A in FIG, the display interface of the preset terminal deployed with the cloud terminal is set as follows Figure 3 As shown in terminal B in the figure, at this time, the cloud terminal displays the interface as follows Figure 4 As shown, there is overlap between the navigation bar components belonging to the cloud terminal client and the preset terminal in the cloud terminal display interface. After executing the cloud terminal client control method, the navigation bar components belonging to the cloud terminal client in the cloud terminal display interface are hidden, and the navigation bar components belonging to the preset terminal in the cloud terminal display interface are displayed, so that the cloud terminal restriction interface is as shown in FIG. Figure 3 The display interface of terminal B in the cloud terminal client enables the user to perform component trigger operations on the displayed navigation bar component belonging to the preset terminal, thereby avoiding the user's misoperation of the navigation bar component and improving the control accuracy of the navigation bar component in the cloud terminal client.

[0053] As an embodiment, the method also includes at least one of the following: if it is detected that the terminal display interface of the preset terminal also includes at least one display interface, it is determined that the cloud terminal client is in a connected state; if it is detected that there is component display overlap on the cloud terminal display interface, it is determined that the cloud terminal client is in a connected state; if a connection request or login request of the cloud terminal client is detected, it is determined that the cloud terminal client is in a connected state.

[0054] In this way, when the size of the cloud terminal display interface and the terminal display interface of the preset terminal is different, the connectivity status of the cloud terminal client can be determined by detecting the display interface also included in the terminal display interface of the preset terminal; when the size of the cloud terminal display interface and the terminal display interface are the same, the connectivity status of the cloud terminal client can also be determined by detecting the component display status of the cloud terminal display interface; when the size of the cloud terminal display interface and the terminal display interface are the same and there is no component display overlap in the cloud terminal display interface, the connectivity status of the cloud terminal client can also be determined by detecting the connection request or login request sent by the cloud terminal client.

[0055] As an embodiment, the cloud terminal client includes a foreground environment recognition component, and the connectivity status of the cloud terminal client is detected by the foreground environment recognition component.

[0056] In the above-mentioned cloud terminal client control method, when it is detected that the cloud terminal client is in a connected state, the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client is displayed, wherein the preset terminal is a terminal deployed with the cloud terminal client, and the target function component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state; if a component triggering operation for the target display component is detected, component triggering event data is generated in the preset terminal; the component triggering event data is forwarded to the cloud terminal client through the preset terminal, and the cloud terminal client responds to the component triggering operation based on the component triggering event data, and when the cloud terminal client is in a connected state, the target display component belonging to the cloud terminal client on the cloud terminal display interface is hidden, and the target display component belonging to the preset terminal on the cloud terminal display interface is displayed, at this time, the user can perform a component triggering operation on the target display component still displayed on the cloud terminal display interface, thereby avoiding misoperation of the cloud terminal client and improving the control accuracy of the cloud terminal client.

[0057] In an exemplary embodiment, Figure 5 As shown, a method for accurately determining a target display component is provided, and before displaying the target display component belonging to a preset terminal on the cloud terminal display interface of the cloud terminal client, steps 302 to 304 are included. Among them:

[0058] Step 302 , selecting a corresponding component trigger function from display components belonging to the cloud terminal client on the cloud terminal display interface, and selecting a first display component having the same component trigger function as the display component belonging to the preset terminal on the cloud terminal display interface.

[0059] The component trigger function is a function implemented by a trigger operation on a display component.

[0060] Exemplarily, step 302 includes: obtaining the component trigger function of each display component belonging to the cloud terminal client on the cloud terminal display interface, and obtaining the component trigger function of the display component belonging to the preset terminal on the cloud terminal display interface; according to the component trigger function of each display component belonging to the cloud terminal client on the cloud terminal display interface and the component trigger function of the display component belonging to the preset terminal on the cloud terminal display interface, selecting the corresponding component trigger function from the display components belonging to the cloud terminal client on the cloud terminal display interface, and a first display component with the same component trigger function as the display component belonging to the preset terminal on the cloud terminal display interface.

[0061] Step 304 , screening target display components with a risk of false triggering from the first display components.

[0062] As an embodiment, step 304 includes: detecting the trigger status of each first display component according to the component position of each display component on the cloud terminal display interface, obtaining a trigger status detection result, and screening the corresponding trigger status detection result from each first display component to represent the target display component with a risk of false triggering.

[0063] As an embodiment, according to the component positions of each display component on the cloud terminal display interface, the triggering condition of each first display component is detected to obtain a triggering condition detection result, including: for each first display component, according to the component positions of each display component on the cloud terminal display interface, the component position distance between the first display component and each display component on the cloud terminal display interface is determined; according to the component position distance between the first display component and each display component on the cloud terminal display interface, the triggering condition of each first display component is detected to obtain a triggering condition detection result, wherein the smaller the component position distance, the more the triggering condition detection result represents the risk of false triggering.

[0064] As another embodiment, step 304 includes at least one of the following items: selecting from each first display component a target display component whose corresponding component position has a component position overlapping area; selecting from each first display component a target display component whose corresponding component position has a component spacing distance between the component and the display component on the cloud terminal display interface that is less than a preset distance threshold.

[0065] The preset distance threshold is a critical value of the component spacing distance between the display component and the display component on the cloud terminal display interface when it is determined that there is a risk of misoperation of the display component, which is set as needed.

[0066] As an embodiment, target display components whose corresponding component positions have component overlapping areas are screened out from each first display component, including: for each first display component, capturing a component display image of the first display component in a cloud terminal display interface, and screening target display components whose corresponding component display images have component overlapping areas from each first display component.

[0067] As another embodiment, selecting target display components whose corresponding component positions have component overlapping areas from each first display component includes: selecting target display components whose corresponding component positions have a distance of 0 from each first display component.

[0068] In the present embodiment, by selecting the corresponding component trigger function from each display component belonging to the cloud terminal client on the cloud terminal display interface, a first display component with the same component trigger function as the display component belonging to the preset terminal on the cloud terminal display interface is selected; and the target display component with the risk of false triggering is screened from each first display component. This not only ensures that the target display component on the cloud terminal display interface corresponds to the cloud terminal display interface and the preset terminal, but also ensures that the target display component has the risk of false triggering, thereby achieving accurate display and hiding of the target display component and improving the control accuracy of the display state of the target display component.

[0069] In an exemplary embodiment, Figure 6 As shown, in order to provide a method for accurately generating component trigger event data, generating component trigger event data in a preset terminal includes steps 402 to 406. Among them:

[0070] Step 402: intercept the component triggering operation and extract the operation data through the cloud terminal client to obtain the operation interception data.

[0071] As an embodiment, step 402 includes: the cloud terminal client includes an operation interception module, and the component triggering operation is intercepted and the operation data is extracted through the operation interception module to obtain the operation interception data.

[0072] Step 404: Send the operation interception data to a preset terminal via the cloud terminal client.

[0073] Step 406, through the preset terminal, intercept the data according to the operation, and generate component trigger event data.

[0074] Exemplarily, component trigger event data is generated based on operation interception data, including: obtaining a second component trigger file corresponding to a cloud terminal client, wherein the second component trigger file includes a correspondence between preset operation data and preset component trigger event data, obtaining a second matching degree between the operation interception data and the second component trigger file, if there is a corresponding first operation data with a second matching degree that satisfies a second preset matching degree condition in the second component trigger file, then the preset component trigger event data corresponding to the first operation data in the second component trigger file is determined as the component trigger event data; if there is no corresponding first operation data with a second matching degree that satisfies the second preset matching degree condition in the second component trigger file, then parsing the operation interception data through the preset terminal to obtain component control intent information, and sending the component control intent information to the cloud terminal client; generating component trigger event data through the cloud terminal client according to the component control intent information.

[0075] In this way, in the case where the cloud terminal client can respond normally to the component trigger operation, the component trigger event data can be filtered by querying the second component trigger file. In the case where the cloud terminal client cannot respond normally to the component trigger operation, the component control intention information corresponding to the data can be intercepted through the preset terminal analysis operation, thereby generating component trigger event data to which the cloud terminal client can respond, thereby enabling the cloud terminal client to respond normally to the component trigger operation.

[0076] As an embodiment, obtaining component control intention information by parsing operation interception data through a preset terminal includes: parsing operation interception data through a preset terminal, predicting the control intention to be achieved by the preset terminal executing the operation interception data, and obtaining component control intention information.

[0077] As another embodiment, the component control intention information is obtained by parsing the operation interception data through the preset terminal, including: obtaining a third component trigger file corresponding to the preset terminal, wherein the third component trigger file includes the correspondence between each preset operation data and the preset operation intention information; according to the operation interception data, querying the third component trigger file to obtain the component control intention information.

[0078] Furthermore, according to the operation interception data, the second component trigger file is queried to obtain component control intention information, including: obtaining the third matching degree between the operation interception data and each preset operation data in the third component trigger file, selecting the target operation data with the corresponding third matching degree that meets the third preset matching degree condition from each preset operation data in the third component trigger file, and determining the preset operation intention information corresponding to the target operation data as the component control intention information.

[0079] Optionally, the specific generation method of the second matching degree, the second preset matching degree condition, the third matching degree and the third preset matching degree condition may refer to the specific generation steps of the first matching degree and the first preset matching degree condition in the above step 204, which will not be repeated here.

[0080] In this embodiment, the component trigger operation is intercepted and the operation data is extracted through the cloud terminal client to obtain the operation interception data; the operation interception data is sent to the preset terminal through the cloud terminal client; the component trigger event data is generated through the preset terminal according to the operation interception data, and the generation of component trigger event data for the cloud terminal client response is realized through data interaction between the cloud terminal client and the preset terminal.

[0081] As a detailed embodiment, if it is detected that the terminal display interface of the preset terminal also includes at least one display interface, it is determined that the cloud terminal client is in a connected state; if it is detected that there is a component display overlap on the cloud terminal display interface, it is determined that the cloud terminal client is in a connected state; if a connection request or login request from the cloud terminal client is detected, it is determined that the cloud terminal client is in a connected state; when it is detected that the cloud terminal client is in a connected state, a first display component with a corresponding component trigger function and the same component trigger function as the display component of the preset terminal on the cloud terminal display interface is selected from each display component belonging to the cloud terminal client on the cloud terminal display interface; a target display component whose corresponding component position has a component overlapping area is filtered out from each first display component; a target display component whose corresponding component position has a component spacing distance with the display component on the cloud terminal display interface that is less than a preset distance threshold is filtered out from each first display component.

[0082] Furthermore, if a component trigger operation for a target display component is detected, the component trigger operation is intercepted and the operation data is extracted through the cloud terminal client to obtain operation interception data; the operation interception data is sent to a preset terminal through the cloud terminal client; the operation interception data is parsed through the preset terminal to obtain component control intention information, and the component control intention information is sent to the cloud terminal client; component trigger event data is generated through the cloud terminal client according to the component control intention information; the component trigger event data is forwarded to the cloud terminal client through the preset terminal, and the component trigger operation is responded to based on the component trigger event data through the cloud terminal client.

[0083] In this way, when it is detected that the cloud terminal client is in a connected state, the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client is displayed, wherein the preset terminal is a terminal with the cloud terminal client deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state; if a component triggering operation for the target display component is detected, component triggering event data is generated in the preset terminal; the component triggering event data is forwarded to the cloud terminal client through the preset terminal, and the cloud terminal client responds to the component triggering operation based on the component triggering event data, when the cloud terminal client is in a connected state, the target display component belonging to the cloud terminal client on the cloud terminal display interface is hidden, and the target display component belonging to the preset terminal on the cloud terminal display interface is displayed, at this time, the user can perform a component triggering operation on the target display component still displayed on the cloud terminal display interface, thereby avoiding misoperation of the cloud terminal client and improving the control accuracy of the cloud terminal client.

[0084] Furthermore, through the cloud terminal client, the component trigger operation is intercepted and the operation data is extracted to obtain the operation interception data; the operation interception data is sent to the preset terminal through the cloud terminal client; through the preset terminal, component trigger event data is generated according to the operation interception data, and through the data interaction between the cloud terminal client and the preset terminal, the generation of component trigger event data for the cloud terminal client response is realized, and the corresponding component trigger function is selected from each display component belonging to the cloud terminal client on the cloud terminal display interface, and the first display component with the same component trigger function as the display component belonging to the preset terminal on the cloud terminal display interface is selected; the target display component with the risk of false triggering is screened from each first display component, which not only ensures that the target display component corresponds to the cloud terminal display interface and the preset terminal on the cloud terminal display interface, but also ensures that the target display component has the risk of false triggering, realizes the accurate display and hiding of the target display component, and improves the control accuracy of the display state of the target display component.

[0085] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0086] Based on the same inventive concept, the embodiment of the present application also provides a cloud terminal client control device for implementing the cloud terminal client control method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more cloud terminal client control device embodiments provided below can refer to the limitations of the cloud terminal client control method above, and will not be repeated here.

[0087] In an exemplary embodiment, Figure 7 As shown, a cloud terminal client control device 700 is provided, including: a display module 702, a generation module 704 and a response module 706, wherein:

[0088] Display module 702, for displaying the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client when detecting that the cloud terminal client is in a connected state, wherein the preset terminal is a terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state;

[0089] A generating module 704 is used to determine the control data corresponding to the control instruction in the cloud terminal according to the control instruction;

[0090] The response module 706 is used to control the cloud terminal according to the control data.

[0091] In one of the embodiments, before displaying the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client, the device also includes: a screening module, used to select a corresponding component trigger function from each display component belonging to the cloud terminal client on the cloud terminal display interface, and a first display component with the same component trigger function as the display component belonging to the preset terminal on the cloud terminal display interface; and screen the target display component with a risk of false triggering from each first display component.

[0092] In one of the embodiments, the screening module is also used for at least one of the following: screening target display components whose corresponding component positions have component overlapping areas from each first display component; screening target display components whose corresponding component positions have component spacing distances with display components on the cloud terminal display interface that are less than a preset distance threshold from each first display component.

[0093] In one of the embodiments, the generation module 704 is also used to intercept the component trigger operation and extract the operation data through the cloud terminal client to obtain the operation interception data; send the operation interception data to the preset terminal through the cloud terminal client; and generate component trigger event data through the preset terminal according to the operation interception data.

[0094] In one of the embodiments, the generation module 704 is also used to intercept data through a preset terminal parsing operation, obtain component control intention information, and send the component control intention information to the cloud terminal client; generate component trigger event data through the cloud terminal client according to the component control intention information.

[0095] In one of the embodiments, the device also includes a determination module, which is used for at least one of the following items: if it is detected that the terminal display interface of the preset terminal also includes at least one display interface, it is determined that the cloud terminal client is in a connected state; if it is detected that there is component display overlap on the cloud terminal display interface, it is determined that the cloud terminal client is in a connected state; if a connection request or login request of the cloud terminal client is detected, it is determined that the cloud terminal client is in a connected state.

[0096] Each module in the above-mentioned cloud terminal client control device can be implemented in whole or in part by software, hardware and their combination. Each of the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the corresponding operations of each of the above modules.

[0097] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 8 As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (Near Field Communication, NFC) or other technologies. When the computer program is executed by the processor, a cloud terminal client control method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0098] Those skilled in the art will understand that Figure 8 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0099] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program.

[0100] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0101] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0102] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0103] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0104] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A cloud terminal client control method, characterized in that: The method comprises: In the case where it is detected that the cloud terminal client is in a connected state, displaying a target display component belonging to a preset terminal on a cloud terminal display interface of the cloud terminal client, wherein the preset terminal is a terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state; If a component triggering operation for the target display component is detected, generating component triggering event data in the preset terminal; The component triggering event data is forwarded to the cloud terminal client through the preset terminal, and the component triggering operation is responded to based on the component triggering event data through the cloud terminal client.

2. The method according to claim 1, characterized in that Before displaying the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client, the method further includes: Selecting a corresponding component trigger function from each display component belonging to the cloud terminal client on the cloud terminal display interface, a first display component having the same component trigger function as a display component belonging to a preset terminal on the cloud terminal display interface; Target display components with a risk of false triggering are screened from each of the first display components.

3. The method according to claim 2, characterized in that Screening target display components with a risk of false triggering from each of the first display components includes at least one of the following: Filtering target display components whose corresponding component positions have component overlapping areas from each of the first display components; A target display component is screened from each of the first display components, wherein a corresponding component position exists and a component spacing distance between the target display component and the display component on the display interface of the cloud terminal is less than a preset distance threshold.

4. The method according to claim 1, characterized in that The generating component triggering event data in the preset terminal includes: By means of the cloud terminal client, the component triggering operation is intercepted and the operation data is extracted to obtain the operation interception data; Sending the operation interception data to the preset terminal through the cloud terminal client; Through the preset terminal, data is intercepted according to the operation to generate component triggering event data.

5. The method according to claim 4, characterized in that The method of intercepting data according to the operation through the preset terminal to generate component triggering event data includes: Parsing the operation interception data through the preset terminal to obtain component control intention information, and sending the component control intention information to the cloud terminal client; The cloud terminal client generates component trigger event data according to the component control intention information.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises at least one of the following: If it is detected that the terminal display interface of the preset terminal also includes at least one display interface, it is determined that the cloud terminal client is in a connected state; If it is detected that there is a component display overlap on the cloud terminal display interface, it is determined that the cloud terminal client is in a connected state; If a connection request or a login request of a cloud terminal client is detected, it is determined that the cloud terminal client is in a connected state.

7. A cloud terminal client control device, characterized in that: The device comprises: A display module is used to display a target display component belonging to a preset terminal on a cloud terminal display interface of the cloud terminal client when it is detected that the cloud terminal client is in a connected state, wherein the preset terminal is a terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state; A generating module, configured to generate component triggering event data in the preset terminal if a component triggering operation for the target display component is detected; The response module is used to forward the component trigger event data to the cloud terminal client through the preset terminal, and respond to the component trigger operation based on the component trigger event data through the cloud terminal client.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images