Cloud terminal client control method and device, computer device, readable storage medium and program product

Abstract

The application relates to a cloud terminal client control method and device, computer equipment, a readable storage medium and a program product, which are applied to the technical field of big data, and the method comprises the following steps: when it is detected that a cloud terminal client is in a connection state, a target display component belonging to a preset terminal on a cloud terminal display interface of the cloud terminal client is displayed, the preset terminal is a terminal in which the cloud terminal client is deployed, and a target function component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state; if a component triggering operation for the target display component is detected, component triggering event data is generated in the preset terminal; the component triggering event data is forwarded to the cloud terminal client through the preset terminal, and the cloud terminal client responds to the component triggering operation based on the component triggering event data. The control accuracy of the cloud terminal client can be improved by adopting the method.

Description

Technical Field

[0001] This application relates to the field of big data technology, and in particular to a cloud terminal client control method, device, computer equipment, computer-readable storage medium, and computer program product. Background Technology

[0002] Cloud terminal technology refers to an operating system virtualized on a server, which has the function of a virtual terminal. By controlling the cloud terminal client, the corresponding physical terminal can run in the cloud. Cloud terminal technology combines virtualization, cloud computing, network optimization, video encoding and security technologies, making its application increasingly widespread.

[0003] Cloud terminal clients are typically deployed on terminals. When users use cloud terminal clients, they may be unfamiliar with them, which can easily lead to misoperation of the cloud terminal and result in low control accuracy of the cloud terminal client. Summary of the Invention

[0004] Therefore, it is necessary to provide a cloud terminal client control method, device, computer equipment, computer-readable storage medium, and computer program product that can improve the control accuracy of cloud terminal clients, in response to the above-mentioned technical problems.

[0005] Firstly, this application provides a cloud terminal client control method, including:

[0006] When the cloud terminal client is detected to be connected, the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client is displayed. The preset terminal is the terminal on which the cloud terminal client is deployed. The target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state.

[0007] If a component triggering operation is detected for the target display component, component triggering event data is generated in the preset terminal;

[0008] The preset terminal forwards the component trigger event data to the cloud terminal client, and the cloud terminal client responds to the component trigger operation based on the component trigger event data.

[0009] Secondly, this application also provides a cloud terminal client control device, including:

[0010] The display module is used to display the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client when the cloud terminal client is detected to be in a connected state. The preset terminal is the terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state.

[0011] The generation module is used to generate component trigger event data in the preset terminal if a component trigger operation for the target display component is detected.

[0012] The response module is used to forward the component trigger event data to the cloud terminal client through the preset terminal, and to respond to the component trigger operation through the cloud terminal client based on the component trigger event data.

[0013] Thirdly, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0014] When the cloud terminal client is detected to be connected, the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client is displayed. The preset terminal is the terminal on which the cloud terminal client is deployed. The target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state.

[0015] If a component triggering operation is detected for the target display component, component triggering event data is generated in the preset terminal;

[0016] The preset terminal forwards the component trigger event data to the cloud terminal client, and the cloud terminal client responds to the component trigger operation based on the component trigger event data.

[0017] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, performs the following steps:

[0018] When the cloud terminal client is detected to be connected, the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client is displayed. The preset terminal is the terminal on which the cloud terminal client is deployed. The target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state.

[0019] If a component triggering operation is detected for the target display component, component triggering event data is generated in the preset terminal;

[0020] The preset terminal forwards the component trigger event data to the cloud terminal client, and the cloud terminal client responds to the component trigger operation based on the component trigger event data.

[0021] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, performs the following steps:

[0022] When the cloud terminal client is detected to be connected, the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client is displayed. The preset terminal is the terminal on which the cloud terminal client is deployed. The target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state.

[0023] If a component triggering operation is detected for the target display component, component triggering event data is generated in the preset terminal;

[0024] The preset terminal forwards the component trigger event data to the cloud terminal client, and the cloud terminal client responds to the component trigger operation based on the component trigger event data.

[0025] The aforementioned cloud terminal client control method, apparatus, computer equipment, computer-readable storage medium, and computer program product, when detecting that the cloud terminal client is in a connected state, display target display components belonging to a preset terminal on the cloud terminal display interface of the cloud terminal client, wherein the preset terminal is a terminal on which the cloud terminal client is deployed, and the target functional components belonging to the cloud terminal client on the cloud terminal display interface are in a hidden state; if a component triggering operation is detected for the target display component, component triggering event data is generated in the preset terminal; the component triggering event data is forwarded to the cloud terminal client through the preset terminal, and the cloud terminal client responds to the component triggering operation based on the component triggering event data. When the cloud terminal client is in a connected state, the target display components belonging to the cloud terminal client on the cloud terminal display interface are hidden, and the target display components belonging to the preset terminal on the cloud terminal display interface are displayed. At this time, the user can perform component triggering operations on the target display components still displayed on the cloud terminal display interface, avoiding accidental operation of the cloud terminal client and improving the control accuracy of the cloud terminal client. Attached Figure Description

[0026] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0027] Figure 1 This is an application environment diagram of the cloud terminal client control method in one embodiment;

[0028] Figure 2 This is a flowchart illustrating a cloud terminal client control method in one embodiment;

[0029] Figure 3 This is a schematic diagram of the display interfaces of two terminals in a scenario of one embodiment;

[0030] Figure 4 This is a schematic diagram of the cloud terminal display interface in one scenario of an embodiment;

[0031] Figure 5 This is a flowchart illustrating the target display component determination step in one embodiment;

[0032] Figure 6 This is a flowchart illustrating the steps of generating component trigger event data in a preset terminal in one embodiment;

[0033] Figure 7 This is a structural block diagram of a cloud terminal client control device in one embodiment;

[0034] Figure 8 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0035] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0036] It should be noted that all information and data involved in this application (including but not limited to data used for analysis, stored data, and displayed data) are information and data authorized by the user or fully authorized by all parties, and the acquisition, transmission, storage, use, and processing of the relevant data comply with the relevant provisions of national laws and regulations. Users can refuse or easily refuse content pushed to them (e.g., the primary display layout of the cloud terminal). In the embodiments of this application, certain existing solutions in the industry, such as software, components, and models, may be mentioned. These should be considered exemplary, and their purpose is merely to illustrate the feasibility of implementing the technical solution of this application, but does not mean that the applicant has already used or necessarily used such a solution.

[0037] The cloud terminal client control method provided in this application embodiment can be applied to, for example, Figure 1 In the application environment shown, terminal 102 communicates with server 104 via a network. A data storage system can store the data that terminal 102 needs to process. The data storage system can be integrated on server 104 or placed in the cloud or on other network servers. When terminal 102 detects that the cloud terminal client is connected, it displays the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client. The preset terminal is a terminal with the cloud terminal client deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is hidden. If a component trigger operation is detected targeting the display component, component trigger event data is generated in the preset terminal. The component trigger event data is forwarded to the cloud terminal client through the preset terminal, and the cloud terminal client responds to the component trigger operation based on the component trigger event data. Terminal 102 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices can be smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, projection devices, etc. Portable wearable devices can be smartwatches, smart bracelets, head-mounted devices, etc. Headset devices can be virtual reality (VR) devices, augmented reality (AR) devices, smart glasses, etc. Server 104 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services.

[0038] In one exemplary embodiment, such as Figure 2 As shown, a cloud terminal client control method is provided, which is applied to... Figure 1 Taking terminal 102 as an example, the explanation includes the following steps 202 to 206. Wherein:

[0039] Step 202: When the cloud terminal client is detected to be connected, the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client is displayed. The preset terminal is the terminal on which the cloud terminal client is deployed. The target functional component belonging to the cloud terminal client on the cloud terminal display interface is hidden.

[0040] The target display component in step 202 includes at least one of the following: a navigation bar display component, a virtual keyboard display component, a gesture display component, and an application display component.

[0041] For example, displaying a target display component belonging to a preset terminal on the cloud terminal display interface of the cloud terminal client includes: selecting a target display component from the cloud terminal display interface of the cloud terminal client; detecting a target display component belonging to a preset terminal on the cloud terminal display interface of the cloud terminal client; detecting a target display component belonging to the cloud terminal client on the cloud terminal display interface of the cloud terminal client; displaying the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client; and hiding the target display component belonging to the cloud terminal client on the cloud terminal display interface of the cloud terminal client.

[0042] Further, as an embodiment, selecting a target display component from the cloud terminal display interface of the cloud terminal client includes: selecting display components that belong to both the preset terminal and the cloud terminal client on the cloud terminal display interface as the target display component. For example, display component A has display component a belonging to the preset terminal and display component b belonging to the cloud terminal client on the cloud terminal display interface (at this time, display component a and display component b are both display component A); display component B has display component c belonging to the preset terminal on the cloud terminal display interface, but no display component belonging to the cloud terminal client (at this time, display component c is also display component B); display component C has display component d belonging to the cloud terminal client on the cloud terminal display interface, but no display component belonging to the preset terminal (at this time, display component d is also display component C). Then, display component A is selected as the target display component.

[0043] Step 204: If a component triggering operation is detected for the target display component, generate component triggering event data in the preset terminal.

[0044] The component triggering operation in step 204 includes, but is not limited to, component click operation and component gesture action, and the component gesture action includes at least one of component drag gesture action and component swipe gesture action.

[0045] As one embodiment, generating component trigger event data in a preset terminal includes: generating component trigger event data through the preset terminal according to the trigger event logic of the component trigger operation in the preset terminal.

[0046] As one embodiment, step 204 includes: obtaining a first component trigger file corresponding to a preset terminal, wherein the first component trigger file includes the correspondence between each preset trigger operation and preset trigger event data; querying the first component trigger file according to the component trigger operation to obtain the component trigger event data.

[0047] Further, based on the component trigger event data, the first component trigger file is queried to obtain the component trigger event data, including: obtaining the first matching degree between the component trigger operation and each preset trigger operation in the first component trigger file, selecting the target trigger operation whose first matching degree satisfies the first preset matching degree condition from each preset trigger operation in the first component trigger file, and determining the preset trigger event data corresponding to the target trigger operation as the component trigger event data.

[0048] Specifically, the first matching degree between the component triggering operation and each preset triggering operation in the first component triggering file can be the first similarity between the component triggering operation and each preset triggering operation in the first component triggering file, or it can be determined by the first similarity between the component triggering operation and each preset triggering operation in the first component triggering file. The higher the first similarity, the higher the first matching degree.

[0049] Furthermore, the first preset matching degree condition can be the maximum value among all the first matching degrees corresponding to the preset triggering operations, or it can be greater than the first preset matching degree threshold, without any restriction here.

[0050] Step 206: The component trigger event data is forwarded to the cloud terminal client through the preset terminal, and the component trigger operation is responded to by the cloud terminal client based on the component trigger event data.

[0051] For example, responding to a component triggering operation based on component triggering event data through a cloud terminal client includes: executing component triggering event data through the cloud terminal client to respond to the component triggering operation.

[0052] It is understandable that the same control operation may result in different terminal controls on different terminals, as shown in the following example. Figure 3 , Figure 3The navigation bar components in the display interfaces of terminals A and B are arranged differently. Therefore, clicking the component in the middle of the navigation bar triggers a different action: opening the homepage in terminal A, while returning in terminal B. In this case, the display interface of the cloud terminal client might be set differently. Figure 3 As shown in Terminal A, the display interface settings of the preset terminal with cloud terminals deployed are as follows: Figure 3 As shown in terminal B, the cloud terminal display interface is as follows: Figure 4 As shown, the navigation bar components belonging to the cloud terminal client and the preset terminal overlap in the cloud terminal display interface. After executing this cloud terminal client control method, the navigation bar component belonging to the cloud terminal client is hidden in the cloud terminal display interface, and the navigation bar component belonging to the preset terminal is displayed, making the cloud terminal restricted interface as shown... Figure 3 The display interface of terminal B allows users to trigger operations on the navigation bar components belonging to the preset terminal, avoiding accidental operation of the navigation bar components and improving the control accuracy of the navigation bar components in the cloud terminal client.

[0053] As an embodiment, the method further includes at least one of the following: if it is detected that the terminal display interface of the preset terminal also includes at least one display interface, then it is determined that the cloud terminal client is in a connected state; if it is detected that there is component display overlap on the cloud terminal display interface, then it is determined that the cloud terminal client is in a connected state; if it is detected that the cloud terminal client has a connection request or login request, then it is determined that the cloud terminal client is in a connected state.

[0054] Thus, when the cloud terminal display interface and the preset terminal display interface are different in size, the connectivity status of the cloud terminal client can be determined by detecting the additional display interfaces on the preset terminal display interface; when the cloud terminal display interface and the terminal display interface are the same in size, the connectivity status of the cloud terminal client can also be determined by detecting the component display of the cloud terminal display interface; when the cloud terminal display interface and the terminal display interface are the same in size and there is no component display overlap on the cloud terminal display interface, the connectivity status of the cloud terminal client can also be determined by detecting the connection request or login request sent by the cloud terminal client.

[0055] As one embodiment, the cloud terminal client includes a foreground environment identification component, which detects the connectivity status of the cloud terminal client.

[0056] In the aforementioned cloud terminal client control method, when the cloud terminal client is detected to be connected, the target display component belonging to a preset terminal on the cloud terminal display interface of the cloud terminal client is displayed. The preset terminal is a terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is hidden. If a component trigger operation is detected targeting the display component, component trigger event data is generated in the preset terminal. The preset terminal forwards the component trigger event data to the cloud terminal client, and the cloud terminal client responds to the component trigger operation based on the component trigger event data. When the cloud terminal client is connected, the target display component belonging to the cloud terminal client on the cloud terminal display interface is hidden, and the target display component belonging to the preset terminal on the cloud terminal display interface is displayed. At this time, the user can perform component trigger operations on the target display component still displayed on the cloud terminal display interface, avoiding accidental operation of the cloud terminal client and improving the control accuracy of the cloud terminal client.

[0057] In one exemplary embodiment, such as Figure 5 As shown, a method for accurately determining a target display component is provided, which includes steps 302 to 304 before displaying the target display component belonging to a preset terminal on the cloud terminal display interface of the cloud terminal client. Wherein:

[0058] Step 302: Select the corresponding component trigger function from the display components belonging to the cloud terminal client on the cloud terminal display interface, and select the first display component that has the same component trigger function as the display components belonging to the preset terminal on the cloud terminal display interface.

[0059] Among them, the component triggering function is the function implemented by triggering operations on the display component.

[0060] For example, step 302 includes: obtaining the component triggering functions of each display component belonging to the cloud terminal client on the cloud terminal display interface, and obtaining the component triggering functions of the display components belonging to the preset terminal on the cloud terminal display interface; selecting a corresponding component triggering function from each display component belonging to the cloud terminal client on the cloud terminal display interface, based on the component triggering functions of each display component belonging to the cloud terminal client on the cloud terminal display interface and the component triggering functions of the display components belonging to the preset terminal on the cloud terminal display interface, and selecting a first display component that has the same component triggering function as the display component belonging to the preset terminal on the cloud terminal display interface.

[0061] Step 304: Select target display components that pose a risk of false triggering from each of the first display components.

[0062] As an example, step 304 includes: detecting the triggering status of each first display component according to the component position of each display component on the cloud terminal display interface, obtaining the triggering status detection result, and selecting the target display component with the corresponding triggering status detection result that represents the risk of false triggering from each first display component.

[0063] As one embodiment, the triggering status of each first display component is detected based on the component positions of each display component on the cloud terminal display interface to obtain a triggering status detection result. This includes: for each first display component, determining the component position distance between the first display component and each display component on the cloud terminal display interface based on the component positions of each display component on the cloud terminal display interface; detecting the triggering status of each first display component based on the component position distance between the first display component and each display component on the cloud terminal display interface to obtain a triggering status detection result. The smaller the component position distance, the more the triggering status detection result indicates a risk of false triggering.

[0064] In another embodiment, step 304 includes at least one of the following: selecting target display components from each of the first display components whose corresponding component positions overlap; selecting target display components from each of the first display components whose corresponding component positions have a component spacing distance of less than a preset distance threshold with respect to the display components on the cloud terminal display interface.

[0065] The preset distance threshold is a critical value for the component spacing between the display component and the display component on the cloud terminal display interface when the display component is at risk of misoperation.

[0066] As one embodiment, selecting target display components from each first display component where the corresponding component positions have overlapping areas includes: for each first display component, capturing the component display image of the first display component in the cloud terminal display interface, and selecting target display components from each first display component where the corresponding component display images have overlapping areas.

[0067] As another embodiment, selecting target display components from each first display component where there is a component overlap area includes: selecting target display components from each first display component where the corresponding component position distance is 0.

[0068] In this embodiment, by selecting the corresponding component trigger function from each display component belonging to the cloud terminal client on the cloud terminal display interface, and the first display component having the same component trigger function as the display component belonging to the preset terminal on the cloud terminal display interface; and filtering the target display component with the risk of false triggering from each first display component, it is ensured that the target display component belongs to both the cloud terminal display interface and the preset terminal on the cloud terminal display interface, and that the target display component has the risk of false triggering. This achieves accurate display and hiding of the target display component and improves the accuracy of controlling the display state of the target display component.

[0069] In one exemplary embodiment, such as Figure 6 As shown, to provide an accurate method for generating component trigger event data, generating component trigger event data in a preset terminal includes steps 402 to 406. Wherein:

[0070] Step 402: Intercept and extract operation data of component-triggered operations through cloud terminal client to obtain operation interception data.

[0071] As one embodiment, step 402 includes: the cloud terminal client includes an operation interception module, which intercepts component-triggered operations and extracts operation data to obtain operation interception data.

[0072] Step 404: Send the operation interception data to the preset terminal through the cloud terminal client.

[0073] Step 406: Generate component trigger event data based on the operation interception data through a preset terminal.

[0074] For example, generating component trigger event data based on operation interception data includes: obtaining a second component trigger file corresponding to the cloud terminal client, wherein the second component trigger file includes a correspondence between preset operation data and preset component trigger event data; obtaining a second matching degree between the operation interception data and the second component trigger file; if there is first operation data in the second component trigger file whose second matching degree satisfies the second preset matching degree condition, then the preset component trigger event data corresponding to the first operation data in the second component trigger file is determined as component trigger event data; if there is no first operation data in the second component trigger file whose second matching degree satisfies the second preset matching degree condition, then the operation interception data is parsed through a preset terminal to obtain component control intent information, and the component control intent information is sent to the cloud terminal client; the component trigger event data is generated by the cloud terminal client based on the component control intent information.

[0075] Thus, for cases where the cloud terminal client can respond normally to component trigger operations, the component trigger event data can be filtered by querying the second component trigger file. For cases where the cloud terminal client cannot respond normally to component trigger operations, the component control intent information corresponding to the preset terminal analysis operation interception data can be used to generate component trigger event data that the cloud terminal client can respond to, thereby enabling the cloud terminal client to respond normally to component trigger operations.

[0076] As one embodiment, obtaining component control intent information by parsing operation interception data through a preset terminal includes: parsing operation interception data through a preset terminal, predicting the control intent to be achieved by the preset terminal executing the operation interception data, and obtaining component control intent information.

[0077] As another embodiment, the component control intent information is obtained by parsing the operation interception data through a preset terminal, including: obtaining a third component trigger file corresponding to the preset terminal, wherein the third component trigger file includes the correspondence between each preset operation data and the preset operation intent information; and querying the third component trigger file according to the operation interception data to obtain the component control intent information.

[0078] Furthermore, based on the operation interception data, the second component trigger file is queried to obtain component control intent information, including: obtaining the third matching degree between the operation interception data and each preset operation data in the third component trigger file, selecting the target operation data whose third matching degree meets the third preset matching degree condition from each preset operation data in the third component trigger file, and determining the preset operation intent information corresponding to the target operation data as component control intent information.

[0079] Optionally, the specific generation methods of the second matching degree, the second preset matching degree condition, the third matching degree, and the third preset matching degree condition can refer to the specific generation steps of the first matching degree and the first preset matching degree condition in step 204 above, and will not be repeated here.

[0080] In this embodiment, the component-triggered operation is intercepted and the operation data is extracted through the cloud terminal client to obtain operation interception data; the operation interception data is sent to a preset terminal through the cloud terminal client; the preset terminal generates component-triggered event data based on the operation interception data; and the generation of component-triggered event data for the cloud terminal client response is realized through data interaction between the cloud terminal client and the preset terminal.

[0081] As a detailed embodiment, if it is detected that the terminal display interface of the preset terminal also includes at least one display interface, it is determined that the cloud terminal client is in a connected state; if it is detected that there is component display overlap on the cloud terminal display interface, it is determined that the cloud terminal client is in a connected state; if it is detected that the cloud terminal client has a connection request or login request, it is determined that the cloud terminal client is in a connected state; when the cloud terminal client is detected to be in a connected state, a corresponding component trigger function is selected from the display components belonging to the cloud terminal client on the cloud terminal display interface, and a first display component with the same component trigger function as the display components belonging to the preset terminal on the cloud terminal display interface is selected; a target display component with a component overlapping area is selected from each of the first display components; a target display component with a component spacing distance of less than a preset distance threshold is selected from each of the first display components.

[0082] Furthermore, if a component trigger operation targeting the target display component is detected, the component trigger operation is intercepted and the operation data is extracted through the cloud terminal client to obtain operation interception data; the operation interception data is sent to a preset terminal through the cloud terminal client; the operation interception data is parsed by the preset terminal to obtain component control intent information, and the component control intent information is sent to the cloud terminal client; the component trigger event data is generated by the cloud terminal client based on the component control intent information; the component trigger event data is forwarded to the cloud terminal client through the preset terminal, and the component trigger operation is responded to by the cloud terminal client based on the component trigger event data.

[0083] Thus, by detecting that the cloud terminal client is connected, the target display component belonging to the preset terminal is displayed on the cloud terminal display interface of the cloud terminal client. The preset terminal is the terminal with the cloud terminal client deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is hidden. If a component trigger operation is detected targeting the display component, component trigger event data is generated in the preset terminal. The preset terminal forwards the component trigger event data to the cloud terminal client, and the cloud terminal client responds to the component trigger operation based on the component trigger event data. When the cloud terminal client is connected, the target display component belonging to the cloud terminal client on the cloud terminal display interface is hidden, and the target display component belonging to the preset terminal on the cloud terminal display interface is displayed. At this time, the user can perform component trigger operations on the target display component still displayed on the cloud terminal display interface, avoiding accidental operation of the cloud terminal client and improving the control accuracy of the cloud terminal client.

[0084] Furthermore, the cloud terminal client intercepts and extracts operation data from component triggering operations to obtain operation interception data. The cloud terminal client then sends this intercepted data to a preset terminal. Based on the intercepted data, the preset terminal generates component triggering event data. Through data interaction between the cloud terminal client and the preset terminal, the generation of component triggering event data for the cloud terminal client's response is achieved. Additionally, a first display component with the same triggering function as the display component belonging to the preset terminal on the cloud terminal display interface is selected from the various display components belonging to the cloud terminal client on the cloud terminal display interface. Target display components with a risk of false triggering are then filtered from these first display components. This ensures that the target display component corresponds to both the cloud terminal display interface and the preset terminal on the cloud terminal display interface, and also guarantees against the risk of false triggering. This achieves accurate display and hiding of target display components, improving the accuracy of controlling the display status of target display components.

[0085] It should be understood that although the steps in the flowcharts of the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0086] Based on the same inventive concept, this application also provides a cloud terminal client control device for implementing the cloud terminal client control method described above. The solution provided by this device is similar to the implementation described in the above method; therefore, the specific limitations in one or more cloud terminal client control device embodiments provided below can be found in the limitations of the cloud terminal client control method described above, and will not be repeated here.

[0087] In one exemplary embodiment, such as Figure 7 As shown, a cloud terminal client control device 700 is provided, including: a display module 702, a generation module 704, and a response module 706, wherein:

[0088] Display module 702 is used to display the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client when the cloud terminal client is detected to be in a connected state. The preset terminal is the terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state.

[0089] The generation module 704 is used to determine the control data corresponding to the control command on the cloud terminal based on the control command.

[0090] The response module 706 is used to control the cloud terminal based on the control data.

[0091] In one embodiment, before displaying the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client, the device further includes: a filtering module, used to select the corresponding component triggering function from each display component belonging to the cloud terminal client on the cloud terminal display interface, and a first display component with the same component triggering function as the display component belonging to the preset terminal on the cloud terminal display interface; and to filter the target display component with the risk of false triggering from each first display component.

[0092] In one embodiment, the filtering module is further configured to: filter target display components from each of the first display components whose corresponding component positions have overlapping areas; and filter target display components from each of the first display components whose corresponding component positions have component spacing distances less than a preset distance threshold with respect to the display components on the cloud terminal display interface.

[0093] In one embodiment, the generation module 704 is further configured to intercept and extract operation data from component-triggered operations via a cloud terminal client to obtain operation interception data; send the operation interception data to a preset terminal via the cloud terminal client; and generate component-triggered event data based on the operation interception data via the preset terminal.

[0094] In one embodiment, the generation module 704 is further configured to intercept data through a preset terminal parsing operation, obtain component control intent information, and send the component control intent information to the cloud terminal client; and generate component trigger event data through the cloud terminal client based on the component control intent information.

[0095] In one embodiment, the apparatus further includes a determining module, configured to: determine that the cloud terminal client is in a connected state if at least one display interface is detected on the terminal display interface of the preset terminal; determine that the cloud terminal client is in a connected state if overlapping components are detected on the cloud terminal display interface; or determine that the cloud terminal client is in a connected state if a connection request or login request is detected from the cloud terminal client.

[0096] Each module in the aforementioned cloud terminal client control device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to each module.

[0097] In one exemplary embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 8 As shown, the computer device includes a processor, memory, input / output interfaces, a communication interface, a display unit, and an input device. The processor, memory, and input / output interfaces are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interfaces. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The input / output interfaces are used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, Near Field Communication (NFC), or other technologies. When the computer program is executed by the processor, it implements a cloud terminal client control method. The display unit is used to form a visually visible image and can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.

[0098] Those skilled in the art will understand that Figure 8 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0099] In one exemplary embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above-described method embodiments.

[0100] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps in the above method embodiments.

[0101] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0102] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0103] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0104] The above embodiments merely illustrate several implementation methods of this application, and their descriptions are relatively specific and detailed, but they should not be construed as limiting the scope of this application's patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A cloud terminal client control method, characterized in that, The method includes: When the cloud terminal client is detected to be connected, the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client is displayed. The preset terminal is the terminal on which the cloud terminal client is deployed. The target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state. If a component triggering operation is detected for the target display component, component triggering event data is generated in the preset terminal; The preset terminal forwards the component trigger event data to the cloud terminal client, and the cloud terminal client responds to the component trigger operation based on the component trigger event data.

2. The method according to claim 1, characterized in that, Before displaying the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client, the method further includes: Select the corresponding component trigger function from the display components belonging to the cloud terminal client on the cloud terminal display interface, and select the first display component that has the same component trigger function as the display component belonging to the preset terminal on the cloud terminal display interface; Select target display components that pose a risk of false triggering from each of the first display components.

3. The method according to claim 2, characterized in that, Target display components with a risk of false triggering are selected from each of the first display components, including at least one of the following: Select target display components from each of the first display components whose corresponding component positions have overlapping areas; Select target display components from the first display components whose corresponding component positions exist and whose component spacing distance with the display components on the cloud terminal display interface is less than a preset distance threshold.

4. The method according to claim 1, characterized in that, The generation of component trigger event data in the preset terminal includes: The cloud terminal client is used to intercept the component-triggered operations and extract operation data to obtain operation interception data. The operation interception data is sent to the preset terminal via the cloud terminal client; Through the preset terminal, intercepted data based on the operation is used to generate component trigger event data.

5. The method according to claim 4, characterized in that, The step of generating component trigger event data through the preset terminal based on the operation interception data includes: The system parses the operation interception data through the preset terminal to obtain component control intent information, and then sends the component control intent information to the cloud terminal client. The cloud terminal client generates component trigger event data based on the component control intent information.

6. The method according to any one of claims 1 to 5, characterized in that, The method also includes at least one of the following: If it is detected that the terminal display interface of the preset terminal also includes at least one display interface, then it is determined that the cloud terminal client is in a connected state. If overlapping components are detected on the cloud terminal display interface, it is determined that the cloud terminal client is in a connected state. If a connection request or login request from a cloud terminal client is detected, it is determined that the cloud terminal client is in a connected state.

7. A cloud terminal client control device, characterized in that, The device includes: The display module is used to display the target display component belonging to the preset terminal on the cloud terminal display interface of the cloud terminal client when the cloud terminal client is detected to be in a connected state. The preset terminal is the terminal on which the cloud terminal client is deployed, and the target functional component belonging to the cloud terminal client on the cloud terminal display interface is in a hidden state. The generation module is used to generate component trigger event data in the preset terminal if a component trigger operation for the target display component is detected. The response module is used to forward the component trigger event data to the cloud terminal client through the preset terminal, and to respond to the component trigger operation through the cloud terminal client based on the component trigger event data.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

Images