Zero terminal, method, medium and device for interacting between zero terminal and cloud desktop

Abstract

The present application is about a zero terminal, a method, a medium and a device for interacting between a zero terminal and a cloud desktop. The method includes: the zero terminal displays the cloud desktop on a display at a distance, so that the head-mounted smart device captures the screen information of the display for projection display; the zero terminal establishes connections with the head-mounted smart device and the wrist-mounted smart device respectively; when the connection between the zero terminal and the head-mounted smart device is successfully established, the zero terminal receives the login request information of the user logging into the zero terminal sent by the head-mounted smart device, so that the user logs in to the zero terminal; when the connection between the zero terminal and the wrist-mounted smart device is successfully established, the zero terminal receives the control instructions sent by the head-mounted smart device and / or the wrist-mounted smart device. The present application replaces some keyboard and mouse operations by sending instructions to the zero terminal by the head-mounted smart device and the wrist-mounted smart device, which makes it more convenient for users to control the cloud desktop and improves the user experience.

Description

Background Art

[0002] Zero-terminal cloud desktop products are desktop office systems built based on cloud servers, zero-terminals, monitors, keyboards and mice. Their advantages are that they can be connected to work anytime and anywhere without geographical restrictions; their disadvantages are that they require zero-terminal boxes, monitors, keyboards and mice to be connected before they can be used. In the current era of AI intelligence, the demand for zero-terminal cloud desktop products has been developing in the direction of reducing or simplifying equipment in order to pursue greater portability. While moving towards simplifying equipment, how to make zero-terminals interact with cloud desktops has also become an issue that needs attention.

[0003] Therefore, it is necessary to provide a new technical solution to improve one or more problems existing in the above solutions.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] The purpose of this application is to provide a method for interacting between a zero terminal and a cloud desktop, thereby overcoming one or more problems caused by limitations and defects of related technologies at least to a certain extent.

[0006] According to a first aspect of an embodiment of the present application, a method for interacting between a zero terminal and a cloud desktop is provided, the method comprising:

[0007] The zero terminal displays the cloud desktop on the display at a distance, so that the head-mounted smart device captures the image information of the display for projection display;

[0008] The zero terminal establishes connections with the head-mounted smart device and the wrist-mounted smart device respectively;

[0009] When the connection between the zero terminal and the head-mounted smart device is successfully established, the zero terminal receives the login request information of the user logging into the zero terminal sent by the head-mounted smart device, so that the user logs into the zero terminal;

[0010] When the connection between the zero terminal and the wristband smart device is successfully established, the zero terminal receives the control instructions sent by the head-mounted smart device and / or the wristband smart device, and sends them to the cloud desktop, so that the cloud desktop responds.

[0011] In an embodiment of the present application, the login request information includes: a login account and a login password;

[0012] The login account includes a text login account, and the text login account is a login text obtained by converting the first voice input information made by the user when logging into the zero terminal collected by the head-mounted smart device and performing text conversion;

[0013] The login password includes an eye login action or a text login password. The eye login action is an eye movement made by a user when logging into the zero terminal and collected by the head-mounted smart device. The text login password is a text password obtained by converting the second voice input information made by the user when logging into the zero terminal and collected by the head-mounted smart device.

[0014] In an embodiment of the present application, when the zero terminal receives a control instruction sent by the head-mounted smart device, the zero terminal sends the received control instruction sent by the head-mounted smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instruction sent by the head-mounted smart device includes an eye control instruction, and the eye control instruction is an instruction formed by an eye movement made by the user operating the cloud desktop.

[0015] In an embodiment of the present application, when the zero terminal receives a control instruction sent by the wristband-type smart device, the zero terminal sends the received control instruction sent by the wristband-type smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instruction of the wristband-type smart device includes a hand control instruction, and the hand control instruction is an instruction formed by a hand movement made by a user to operate the cloud desktop.

[0016] In an embodiment of the present application, when the zero terminal receives the control instructions sent by the head-mounted smart device and the control instructions sent by the wristband smart device, the zero terminal sends the control instructions sent by the head-mounted smart device and the control instructions sent by the wristband smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instructions sent by the head-mounted smart device include eye control instructions, and the control instructions sent by the wristband smart device include hand control instructions, the eye control instructions are instructions formed by eye movements made by the user operating the cloud desktop, and the hand control instructions are instructions formed by hand movements made by the user operating the cloud desktop.

[0017] According to a second aspect of an embodiment of the present application, a method for interacting a head-mounted smart device with a cloud desktop is provided, comprising:

[0018] When the zero terminal zooms out and displays the cloud desktop on the display, the head-mounted smart device captures the display screen of the display for projection display;

[0019] The head-mounted smart device establishes a connection with the zero terminal;

[0020] When the connection between the head-mounted smart device and the zero terminal is successfully established, the head-mounted smart device sends the user's login request information to the zero terminal, so that the user logs in to the zero terminal;

[0021] The head-mounted smart device sends a control instruction to the zero terminal, so that the zero terminal sends it to the cloud desktop for response.

[0022] According to a third aspect of an embodiment of the present application, a method for interacting a wristband-type smart device with a cloud desktop is provided, comprising:

[0023] The wristband smart device establishes a connection with the zero terminal;

[0024] When the wristband-type smart device successfully establishes a connection with the zero terminal, the wristband-type smart device sends a control instruction to the zero terminal, so that the zero terminal sends it to the cloud desktop for response.

[0025] According to a fourth aspect of an embodiment of the present application, a zero terminal is provided, including:

[0026] A remote display module is used to remotely display the cloud desktop on a display by a zero terminal, so that a head-mounted smart device can capture the image information of the display for projection display;

[0027] A first connection module is used for the zero terminal to establish connection with the head-mounted smart device and the wrist-mounted smart device respectively;

[0028] A login module, configured to, when a connection is successfully established between the zero terminal and the head-mounted smart device, cause the zero terminal to receive login request information of a user logging into the zero terminal sent by the head-mounted smart device, so that the user logs into the zero terminal;

[0029] The control module, when the connection between the zero terminal and the wristband smart device is successfully established, the zero terminal receives the control instructions sent by the head-mounted smart device and / or the wristband smart device, and sends them to the cloud desktop so that the cloud desktop responds.

[0030] According to a fifth aspect of an embodiment of the present application, a head-mounted smart device is provided, including:

[0031] A capture module, used for, when the zero terminal zooms out and displays the cloud desktop on the display, the head-mounted smart device captures the display screen of the display for projection display;

[0032] A second connection module, used for establishing a connection between the head-mounted smart device and the zero terminal;

[0033] A first sending module, configured to, when a connection is successfully established between the head-mounted smart device and the zero terminal, cause the head-mounted smart device to send a user's login request information to the zero terminal, so that the user can log in to the zero terminal;

[0034] The second sending module is used for the head-mounted smart device to send a control instruction to the zero terminal, so that the zero terminal sends it to the cloud desktop for response.

[0035] According to a sixth aspect of an embodiment of the present application, there is provided a wristband-type smart device, including:

[0036] The third connection module is used to establish a connection between the wristband smart device and the zero terminal;

[0037] The third sending module is used for, when the wristband-type smart device successfully establishes a connection with the zero terminal, the wristband-type smart device sending a control instruction to the zero terminal, so that the zero terminal sends the instruction to the cloud desktop for response.

[0038] According to a seventh aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the steps of the method for interacting between a zero terminal and a cloud desktop described in any one of the above embodiments are implemented.

[0039] According to an eighth aspect of the embodiments of the present application, an electronic device is provided, including:

[0040] Processor; and

[0041] A memory, configured to store executable instructions of the processor;

[0042] The processor is configured to execute the steps of the method for interacting between the zero terminal and the cloud desktop in any one of the above embodiments by executing the executable instructions.

[0043] The technical solution provided by the embodiments of the present application may have the following beneficial effects:

[0044] In one embodiment of the present application, through the above method, the zero terminal establishes a connection with the head-mounted smart device and the wrist-mounted smart device, and after the connection is successfully established, the head-mounted smart device sends the login request information of the user to log in to the zero terminal to the zero terminal, so that the user logs in to the zero terminal; at the same time, the user sends the control instructions of controlling the cloud desktop through the head-mounted smart device and / or the wrist-mounted smart device, so that the cloud desktop responds, and the interaction between the zero terminal and the cloud desktop is realized. In addition, since the head-mounted smart device and the wrist-mounted smart device are both smart wearables, the user is relatively light to wear and convenient to wear all day, so that the user can connect to the cloud desktop and control the cloud desktop through the head-mounted smart device and the wrist-mounted smart device. Moreover, the method of sending instructions to the zero terminal through the head-mounted smart device and the wrist-mounted smart device replaces some keyboard and mouse operations, which makes it more convenient for users to control the cloud desktop and improves the user experience.

[0045] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0047] Figure 1 A flowchart schematically showing the steps of a method for interacting between a zero terminal and a cloud desktop in an exemplary embodiment of the present application;

[0048] Figure 2 A system architecture diagram schematically showing the interaction between the zero terminal and the cloud desktop in an exemplary embodiment of the present application;

[0049] Figure 3 A flowchart schematically illustrating the steps of a method for interacting a head-mounted smart device with a cloud desktop in an exemplary embodiment of the present application;

[0050] Figure 4 A flowchart schematically showing the steps of a method for interacting a wristband-type smart device with a cloud desktop in an exemplary embodiment of the present application;

[0051] Figure 5 A block diagram schematically shows a zero terminal in an exemplary embodiment of the present application;

[0052] Figure 6 A block diagram schematically shows a head-mounted smart device in an exemplary embodiment of the present application;

[0053] Figure 7A block diagram schematically shows a wristband-type smart device in an exemplary embodiment of the present application;

[0054] Figure 8 A schematic diagram of a program product in an exemplary embodiment of the present application is schematically shown;

[0055] Fig. 9 A schematic diagram of an electronic device in an exemplary embodiment of the present application is schematically shown. DETAILED DESCRIPTION

[0056] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0057] In addition, the accompanying drawings are only schematic illustrations of the present application and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0058] In the related technology, the zero-terminal cloud desktop product is a desktop office system built based on a cloud server, a zero terminal, a display, and a keyboard and mouse. When the zero terminal interacts with a remote cloud desktop, the user sends the command to operate the cloud desktop to the zero terminal through keyboard and mouse operations, so as to operate the cloud desktop through the zero terminal and achieve the purpose of interacting with the cloud desktop. This keyboard and mouse operation method generally requires the connection of zero terminal boxes, displays, keyboards, mice and other equipment to be realized. With the advent of the AI ​​intelligent era, for users, this keyboard and mouse operation method used when interacting with the cloud desktop through the zero terminal is not convenient and intelligent enough, which affects the user experience. Therefore, it is necessary to seek a convenient and intelligent operation method to realize the interaction between the zero terminal and the cloud desktop.

[0059] Based on this, this example implementation first provides a method for a zero terminal to interact with a cloud desktop. Figure 1 As shown in , the method includes: steps S101 to S104.

[0060] Among them, step S101: the zero terminal displays the cloud desktop on the display at a distance, so that the head-mounted smart device captures the image information of the display for projection display.

[0061] Step S102: The zero terminal establishes connections with the head-mounted smart device and the wrist-mounted smart device respectively.

[0062] Step S103: When the connection between the zero terminal and the head-mounted smart device is successfully established, the zero terminal receives the login request information of the user logging into the zero terminal sent by the head-mounted smart device, so that the user logs into the zero terminal.

[0063] Step S104: When the connection between the zero terminal and the wristband smart device is successfully established, the zero terminal receives the control command sent by the head-mounted smart device and / or the wristband smart device, and sends it to the cloud desktop so that the cloud desktop responds.

[0064] In one embodiment of the present application, through the above method, the zero terminal establishes a connection with the head-mounted smart device and the wrist-mounted smart device, and after the connection is successfully established, the head-mounted smart device sends the login request information of the user to log in to the zero terminal to the zero terminal, so that the user logs in to the zero terminal; at the same time, the user sends the control instructions of controlling the cloud desktop through the head-mounted smart device and / or the wrist-mounted smart device, so that the cloud desktop responds, and the interaction between the zero terminal and the cloud desktop is realized. In addition, since the head-mounted smart device and the wrist-mounted smart device are both smart wearables, the user is relatively light to wear and convenient to wear all day, so that the user can connect to the cloud desktop and control the cloud desktop through the head-mounted smart device and the wrist-mounted smart device. Moreover, the method of sending instructions to the zero terminal through the head-mounted smart device and the wrist-mounted smart device replaces some keyboard and mouse operations, which makes it more convenient for users to control the cloud desktop and improves the user experience.

[0065] Next, we will refer to Figure 1 to Figure 2 Each step of the above method in this example implementation is described in more detail.

[0066] In step S101, the head-mounted smart device may be an AR glasses of Orion products, which can display a maximum field of view of 70°. The AR glasses are equipped with 7 micro cameras, which can capture the user's eye movements, hand movements, and the user's surrounding environment. The zero terminal uses the encoding and decoding protocol and the network transmission protocol to display the cloud desktop of the ISSA server on the user's local display. AR glasses can collect the picture information on the display through the micro camera. When the picture information on the display is the picture of the cloud desktop, the AR glasses also capture the picture of the cloud desktop, and the user can see the picture of the cloud desktop through the AR glasses.

[0067] In step S102, when the zero terminal (i.e., the zero terminal box) establishes a connection with the head-mounted smart device and the wrist-mounted smart device, the connection can be established through a network connection or a Bluetooth connection. For details, please refer to the prior art for understanding, and this application will not go into details. Among them, the wrist-mounted smart device can be a neural wristband of the Orion product. The neural wristband is relatively light and easy to wear, and can obtain corresponding hand movements through physiological signals collected during the user's hand movements. When the zero terminal successfully establishes a connection with the head-mounted smart device and the wrist-mounted smart device, the user can transmit information between the zero terminal by wearing the head-mounted smart device and the wrist-mounted smart device.

[0068] In step S103, when the user logs in to the zero terminal through the head-mounted smart device, the user sends a login request message to the zero terminal through the head-mounted smart device so that the user can log in to the zero terminal.

[0069] Furthermore, the login request information includes: a login account and a login password;

[0070] The login account includes a text login account, which is a login text obtained by converting the first voice input information made by the user logging into the zero terminal collected by the head-mounted smart device and performing text conversion;

[0071] The login password includes an eye login action or a text login password. The eye login action is the eye movement made by the user logging into the zero terminal collected by the head-mounted smart device. The text login password is the second voice input information made by the user logging into the zero terminal collected by the head-mounted smart device, and the text password is obtained by converting it into text.

[0072] It is understandable that the user can log in to the zero terminal by inputting the corresponding login account and login password through the head-mounted smart device. The login account is generally a text login account, and the login password includes eye login movements or text login passwords.

[0073] When the user inputs text to log in to the account through the head-mounted smart device, the head-mounted smart device collects the first voice input information sent by the user to log in to the zero terminal, and then converts the first voice input information into text to obtain the corresponding login text. The corresponding login text can be used as the text login account and sent to the zero terminal, so as to complete the input of the corresponding login text when logging in to the zero terminal into the text login account on the zero terminal.

[0074] When the user uses the head-mounted smart device to perform eye login actions to input the login password, the head-mounted smart device collects the eye movements made by the user to log in to the zero terminal, and then sends them to the zero terminal, so that the eye movements made when logging in to the zero terminal can be input as the login password into the login password on the zero terminal. When the zero terminal receives the corresponding text login account and login password, the user can successfully log in to the zero terminal.

[0075] When the user inputs the text login password through the head-mounted smart device, the head-mounted smart device collects the second voice input information sent by the user to log in to the zero terminal, and then converts the second voice input information into text to obtain the corresponding text password, which can be used as the text login password and sent to the zero terminal, so that the corresponding text password when logging in to the zero terminal can be input into the text login password on the zero terminal. When the zero terminal receives the corresponding text login account and text login password, the user can successfully log in to the zero terminal.

[0076] It should be noted that the first voice input information and the second voice input information of the user collected by the head-mounted smart device are converted into corresponding text input, which can replace the text input of the keyboard.

[0077] It should also be noted that the eye movements made by the user logging into the zero terminal collected by the head-mounted smart device can be blinking movements, eye closing movements, or a combination of blinking movements and eye closing movements.

[0078] For example, the password for the eye login action can be set as: the user blinks a preset number of times within a first preset time period. When the user blinks a preset number of times within the first preset time period, the user can successfully log in to the zero terminal if the login account is entered correctly. The first preset time period and the preset number of times can be set according to actual conditions, and this application does not limit this.

[0079] The password for the eye login action can also be set as: the user closes his eyes within a first preset time period. When the user cooperates with the eye-closing action within the first preset time period, and the login account is entered correctly, the user can successfully log in to the zero terminal.

[0080] The password for the eye login action can also be set to: the user blinks a preset number of times in a first preset time period, and closes the eyes at the same time in the first preset time period. When the user blinks a preset number of times in the first preset time period, and closes the eyes at the same time in the first preset time period, and on the premise that the login account is entered correctly, the user can successfully log in to the zero terminal.

[0081] In step S104, when the user needs to control the cloud desktop, it can be achieved in the following ways:

[0082] 1) When the user controls the cloud desktop through eye movements, the head-mounted smart device collects the user's eye movements to operate the cloud desktop, forms corresponding control instructions, and sends the control instructions to the zero terminal, which sends them to the cloud desktop so that the cloud desktop responds.

[0083] Furthermore, when the zero terminal receives a control instruction sent by the head-mounted smart device, the zero terminal sends the received control instruction sent by the head-mounted smart device to the cloud desktop, so that the cloud desktop responds; wherein, the control instruction sent by the head-mounted smart device includes eye control instructions, and the eye control instructions are instructions formed by eye movements made by the user to operate the cloud desktop.

[0084] It is understandable that the eye movements collected by the head-mounted smart device when the user operates the cloud desktop may include: the user closing the eyes in the second preset time period, the user closing the eyes in the third preset time period, and the user closing the eyes in the fourth preset time period, etc. Among them, the instruction corresponding to the user closing the eyes in the second preset time period is the screen off instruction, the instruction corresponding to the user closing the eyes in the second preset time period is the shutdown instruction, and the instruction corresponding to the user closing the eyes in the fourth preset time period is the disconnection instruction.

[0085] For example: when the user closes his eyes within the second preset time period, the eye control command is set as the screen-off command, that is, when the user closes his eyes within the second preset time period, the head-mounted smart device collects his movements and forms a screen-off command, which is sent to the zero terminal to turn off the screen of the cloud desktop through the zero terminal.

[0086] When the user closes his eyes within the third preset time period, the eye control instruction is set as a shutdown instruction, that is, when the user closes his eyes within the third preset time period, the head-mounted smart device collects his actions and forms a shutdown instruction, which is sent to the zero terminal to shut down the cloud desktop through the zero terminal.

[0087] When the user closes his eyes within the fourth preset time period, the eye control instruction is set to a disconnect instruction, that is, when the user closes his eyes within the fourth preset time period, the head-mounted smart device collects his actions and forms a disconnect instruction, which is sent to the zero terminal, so that the cloud desktop is disconnected from it through the zero terminal.

[0088] It should be noted that the second preset time period, the third preset time period and the fourth preset time period can be set according to actual conditions, and this application will not elaborate on this.

[0089] 2) When the user operates the cloud desktop through hand movements, the wristband-type smart device collects the user's hand movements to control the cloud desktop, forms corresponding control instructions, and sends the control instructions to the zero terminal, which sends them to the cloud desktop so that the cloud desktop responds.

[0090] Furthermore, when the zero terminal receives a control instruction sent by the wristband smart device, the zero terminal sends the received control instruction sent by the wristband smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instruction of the wristband smart device includes hand control instructions, and the hand control instructions are instructions formed by hand movements made by the user to operate the cloud desktop.

[0091] It is understandable that the hand movements collected by the wristband smart device when the user operates the cloud desktop may include: click once, click and drag, click twice in a row, raise one hand with five fingers open, raise one hand with five fingers together, slide the finger diagonally upward, slide the finger diagonally downward, etc. Among them, the instruction corresponding to click once is a close file instruction, which instructs a file on the cloud desktop, the instruction corresponding to click and drag is a move icon instruction, the instruction corresponding to click twice in a row is an open instruction, the instruction corresponding to raise one hand with five fingers open is a zoom-in instruction, the instruction corresponding to raise one hand with five fingers together is a zoom-out instruction, the instruction corresponding to slide the finger diagonally upward is a page-up instruction, and the instruction corresponding to slide the finger diagonally downward is a page-down instruction.

[0092] It should be noted that the hand movements made by the user to operate the cloud desktop in this application are not limited to the above-mentioned contents, and the setting of the hand movements made to operate the cloud desktop and the corresponding operation content can be set according to actual conditions, and this application does not impose any restrictions on this.

[0093] 3) When the user operates the cloud desktop through eye movements and hand movements at the same time, at this time, the head-mounted smart device collects the user's eye movements to manipulate the cloud desktop, forms corresponding control instructions, and sends the control instructions to the zero terminal, and the zero terminal sends them to the cloud desktop; at the same time, the wristband smart device collects the user's hand movements to manipulate the cloud desktop, forms corresponding control instructions, and sends the control instructions to the zero terminal, and the zero terminal sends them to the cloud desktop, so that the cloud desktop responds based on the control instructions sent by the head-mounted smart device and the wristband smart device at the same time.

[0094] Furthermore, when the zero terminal receives control instructions sent by the head-mounted smart device and the wrist-mounted smart device, the zero terminal sends the control instructions sent by the head-mounted smart device and the control instructions sent by the wrist-mounted smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instructions sent by the head-mounted smart device include eye control instructions, and the control instructions sent by the wrist-mounted smart device include hand control instructions, the eye control instructions are instructions formed by eye movements made by the user to operate the cloud desktop, and the hand control instructions are instructions formed by hand movements made by the user to operate the cloud desktop.

[0095] It is understandable that hand control commands can be combined with eye control commands to perform multiple command inputs to control the cloud desktop.

[0096] For example, when the hand action is a click and drag action, the hand control instruction is the click and drag instruction, and the eye action is the user closing the eyes in the second preset time period, and the eye control instruction is the screen off instruction. When these two instructions are input into the zero terminal, the zero terminal first executes the click and drag instruction on the icon on the cloud desktop to make the cloud desktop respond, and then executes the screen off instruction on the cloud desktop to make the cloud desktop respond.

[0097] For another example: when the hand action is a click, the hand control instruction is a file closing instruction, and the eye action is the user closing the eyes in the third preset time period, and the eye control instruction is a shutdown instruction. When these two instructions are input into the zero terminal, the zero terminal first executes the closing instruction on the file on the cloud desktop, causing the cloud desktop to respond, and then executes the closing instruction on the cloud desktop, causing the cloud desktop to respond.

[0098] It should be noted that the head-mounted smart device in this application is Orion's AR glasses, and the wristband smart device is Orion's neural wristband. In the process of interaction between the zero terminal and the cloud desktop, this application replaces some keyboard and mouse operations by sending instructions to the zero terminal through the head-mounted smart device and the wristband smart device, which makes it more convenient for users to control the cloud desktop and improves the user experience.

[0099] It should be noted that, although the steps of the method in the present application are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step for execution, and / or one step may be decomposed into multiple steps for execution, etc. In addition, it is also easy to understand that these steps may be, for example, executed synchronously or asynchronously in multiple modules / processes / threads.

[0100] In this example implementation, a method for a head-mounted smart device to interact with a cloud desktop is also provided. Figure 3 The method includes: step S201 to step S204.

[0101] Wherein, step S201: after the zero terminal zooms out and displays the cloud desktop on the display, the head-mounted smart device captures the display screen of the display for projection display;

[0102] Step S202: The head-mounted smart device establishes a connection with the zero terminal;

[0103] Step S203: When the connection between the head-mounted smart device and the zero terminal is successfully established, the head-mounted smart device sends the user's login request information to the zero terminal, so that the user logs in to the zero terminal;

[0104] Step S204: The head-mounted smart device sends a control instruction to the zero terminal, so that the zero terminal sends it to the cloud desktop for response.

[0105] In one embodiment, the control instructions sent by the head-mounted smart device include eye control instructions, and the eye control instructions are instructions formed by eye movements made by the user to operate the cloud desktop.

[0106] It should be noted that in the steps of discussing the method for the zero terminal to interact with the cloud desktop, the method for the head-mounted smart device to interact with the cloud desktop has been explained, and this application will not repeat it.

[0107] In this example implementation, a method for a head-mounted smart device to interact with a cloud desktop is also provided. Figure 4 The method includes: step S301 to step S302.

[0108] Wherein, step S301: the wristband smart device establishes a connection with the zero terminal;

[0109] Step S302: When the wristband-type smart device successfully establishes a connection with the zero terminal, the wristband-type smart device sends a control instruction to the zero terminal, so that the zero terminal sends it to the cloud desktop for response.

[0110] In one embodiment, the control instructions sent by the wristband-type smart device include hand control instructions, and the hand control instructions are instructions formed by hand movements made by the user to operate the cloud desktop.

[0111] It should be noted that, in the steps of discussing the method for the zero terminal to interact with the cloud desktop, the method for the wristband-type smart device to interact with the cloud desktop has been explained, and this application will not repeat it.

[0112] Furthermore, in this exemplary embodiment, a zero terminal is also provided. Figure 5 As shown in , the zero terminal 400 includes a zoom-out display module 401, a first connection module 402, a login module 403 and a control module 404. Among them, the zoom-out display module 401 is used for the zero terminal to zoom out and display the cloud desktop on the display, so that the head-mounted smart device can capture the screen information of the display for projection display; the first connection module 402 is used for the zero terminal to establish connections with the head-mounted smart device and the wrist-mounted smart device respectively; the login module 403 is used for when the zero terminal and the head-mounted smart device are successfully connected, the zero terminal receives the login request information of the user logging into the zero terminal sent by the head-mounted smart device, so that the user logs in to the zero terminal; the control module 404 is used for when the zero terminal and the wrist-mounted smart device are successfully connected, the zero terminal receives the control instructions sent by the head-mounted smart device and / or the wrist-mounted smart device, and sends them to the cloud desktop, so that the cloud desktop responds.

[0113] In one embodiment, it further includes:

[0114] The first control submodule is used for sending the control instructions sent by the head-mounted smart device to the cloud desktop when the zero terminal receives the control instructions sent by the head-mounted smart device, so that the cloud desktop responds; wherein the control instructions sent by the head-mounted smart device include eye control instructions, and the eye control instructions are instructions formed by eye movements made by the user to operate the cloud desktop.

[0115] In one embodiment, it further includes:

[0116] The second control submodule is used for sending the control instructions sent by the wristband smart device to the cloud desktop when the zero terminal receives the control instructions sent by the wristband smart device, so that the cloud desktop responds; wherein the control instructions of the wristband smart device include hand control instructions, and the hand control instructions are instructions formed by hand movements made by the user to operate the cloud desktop.

[0117] In one embodiment, it further includes:

[0118] The third control submodule is used for sending the control instructions sent by the head-mounted smart device and the control instructions sent by the wristband smart device to the cloud desktop when the zero terminal receives the control instructions sent by the head-mounted smart device and the control instructions sent by the wristband smart device, so that the cloud desktop responds; wherein the control instructions sent by the head-mounted smart device include eye control instructions, and the control instructions sent by the wristband smart device include hand control instructions, the eye control instructions are instructions formed by eye movements made by the user to operate the cloud desktop, and the hand control instructions are instructions formed by hand movements made by the user to operate the cloud desktop.

[0119] Regarding the zero terminal in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0120] Furthermore, in this exemplary embodiment, a head-mounted smart device is also provided. Figure 6 As shown in , the head-mounted smart device 500 includes: a capture module 501, a second connection module 502, a first sending module 503, and a second sending module 504. Among them, the capture module 501 is used for the head-mounted smart device to capture the display screen of the display for projection display after the zero terminal pulls the cloud desktop away and displays it on the display; the second connection module 502 is used for the head-mounted smart device to establish a connection with the zero terminal; the first sending module 503 is used for the head-mounted smart device to send the user's login request information to the zero terminal after the connection between the head-mounted smart device and the zero terminal is successfully established, so that the user logs in to the zero terminal; the second sending module 504 is used for the head-mounted smart device to send a control instruction to the zero terminal, so that the zero terminal sends it to the cloud desktop for response.

[0121] It should be noted that, regarding the head-mounted smart device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0122] Furthermore, in this exemplary embodiment, a wristband-type smart device is also provided. Figure 7 As shown in , the wristband smart device 800 includes: a third connection module 801 and a third sending module 802. The third connection module 801 is used for the wristband smart device to establish a connection with the zero terminal; the third sending module 802 is used for the wristband smart device to send a control instruction to the zero terminal after the wristband smart device successfully establishes a connection with the zero terminal, so that the zero terminal sends it to the cloud desktop for response.

[0123] It should be noted that, regarding the wristband-type smart device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0124] It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the implementation mode of the present application, the features and functions of two or more modules or units described above can be concretized in one module or unit. Conversely, the features and functions of a module or unit described above can be further divided into multiple modules or units for concretization. The components displayed as modules or units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the present application scheme. Those of ordinary skill in the art can understand and implement it without paying creative work.

[0125] In an exemplary embodiment of the present application, a computer-readable storage medium is also provided, on which a computer program is stored, and when the program is included in the processor and executed, the steps of the method for interacting between the zero terminal and the cloud desktop described in any of the above embodiments can be implemented. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps of various exemplary embodiments of the present invention described in the method for interacting between the zero terminal and the cloud desktop described in the above-mentioned part of this specification.

[0126] refer to Figure 8 As shown, a program product 300 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0127] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0128] The computer readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by an instruction execution system, an apparatus, or a device or used in combination with it. The program code contained on the readable storage medium may be transmitted with any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.

[0129] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0130] In an exemplary embodiment of the present application, an electronic device is also provided, which may include a processor and a memory for storing executable instructions of the processor. The processor is configured to execute the steps of the method for interacting between the zero terminal and the cloud desktop in any of the above embodiments by executing the executable instructions.

[0131] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".

[0132] Refer to the following Fig. 9 The electronic device 600 according to this embodiment of the present invention is described. Fig. 9 The electronic device 600 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0133] like Fig. 9As shown, the electronic device 600 is in the form of a general computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different system components (including the storage unit 620 and the processing unit 610), a display unit 640, etc.

[0134] The storage unit stores a program code, which can be executed by the processing unit 610, so that the processing unit 610 executes the steps of various exemplary embodiments of the present invention described in the method of interacting between the zero terminal and the cloud desktop in the above description of this specification. For example, the processing unit 610 can execute the following steps: Figure 1 Follow the steps shown in .

[0135] The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 6201 and / or a cache memory unit 6202 , and may further include a read-only memory unit (ROM) 6203 .

[0136] The storage unit 620 may also include a program / utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules and program data, each of which or some combination may include the implementation of a network environment.

[0137] Bus 630 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0138] The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 600, and / or communicate with any device that enables the electronic device 600 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 650. Furthermore, the electronic device 600 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 660. The network adapter 660 may communicate with other modules of the electronic device 600 via a bus 630. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0139] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation method of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server or a network device, etc.) to execute the above-mentioned method of interacting with the cloud desktop according to the implementation method of the present application.

[0140] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary technical means in the art that are not disclosed in the present application.

Claims

1. A method for interacting between a zero terminal and a cloud desktop, characterized in that: The method includes: The zero terminal displays the cloud desktop on the display at a distance, so that the head-mounted smart device captures the image information of the display for projection display; The zero terminal establishes connections with the head-mounted smart device and the wrist-mounted smart device respectively; When the connection between the zero terminal and the head-mounted smart device is successfully established, the zero terminal receives the login request information of the user logging into the zero terminal sent by the head-mounted smart device, so that the user logs into the zero terminal; When the connection between the zero terminal and the wristband smart device is successfully established, the zero terminal receives the control instructions sent by the head-mounted smart device and / or the wristband smart device, and sends them to the cloud desktop, so that the cloud desktop responds.

2. The method for interacting between a zero terminal and a cloud desktop according to claim 1, characterized in that: The login request information includes: login account and login password; The login account includes a text login account, and the text login account is a login text obtained by converting the first voice input information made by the user when logging into the zero terminal collected by the head-mounted smart device and performing text conversion; The login password includes an eye login action or a text login password. The eye login action is an eye movement made by a user when logging into the zero terminal and collected by the head-mounted smart device. The text login password is a text password obtained by converting the second voice input information made by the user when logging into the zero terminal and collected by the head-mounted smart device.

3. The method for interacting between a zero terminal and a cloud desktop according to claim 1, characterized in that: When the zero terminal receives the control instruction sent by the head-mounted smart device, the zero terminal sends the received control instruction sent by the head-mounted smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instruction sent by the head-mounted smart device includes an eye control instruction, and the eye control instruction is an instruction formed by the eye movement made by the user operating the cloud desktop.

4. The method for interacting between a zero terminal and a cloud desktop according to claim 1, characterized in that: When the zero terminal receives the control instruction sent by the wristband-type smart device, the zero terminal sends the received control instruction sent by the wristband-type smart device to the cloud desktop, so that the cloud desktop responds; wherein, the control instruction of the wristband-type smart device includes a hand control instruction, and the hand control instruction is an instruction formed by a hand movement made by a user to operate the cloud desktop.

5. The method for interacting between a zero terminal and a cloud desktop according to claim 1, characterized in that: When the zero terminal receives the control instructions sent by the head-mounted smart device and the control instructions sent by the wristband smart device, the zero terminal sends the control instructions sent by the head-mounted smart device and the control instructions sent by the wristband smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instructions sent by the head-mounted smart device include eye control instructions, and the control instructions sent by the wristband smart device include hand control instructions, the eye control instructions are instructions formed by eye movements made by the user operating the cloud desktop, and the hand control instructions are instructions formed by hand movements made by the user operating the cloud desktop.

6. A method for interacting a head-mounted smart device with a cloud desktop, characterized in that: include: When the zero terminal zooms out and displays the cloud desktop on the display, the head-mounted smart device captures the display screen of the display for projection display; The head-mounted smart device establishes a connection with the zero terminal; When the connection between the head-mounted smart device and the zero terminal is successfully established, the head-mounted smart device sends the user's login request information to the zero terminal, so that the user logs in to the zero terminal; The head-mounted smart device sends a control instruction to the zero terminal, so that the zero terminal sends it to the cloud desktop for response.

7. A method for interacting a wristband-type smart device with a cloud desktop, characterized in that: include: The wristband smart device establishes a connection with the zero terminal; When the wristband-type smart device successfully establishes a connection with the zero terminal, the wristband-type smart device sends a control instruction to the zero terminal, so that the zero terminal sends it to the cloud desktop for response.

8. A zero terminal, characterized in that: include: A remote display module is used to remotely display the cloud desktop on a display by a zero terminal, so that a head-mounted smart device can capture the image information of the display for projection display; A first connection module is used for the zero terminal to establish connection with the head-mounted smart device and the wrist-mounted smart device respectively; A login module, configured to, when a connection is successfully established between the zero terminal and the head-mounted smart device, cause the zero terminal to receive login request information of a user logging into the zero terminal sent by the head-mounted smart device, so that the user logs into the zero terminal; The control module, when the connection between the zero terminal and the wristband smart device is successfully established, the zero terminal receives the control instructions sent by the head-mounted smart device and / or the wristband smart device, and sends them to the cloud desktop so that the cloud desktop responds.

9. A head-mounted smart device, characterized in that: include: A capture module, used for, when the zero terminal zooms out and displays the cloud desktop on the display, the head-mounted smart device captures the display screen of the display for projection display; A second connection module, used for establishing a connection between the head-mounted smart device and the zero terminal; A first sending module, configured to, when a connection is successfully established between the head-mounted smart device and the zero terminal, cause the head-mounted smart device to send a user's login request information to the zero terminal, so that the user can log in to the zero terminal; The second sending module is used for the head-mounted smart device to send a control instruction to the zero terminal, so that the zero terminal sends it to the cloud desktop for response.

10. A wristband-type smart device, characterized in that: include: The third connection module is used to establish a connection between the wristband smart device and the zero terminal; The third sending module is used for, when the wristband-type smart device successfully establishes a connection with the zero terminal, the wristband-type smart device sending a control instruction to the zero terminal, so that the zero terminal sends the instruction to the cloud desktop for response.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method for interacting between a zero terminal and a cloud desktop as described in any one of claims 1 to 7 are implemented.

12. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to execute the steps of the method for interacting between a zero terminal and a cloud desktop as described in any one of claims 1 to 7 by executing the executable instructions.

Images