Computing unit, method for interaction between computing unit and cloud desktop, medium and equipment

Abstract

The invention relates to a computing unit, a method for interaction between the computing unit and a cloud desktop, a medium and equipment. The method comprises the steps that a calculation unit establishes connection with a head-mounted intelligent device and a wrist strap type intelligent device; after the connection between the computing unit and the head-mounted intelligent equipment is successfully established, the cloud desktop is remotely displayed on the head-mounted intelligent equipment by the computing unit; the computing unit receives login request information, sent by the head-mounted intelligent equipment, of a user logging in the computing unit, so that the user logs in the computing unit; and after the connection between the computing unit and the wrist strap type intelligent equipment is successfully established, the computing unit receives a control instruction sent by the head-mounted intelligent equipment and / or the wrist strap type intelligent equipment and sends the control instruction to the cloud desktop, so that the cloud desktop responds. According to the application, the head-mounted intelligent device and the wrist strap type intelligent device send the instruction to the computing unit instead of partial keyboard and mouse operation, so that the user can control the cloud desktop more conveniently, and the user experience is improved.

Description

Background Art

[0002] Zero-terminal cloud desktop products are desktop office systems built on cloud servers, zero-terminals, monitors, keyboards and mice. Their advantages are that they can be connected to work anytime and anywhere without geographical restrictions; their disadvantages are that they require zero-terminal boxes, monitors, keyboards and mice to be connected before they can be used. In the current era of AI intelligence, the demand for zero-terminal cloud desktop products has been developing in the direction of reducing or simplifying equipment in order to pursue greater portability. While moving towards the direction of simplifying equipment, how to make the simplified equipment interact with the cloud desktop has also become an issue that needs attention.

[0003] Therefore, it is necessary to provide a new technical solution to improve one or more problems existing in the above solutions.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] The purpose of the present application is to provide a computing unit, a method, a medium and a device for interacting between the computing unit and a cloud desktop, thereby overcoming one or more problems caused by limitations and defects of related technologies at least to a certain extent.

[0006] According to a first aspect of an embodiment of the present application, a method for a computing unit to interact with a cloud desktop is provided, the method comprising:

[0007] The computing unit establishes connections with the head-mounted smart device and the wrist-mounted smart device respectively;

[0008] When the connection between the computing unit and the head-mounted smart device is successfully established, the computing unit displays the cloud desktop on the head-mounted smart device in a remote manner; wherein the computing unit includes a zero-terminal computing system, and the computing system is used to realize the remote display of the cloud desktop on the head-mounted smart device;

[0009] The computing unit receives login request information of a user to log in to the computing unit sent by the head mounted smart device, so that the user logs in to the computing unit;

[0010] When the connection between the computing unit and the wristband smart device is successfully established, the computing unit receives the control instructions sent by the head-mounted smart device and / or the wristband smart device, and sends them to the cloud desktop, so that the cloud desktop responds.

[0011] In an embodiment of the present application, the login request information includes: a login account and a login password;

[0012] The login account includes a text login account, and the text login account is a login text obtained by converting the first voice input information made by the user logging into the computing unit collected by the head-mounted smart device and performing text conversion;

[0013] The login password includes an eye login action or a text login password. The eye login action is an eye movement made by a user when logging into the computing unit and collected by the head-mounted smart device. The text login password is a text password obtained by converting the second voice input information made by the user when logging into the computing unit and collected by the head-mounted smart device.

[0014] In an embodiment of the present application, when the computing unit receives a control instruction sent by the head-mounted smart device, the computing unit sends the received control instruction sent by the head-mounted smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instruction sent by the head-mounted smart device includes an eye control instruction, and the eye control instruction is an instruction formed by an eye movement made by a user operating the cloud desktop.

[0015] In an embodiment of the present application, when the computing unit receives a control instruction sent by the wristband-type smart device, the computing unit sends the received control instruction sent by the wristband-type smart device to the cloud desktop so that the cloud desktop responds; wherein the control instruction of the wristband-type smart device includes a hand control instruction, and the hand control instruction is an instruction formed by a hand movement made by a user to operate the cloud desktop.

[0016] In an embodiment of the present application, when the computing unit receives a control instruction sent by the head-mounted smart device and a control instruction sent by the wrist-band smart device, the computing unit sends the control instruction sent by the head-mounted smart device and the control instruction sent by the wrist-band smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instruction sent by the head-mounted smart device includes an eye control instruction, and the control instruction sent by the wrist-band smart device includes a hand control instruction, the eye control instruction is an instruction formed by an eye movement made by a user operating the cloud desktop, and the hand control instruction is an instruction formed by a hand movement made by the user operating the cloud desktop.

[0017] According to a second aspect of an embodiment of the present application, a method for interacting a head-mounted smart device with a cloud desktop is provided, comprising:

[0018] The head-mounted smart device establishes a connection with the computing unit;

[0019] When the connection between the head-mounted smart device and the computing unit is successfully established, the head-mounted smart device receives and displays the cloud desktop sent by the computing unit; wherein the computing unit includes a zero-terminal computing system, and the computing system is used to realize the display of the cloud desktop on the head-mounted smart device by zooming out;

[0020] The head-mounted smart device sends a user's login request information to the computing unit, so that the user logs in to the computing unit;

[0021] The head-mounted smart device sends a control instruction to the computing unit, so that the computing unit sends it to the cloud desktop for response.

[0022] According to a third aspect of an embodiment of the present application, a method for interacting a wristband-type smart device with a cloud desktop is provided, comprising:

[0023] The wristband smart device establishes a connection with the computing unit;

[0024] When the wristband-type smart device successfully establishes a connection with the computing unit, the wristband-type smart device sends a control instruction to the computing unit, so that the computing unit sends it to the cloud desktop for response.

[0025] According to a fourth aspect of an embodiment of the present application, there is provided a computing unit, including:

[0026] A connection module is used for the computing unit to establish connections with the head-mounted smart device and the wrist-mounted smart device respectively;

[0027] A zoom-out display module, which is used for the computing unit to zoom out and display the cloud desktop on the head-mounted smart device after the connection between the computing unit and the head-mounted smart device is successfully established; wherein the computing unit includes a zero-terminal computing system, and the computing system is used to realize the zoom-out display of the cloud desktop on the head-mounted smart device;

[0028] A login module, used for the computing unit to receive login request information of a user to log in to the computing unit sent by the head-mounted smart device, so that the user logs in to the computing unit;

[0029] The control module is used for receiving the control instructions sent by the head-mounted smart device and / or the wrist-mounted smart device and sending them to the cloud desktop after the connection between the computing unit and the wrist-mounted smart device is successfully established, so that the cloud desktop responds.

[0030] According to a fifth aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the steps of the method for interacting between a computing unit and a cloud desktop described in any of the above embodiments are implemented.

[0031] According to a sixth aspect of an embodiment of the present application, there is provided an electronic device, including:

[0032] Processor; and

[0033] A memory, configured to store executable instructions of the processor;

[0034] The processor is configured to execute the steps of the method for interacting between a computing unit and a cloud desktop in any one of the above embodiments by executing the executable instructions.

[0035] The technical solution provided by the embodiments of the present application may have the following beneficial effects:

[0036] In one embodiment of the present application, after the computing unit successfully establishes a connection with the head-mounted smart device and the wrist-mounted smart device through the above method, the computing unit can replace the zero terminal to realize the remote display of the cloud desktop on the head-mounted smart device by integrating the computing power system of the zero terminal into the computing unit, and at the same time realize the replacement of the display by the head-mounted smart device; the head-mounted smart device sends a login request message to the computing unit to realize the user's login to the computing unit. At the same time, the user sends a control instruction for controlling the cloud desktop through the head-mounted smart device and / or the wrist-mounted smart device, so that the cloud desktop responds and realizes the interaction between the computing unit and the cloud desktop. In addition, since the head-mounted smart device and the wrist-mounted smart device are both smart wearables, the user is relatively light to wear and easy to wear all day, so that the user can connect to the cloud desktop and control the cloud desktop through the head-mounted smart device and the wrist-mounted smart device. Moreover, the method of sending instructions to the computing unit by the head-mounted smart device and the wrist-mounted smart device replaces some keyboard and mouse operations, which makes it more convenient for users to control the cloud desktop and improves the user experience.

[0037] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0039] Figure 1A flowchart schematically illustrates a method for a computing unit to interact with a cloud desktop in an exemplary embodiment of the present application;

[0040] Figure 2 A system architecture diagram schematically showing the interaction between a computing unit and a cloud desktop in an exemplary embodiment of the present application;

[0041] Figure 3 A flowchart schematically illustrating the steps of a method for interacting a head-mounted smart device with a computing unit in an exemplary embodiment of the present application;

[0042] Figure 4 A flowchart schematically showing the steps of a method for interacting between a wristband-type smart device and a computing unit in an exemplary embodiment of the present application;

[0043] Figure 5 A block diagram schematically illustrates a computing unit in an exemplary embodiment of the present application;

[0044] Figure 6 A schematic diagram of a program product in an exemplary embodiment of the present application is schematically shown;

[0045] Figure 7 A schematic diagram of an electronic device in an exemplary embodiment of the present application is schematically shown. DETAILED DESCRIPTION

[0046] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0047] In addition, the accompanying drawings are only schematic illustrations of the present application and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0048] In the related art, the zero-terminal cloud desktop product is a desktop office system built based on a cloud server, a zero terminal, a display, and a keyboard and mouse. When the zero terminal interacts with a remote cloud desktop, on the one hand, the user generally sends the command to operate the cloud desktop to the zero terminal through keyboard and mouse operations, so as to operate the cloud desktop through the zero terminal and achieve the purpose of interacting with the cloud desktop. This keyboard and mouse operation method generally requires the connection of zero terminal boxes, displays, keyboards and mice and other equipment to be realized. With the advent of the AI ​​intelligent era, for users, this keyboard and mouse operation method used when interacting with the cloud desktop through the zero terminal is not convenient or intelligent enough, and the method of directly interacting with the cloud desktop through the zero terminal is not convenient enough, which affects the user experience. Therefore, it is necessary to find a more convenient way to interact with the cloud desktop.

[0049] Based on this, this example implementation first provides a method for a computing unit to interact with a cloud desktop. Figure 1 As shown in , the method may include: steps S101 to S104.

[0050] Among them, step S101: the computing unit establishes connections with the head-mounted smart device and the wrist-band smart device respectively.

[0051] Step S102: When the computing unit and the head-mounted smart device are successfully connected, the computing unit displays the cloud desktop on the head-mounted smart device. The computing unit includes a zero-terminal computing system, and the computing system is used to display the cloud desktop on the head-mounted smart device.

[0052] Step S103: the computing unit receives the login request information of the user to log in to the computing unit sent by the head mounted smart device, so that the user logs in to the computing unit.

[0053] Step S104: When the connection between the computing unit and the wristband smart device is successfully established, the computing unit receives the control instructions sent by the head-mounted smart device and / or the wristband smart device, and sends them to the cloud desktop so that the cloud desktop responds.

[0054] In one embodiment of the present application, after the computing unit successfully establishes a connection with the head-mounted smart device and the wrist-mounted smart device through the above method, the computing unit can replace the zero terminal to realize the remote display of the cloud desktop on the head-mounted smart device by integrating the computing power system of the zero terminal into the computing unit, and at the same time realize the replacement of the display by the head-mounted smart device; the head-mounted smart device sends a login request message to the computing unit to realize the user's login to the computing unit. At the same time, the user sends a control instruction for controlling the cloud desktop through the head-mounted smart device and / or the wrist-mounted smart device, so that the cloud desktop responds and realizes the interaction between the computing unit and the cloud desktop. In addition, since the head-mounted smart device and the wrist-mounted smart device are both smart wearables, the user is relatively light to wear and easy to wear all day, so that the user can connect to the cloud desktop and control the cloud desktop through the head-mounted smart device and the wrist-mounted smart device. Moreover, the method of sending instructions to the computing unit by the head-mounted smart device and the wrist-mounted smart device replaces some keyboard and mouse operations, which makes it more convenient for users to control the cloud desktop and improves the user experience.

[0055] Next, we will refer to Figure 1 to Figure 2 Each step of the above method in this example implementation is described in more detail.

[0056] Before discussing the above steps, the computing unit, the head-mounted smart device and the wrist-mounted smart device are first explained.

[0057] The computing unit in this application may be a wireless computing unit of an Orion product, the head-mounted smart device may be an AR glasses of an Orion product, and the wristband-type smart device may be a neural wristband of an Orion product. Among them, the computing unit is small and light and can be easily put into a pocket; the AR glasses can display a field of view of up to 70°, and the AR glasses are equipped with 7 micro cameras that can collect the user's eye movements, hand movements, and the user's surrounding environment. The neural wristband mainly adopts a neural control mechanism, using electromyography (EMG) technology to read electrical signals related to hand movements in the brain. This allows it to interpret subtle gestures without physical controllers or buttons, creating a seamless interactive experience. Users can perform gestures, such as pinching their fingers to select items or scroll menus. The neural wristband converts these gestures into commands for Orion products, enabling intuitive control of games and applications.

[0058] In step S101, when the computing unit establishes a connection with the head-mounted smart device or the wrist-mounted smart device, the connection can be established through a network connection or a Bluetooth connection, etc., and the specifics can be understood by referring to the prior art, and this application does not elaborate on this. When the computing unit successfully establishes a connection with the head-mounted smart device or the wrist-mounted smart device, the user can transmit information between the computing unit by wearing the head-mounted smart device or the wrist-mounted smart device.

[0059] In step S102, when the computing unit successfully establishes a connection with the head-mounted smart device, since the computing power system of the zero terminal is integrated into the computing unit, the computing unit can use the computing power system to display the cloud desktop on the head-mounted smart device at a distance.

[0060] In step S103, when the user logs in to the computing unit through the head-mounted smart device, the user sends a login request message to the computing unit through the head-mounted smart device so that the user can log in to the computing unit.

[0061] Furthermore, the login request information includes: a login account and a login password;

[0062] The login account includes a text login account, and the text login account is a login text obtained by converting the first voice input information made by the user login computing unit collected by the head-mounted smart device into text;

[0063] The login password includes an eye login action or a text login password. The eye login action is the eye movement made by the user login calculation unit collected by the head-mounted smart device. The text login password is the second voice input information made by the user login calculation unit collected by the head-mounted smart device, and the text password is obtained by converting it into text.

[0064] It is understandable that the user can log in to the computing unit by inputting the corresponding login account and login password through the head-mounted smart device. The login account is generally a text login account, and the login password includes eye login movements or text login passwords.

[0065] When the user inputs text to log into the account through the head-mounted smart device, the head-mounted smart device collects the first voice input information sent by the user to log into the computing unit, and then converts the first voice input information into text to obtain corresponding login text. The corresponding login text can be used as the text login account and sent to the computing unit, so as to complete the input of the corresponding login text when logging into the computing unit into the text login account on the computing unit.

[0066] When the user performs eye login actions to input the login password through the head-mounted smart device, the head-mounted smart device collects the eye movements made by the user to log in to the computing unit, and then sends them to the computing unit, so that the eye movements made when logging in to the computing unit can be input as the login password into the login password on the computing unit. When the computing unit receives the corresponding text login account and login password, the user can successfully log in to the computing unit.

[0067] When the user inputs the login password in text through the head-mounted smart device, the head-mounted smart device collects the second voice input information sent by the user to log in to the computing unit, and then converts the second voice input information into text to obtain the corresponding text password, which can be used as the text login password and sent to the computing unit, so that the corresponding text password when logging in to the computing unit can be input into the text login password on the computing unit. When the computing unit receives the corresponding text login account and text login password, the user can successfully log in to the computing unit.

[0068] It should be noted that the first voice input information and the second voice input information of the user collected by the head-mounted smart device are converted into corresponding text input, which can replace the text input of the keyboard.

[0069] It should also be noted that the eye movements made by the user login computing unit collected by the head-mounted smart device can be blinking movements, eye closing movements, or a combination of blinking movements and eye closing movements.

[0070] For example, the password for the eye login action can be set as: the user blinks a preset number of times within a first preset time period. When the user blinks a preset number of times within the first preset time period, the user can successfully log in to the computing unit if the login account is entered correctly. The first preset time period and the preset number of times can be set according to actual conditions, and this application does not limit this.

[0071] The password for the eye login action can also be set as: the user closes his eyes within a first preset time period. When the user cooperates with the eye closing action within the first preset time period, and the login account is entered correctly, the user can successfully log in to the computing unit.

[0072] The password for the eye login action can also be set to: the user blinks a preset number of times in a first preset time period, and closes the eyes in the first preset time period. When the user blinks a preset number of times in the first preset time period, and closes the eyes in the first preset time period, and the login account is entered correctly, the user can successfully log in to the computing unit.

[0073] In step S104, when the user needs to control the cloud desktop, it can be achieved in the following ways:

[0074] 1) When the user controls the cloud desktop through eye movements, the head-mounted smart device collects the user's eye movements to operate the cloud desktop, forms corresponding control instructions, and sends the control instructions to the computing unit, which sends them to the cloud desktop so that the cloud desktop responds.

[0075] Furthermore, when the computing unit receives a control instruction sent by the head-mounted smart device, the computing unit sends the received control instruction sent by the head-mounted smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instruction sent by the head-mounted smart device includes an eye control instruction, and the eye control instruction is an instruction formed by the eye movements made by the user to operate the cloud desktop.

[0076] It is understandable that the eye movements collected by the head-mounted smart device when the user operates the cloud desktop may include: the user closing the eyes in the second preset time period, the user closing the eyes in the third preset time period, and the user closing the eyes in the fourth preset time period, etc. Among them, the instruction corresponding to the user closing the eyes in the second preset time period is the screen off instruction, the instruction corresponding to the user closing the eyes in the second preset time period is the shutdown instruction, and the instruction corresponding to the user closing the eyes in the fourth preset time period is the disconnection instruction.

[0077] For example: when the user closes his eyes within the second preset time period, the eye control command is set as the screen-off command, that is, when the user closes his eyes within the second preset time period, the head-mounted smart device collects his actions and forms a screen-off command, which is sent to the computing unit, so that the cloud desktop can be turned off through the computing unit.

[0078] When the user closes his eyes within the third preset time period, the eye control instruction is set as a shutdown instruction, that is, when the user closes his eyes within the third preset time period, the head-mounted smart device collects his actions and forms a shutdown instruction, which is sent to the computing unit to shut down the cloud desktop through the computing unit.

[0079] When the user closes his eyes within the fourth preset time period, the eye control instruction is set to a disconnect instruction, that is, when the user closes his eyes within the fourth preset time period, the head-mounted smart device collects his actions and forms a disconnect instruction, which is sent to the computing unit, so that the cloud desktop is disconnected from it through the computing unit.

[0080] It should be noted that the second preset time period, the third preset time period and the fourth preset time period can be set according to actual conditions, and this application will not elaborate on this.

[0081] 2) When the user operates the cloud desktop through hand movements, the wristband-type smart device collects the user's hand movements to operate the cloud desktop, forms corresponding control instructions, and sends the control instructions to the computing unit, which sends them to the cloud desktop so that the cloud desktop responds.

[0082] Furthermore, when the computing unit receives a control instruction sent by the wristband-type smart device, the computing unit sends the received control instruction sent by the wristband-type smart device to the cloud desktop so that the cloud desktop responds; wherein the control instruction of the wristband-type smart device includes a hand control instruction, and the hand control instruction is an instruction formed by a hand movement made by the user to operate the cloud desktop.

[0083] It is understandable that the hand movements collected by the wristband smart device when the user operates the cloud desktop may include: click once, click and drag, click twice in a row, raise one hand with five fingers open, raise one hand with five fingers together, slide the finger diagonally upward, slide the finger diagonally downward, etc. Among them, the instruction corresponding to click once is a close file instruction, which instructs a file on the cloud desktop, the instruction corresponding to click and drag is a move icon instruction, the instruction corresponding to click twice in a row is an open instruction, the instruction corresponding to raise one hand with five fingers open is a zoom-in instruction, the instruction corresponding to raise one hand with five fingers together is a zoom-out instruction, the instruction corresponding to slide the finger diagonally upward is a page-up instruction, and the instruction corresponding to slide the finger diagonally downward is a page-down instruction.

[0084] It should be noted that the hand movements made by the user to operate the cloud desktop in this application are not limited to the above-mentioned contents, and the setting of the hand movements made to operate the cloud desktop and the corresponding operation content can be set according to actual conditions, and this application does not impose any restrictions on this.

[0085] 3) When the user operates the cloud desktop through eye movements and hand movements at the same time, at this time, the head-mounted smart device collects the user's eye movements to manipulate the cloud desktop, forms corresponding manipulation instructions, and sends the manipulation instructions to the computing unit, which sends them to the cloud desktop; at the same time, the wristband smart device collects the user's hand movements to manipulate the cloud desktop, forms corresponding manipulation instructions, and sends the manipulation instructions to the computing unit, which sends them to the cloud desktop, so that the cloud desktop responds based on the manipulation instructions sent by the head-mounted smart device and the wristband smart device at the same time.

[0086] Furthermore, when the computing unit receives control instructions sent by the head-mounted smart device and control instructions sent by the wristband smart device, the computing unit sends the control instructions sent by the head-mounted smart device and the control instructions sent by the wristband smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instructions sent by the head-mounted smart device include eye control instructions, and the control instructions sent by the wristband smart device include hand control instructions, the eye control instructions are instructions formed by eye movements made by the user to operate the cloud desktop, and the hand control instructions are instructions formed by hand movements made by the user to operate the cloud desktop.

[0087] It is understandable that hand control commands can be combined with eye control commands to perform multiple command inputs to control the cloud desktop.

[0088] For example, when the hand action is a click and drag action, the hand control instruction is the click and drag instruction, and the eye action is the user closing the eyes in the second preset time period, and the eye control instruction is the screen-off instruction. After these two instructions are input into the computing unit, the computing unit first executes the click and drag instruction on the icon on the cloud desktop to make the cloud desktop respond, and then executes the screen-off instruction on the cloud desktop to make the cloud desktop respond.

[0089] For another example: when the hand action is a click, the hand control instruction is a file closing instruction, and the eye action is the user closing the eyes in the third preset time period, and the eye control instruction is a shutdown instruction. When these two instructions are input into the computing unit, the computing unit first executes the closing instruction on the file on the cloud desktop, causing the cloud desktop to respond, and then executes the closing instruction on the cloud desktop, causing the cloud desktop to respond.

[0090] It should be noted that the head-mounted smart device in this application is the AR glasses of Orion products, the wristband smart device is the neural wristband of Orion products, and the computing unit is the wireless computing unit of Orion products. In the process of using the computing unit instead of the zero terminal to interact with the cloud desktop, this application replaces some keyboard and mouse operations by sending instructions to the computing unit through the head-mounted smart device and the wristband smart device, which makes it more convenient for users to control the cloud desktop and improves the user experience.

[0091] It should be noted that, although the steps of the method in the present application are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step for execution, and / or one step may be decomposed into multiple steps for execution, etc. In addition, it is also easy to understand that these steps may be, for example, executed synchronously or asynchronously in multiple modules / processes / threads.

[0092] In this example implementation, a method for a head-mounted smart device to interact with a cloud desktop is also provided. Figure 3 The method includes: step S201 to step S204.

[0093] Among them, step S201: the head-mounted smart device establishes a connection with the computing unit.

[0094] Step S202: When the connection between the head-mounted smart device and the computing unit is successfully established, the head-mounted smart device receives and displays the cloud desktop sent by the computing unit; wherein the computing unit includes a zero-terminal computing system, and the computing system is used to realize the display of the cloud desktop on the head-mounted smart device at a distance.

[0095] Step S203: the head-mounted smart device sends the user's login request information to the computing unit, so that the user logs in to the computing unit.

[0096] Step S204: The head-mounted smart device sends a control instruction to the computing unit, so that the computing unit sends it to the cloud desktop for response.

[0097] In one embodiment, the control instructions sent by the head-mounted smart device include eye control instructions, and the eye control instructions are instructions formed by eye movements made by the user to operate the cloud desktop.

[0098] It should be noted that in the steps of discussing the method for the computing unit to interact with the cloud desktop, the method for the head-mounted smart device to interact with the cloud desktop has been explained, and this application will not repeat it.

[0099] In this example implementation, a method for interacting with a wristband-type smart device and a cloud desktop is also provided. Figure 4 The method includes: step S301 to step S302.

[0100] Wherein, step S301: the wristband-type smart device establishes a connection with the computing unit;

[0101] Step S302: When the wristband-type smart device successfully establishes a connection with the computing unit, the wristband-type smart device sends a control instruction to the computing unit, so that the computing unit sends it to the cloud desktop for response.

[0102] In one embodiment, the control instructions sent by the wristband-type smart device include hand control instructions, and the hand control instructions are instructions formed by hand movements made by the user to operate the cloud desktop.

[0103] It should be noted that, in the steps of discussing the method for the computing unit to interact with the cloud desktop, the method for the wristband-type smart device to interact with the cloud desktop has been explained, and this application will not elaborate on this.

[0104] Furthermore, in this exemplary embodiment, a calculation unit is also provided. Figure 5 As shown in , the computing unit 400 may include a connection module 401, a zoom-out display module 402, a login module 403 and a control module 404. The connection module 401 is used for the computing unit to establish a connection with the head-mounted smart device and the wrist-mounted smart device respectively; the zoom-out display module 402 is used for the computing unit to zoom out and display the cloud desktop on the head-mounted smart device after the connection between the computing unit and the head-mounted smart device is successfully established; the computing unit includes a zero-terminal computing system, and the computing system is used to realize the zoom-out display of the cloud desktop on the head-mounted smart device; the login module 403 is used for the computing unit to receive the login request information of the user logging in to the computing unit sent by the head-mounted smart device, so that the user logs in to the computing unit; the control module 404 is used for the computing unit to receive the control instructions sent by the head-mounted smart device and / or the wrist-mounted smart device after the connection between the computing unit and the wrist-mounted smart device is successfully established, and send them to the cloud desktop, so that the cloud desktop responds.

[0105] In one embodiment, it further includes:

[0106] The first control submodule is used for sending the received control instructions sent by the head-mounted smart device to the cloud desktop when the computing unit receives the control instructions sent by the head-mounted smart device, so that the cloud desktop responds; wherein the control instructions sent by the head-mounted smart device include eye control instructions, and the eye control instructions are instructions formed by eye movements made by the user operating the cloud desktop.

[0107] In one embodiment, it further includes:

[0108] The second control submodule is used for sending the received control instructions sent by the wristband-type smart device to the cloud desktop when the computing unit receives the control instructions sent by the wristband-type smart device, so that the cloud desktop responds; wherein the control instructions of the wristband-type smart device include hand control instructions, and the hand control instructions are instructions formed by hand movements made by the user to operate the cloud desktop.

[0109] In one embodiment, it further includes:

[0110] The third control submodule is used for sending the control instructions sent by the head-mounted smart device and the control instructions sent by the wristband smart device to the cloud desktop when the computing unit receives the control instructions sent by the head-mounted smart device and the control instructions sent by the wristband smart device, so that the cloud desktop responds; wherein the control instructions sent by the head-mounted smart device include eye control instructions, and the control instructions sent by the wristband smart device include hand control instructions, the eye control instructions are instructions formed by eye movements made by the user to operate the cloud desktop, and the hand control instructions are instructions formed by hand movements made by the user to operate the cloud desktop.

[0111] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0112] It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the implementation mode of the present application, the features and functions of two or more modules or units described above can be concretized in one module or unit. Conversely, the features and functions of a module or unit described above can be further divided into multiple modules or units for concretization. The components displayed as modules or units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the present application scheme. Those of ordinary skill in the art can understand and implement it without paying creative work.

[0113] In an exemplary embodiment of the present application, a computer-readable storage medium is also provided, on which a computer program is stored, and when the program is included in the processor and executed, the steps of the method for interacting between a computing unit and a cloud desktop described in any of the above embodiments can be implemented. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps of various exemplary embodiments of the present invention described in the method for interacting between a computing unit and a cloud desktop described in the above-mentioned section of this specification.

[0114] refer to Figure 6As shown, a program product 300 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0115] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0116] The computer readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by an instruction execution system, an apparatus, or a device or used in combination with it. The program code contained on the readable storage medium may be transmitted with any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.

[0117] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0118] In an exemplary embodiment of the present application, an electronic device is also provided, which may include a processor and a memory for storing executable instructions of the processor. The processor is configured to execute the steps of the method for interacting between a computing unit and a cloud desktop in any of the above embodiments by executing the executable instructions.

[0119] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".

[0120] Refer to the following Figure 7 The electronic device 600 according to this embodiment of the present invention is described. Figure 7 The electronic device 600 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0121] like Figure 7 As shown, the electronic device 600 is in the form of a general computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different system components (including the storage unit 620 and the processing unit 610), a display unit 640, etc.

[0122] The storage unit stores a program code, which can be executed by the processing unit 610, so that the processing unit 610 executes the steps of various exemplary embodiments of the present invention described in the method of the computing unit interacting with the cloud desktop in the above-mentioned part of this specification. For example, the processing unit 610 can execute the following steps: Figure 1 Follow the steps shown in .

[0123] The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 6201 and / or a cache memory unit 6202 , and may further include a read-only memory unit (ROM) 6203 .

[0124] The storage unit 620 may also include a program / utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules and program data, each of which or some combination may include the implementation of a network environment.

[0125] Bus 630 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0126] The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 600, and / or communicate with any device that enables the electronic device 600 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 650. Furthermore, the electronic device 600 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 660. The network adapter 660 may communicate with other modules of the electronic device 600 via a bus 630. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0127] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation method of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server or a network device, etc.) to execute the method for the above-mentioned computing unit to interact with the cloud desktop according to the implementation method of the present application.

[0128] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary technical means in the art that are not disclosed in the present application.

Claims

1. A method for interacting between a computing unit and a cloud desktop, characterized in that: The method includes: The computing unit establishes connections with the head-mounted smart device and the wrist-mounted smart device respectively; When the connection between the computing unit and the head-mounted smart device is successfully established, the computing unit displays the cloud desktop on the head-mounted smart device in a remote manner; wherein the computing unit includes a zero-terminal computing system, and the computing system is used to realize the remote display of the cloud desktop on the head-mounted smart device; The computing unit receives login request information of a user to log in to the computing unit sent by the head mounted smart device, so that the user logs in to the computing unit; When the connection between the computing unit and the wristband smart device is successfully established, the computing unit receives the control instructions sent by the head-mounted smart device and / or the wristband smart device, and sends them to the cloud desktop, so that the cloud desktop responds.

2. The method for interacting between a computing unit and a cloud desktop according to claim 1, characterized in that: The login request information includes: login account and login password; The login account includes a text login account, and the text login account is a login text obtained by converting the first voice input information made by the user logging into the computing unit collected by the head-mounted smart device and performing text conversion; The login password includes an eye login action or a text login password. The eye login action is an eye movement made by a user when logging into the computing unit and collected by the head-mounted smart device. The text login password is a text password obtained by converting the second voice input information made by the user when logging into the computing unit and collected by the head-mounted smart device.

3. The method for interacting between a computing unit and a cloud desktop according to claim 1, characterized in that: When the computing unit receives a control instruction sent by the head-mounted smart device, the computing unit sends the received control instruction sent by the head-mounted smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instruction sent by the head-mounted smart device includes an eye control instruction, and the eye control instruction is an instruction formed by an eye movement made by a user operating the cloud desktop.

4. The method for interacting between a computing unit and a cloud desktop according to claim 1, characterized in that: When the computing unit receives a control instruction sent by the wristband-type smart device, the computing unit sends the received control instruction sent by the wristband-type smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instruction of the wristband-type smart device includes a hand control instruction, and the hand control instruction is an instruction formed by a hand movement made by a user to operate the cloud desktop.

5. The method for interacting between a computing unit and a cloud desktop according to claim 1, characterized in that: When the computing unit receives the control instructions sent by the head-mounted smart device and the control instructions sent by the wrist-band smart device, the computing unit sends the control instructions sent by the head-mounted smart device and the control instructions sent by the wrist-band smart device to the cloud desktop, so that the cloud desktop responds; wherein the control instructions sent by the head-mounted smart device include eye control instructions, and the control instructions sent by the wrist-band smart device include hand control instructions, the eye control instructions are instructions formed by eye movements made by the user operating the cloud desktop, and the hand control instructions are instructions formed by hand movements made by the user operating the cloud desktop.

6. A method for interacting a head-mounted smart device with a cloud desktop, characterized in that: include: The head-mounted smart device establishes a connection with the computing unit; When the connection between the head-mounted smart device and the computing unit is successfully established, the head-mounted smart device receives and displays the cloud desktop sent by the computing unit; wherein the computing unit includes a zero-terminal computing system, and the computing system is used to realize the display of the cloud desktop on the head-mounted smart device by zooming out; The head-mounted smart device sends a user's login request information to the computing unit, so that the user logs in to the computing unit; The head-mounted smart device sends a control instruction to the computing unit, so that the computing unit sends it to the cloud desktop for response.

7. A method for interacting a wristband-type smart device with a cloud desktop, characterized in that: include: The wristband smart device establishes a connection with the computing unit; When the wristband-type smart device successfully establishes a connection with the computing unit, the wristband-type smart device sends a control instruction to the computing unit, so that the computing unit sends it to the cloud desktop for response.

8. A computing unit, characterized in that: include: A connection module is used for the computing unit to establish connections with the head-mounted smart device and the wrist-mounted smart device respectively; A zoom-out display module, which is used for the computing unit to zoom out and display the cloud desktop on the head-mounted smart device after the connection between the computing unit and the head-mounted smart device is successfully established; wherein the computing unit includes a zero-terminal computing system, and the computing system is used to realize the zoom-out display of the cloud desktop on the head-mounted smart device; A login module, used for the computing unit to receive login request information of a user to log in to the computing unit sent by the head-mounted smart device, so that the user logs in to the computing unit; The control module is used for receiving the control instructions sent by the head-mounted smart device and / or the wrist-mounted smart device and sending them to the cloud desktop after the connection between the computing unit and the wrist-mounted smart device is successfully established, so that the cloud desktop responds.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method for interacting between a computing unit and a cloud desktop as described in any one of claims 1 to 5 are implemented.

10. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to execute the steps of the method for interacting between a computing unit and a cloud desktop according to any one of claims 1 to 5 by executing the executable instructions.

Images