Information processing method and device of desktop cloud system, equipment, medium and product

Abstract

The invention discloses an information processing method and device of a desktop cloud system, equipment, a medium and a product, the method is applied to a virtual machine, and the method comprises the following steps: in a scene in which an external device is mapped to the virtual machine, in response to event information representing operation of the external device, identifying whether the operation indicates a client component of an operation accessed desktop cloud client; if it is determined that the current operation indicates to operate the client component, sending first information to the desktop cloud client based on event information of the current operation; the desktop cloud client is connected with the external equipment; the first information is used for indicating the desktop cloud client to render a visual image and / or execute a client operation task. And after the virtual machine determines that the operation indicates the client component, the analyzed event information is transmitted back to the desktop cloud client, so that the desktop cloud system not only supports the self-defining function of the external equipment, but also supports the external equipment to operate the client component and the virtual desktop, and the compatibility of the desktop cloud system to the external equipment is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of desktop cloud, and in particular to an information processing method and device of a desktop cloud system, equipment, medium and product. BACKGROUND

[0002] The desktop cloud client (also known as a thin terminal) is an access terminal of the desktop cloud system, and can be connected to external devices such as a keyboard, a mouse and a trackball. A user can operate an accessed virtual desktop window and / or a client component of the desktop cloud client based on operation of the external devices. For example, the user uses the mouse to operate the client component to exit the virtual machine access.

[0003] It should be noted that the desktop cloud client can parse the operation of the external device and send event information representing the operation of the external device to the virtual machine by installing a driver locally. However, the desktop cloud client usually only supports a standard USB protocol driver, and the custom functions of some external devices usually need to be parsed by installing a non-standard USB protocol driver. The non-standard USB protocol driver can not be installed on the desktop cloud client, so that the event information cannot be parsed and sent to the virtual machine. Alternatively, because the virtual machine does not install the driver of the external device, it can only parse the event information according to the pre-configured driver, so that the virtual machine cannot accurately parse the custom functions corresponding to the event information. For example, the mouse has left and right scroll functions. When the mouse is scrolled left or right, the desktop cloud client cannot parse and send such event information. For example, based on the driver modification of the keyboard, the F1 key of the keyboard is set as a volume up key. When the F1 key is pressed, the virtual machine cannot parse the image of adjusting the volume based on the event information representing the pressing of the F1 key.

[0004] In order to ensure the normal use of the custom multifunctional external device, in the related art, the desktop cloud system usually uses USB mapping technology to map the external device to the virtual machine for use. The desktop cloud client does not load the driver, but only forwards the original event information representing the operation of the external device. The virtual machine installs the driver of the external device, which is equivalent to the external device being directly connected to the virtual machine for use. However, after the external device is mapped to the virtual machine, the user cannot use the external device to operate the client component of the desktop cloud client because the desktop cloud client does not parse the event information. For example, when it is necessary to exit the virtual machine access, the user needs to unplug the external device or use other operation methods to exit the mapping of the external device, so that the desktop cloud client can respond to the operation of the external device, which affects the user experience. SUMMARY

[0005] Therefore, the embodiments of the present application provide an information processing method, device, equipment, medium and product of a desktop cloud system, aiming to improve the compatibility of the desktop cloud system to external devices.

[0006] The technical scheme of the embodiments of the present application is implemented as follows:

[0007] In a first aspect, the embodiments of the present application provide an information processing method of a desktop cloud system, applied to a virtual machine, a virtual desktop running on the virtual machine, and the method comprising:

[0008] In the case that an external device has been mapped to the virtual machine, in response to event information representing an operation of the external device, it is identified whether the current operation indicates an operation on a client component of an accessed desktop cloud client;

[0009] If it is determined that the current operation indicates an operation on the client component, first information is sent to the desktop cloud client based on the event information of the current operation;

[0010] The desktop cloud client is connected to the external device, and the first information is used to instruct the desktop cloud client to render a visual image and / or execute a client operation task.

[0011] In the above scheme, in response to the event information representing the operation of the external device, it is identified whether the current operation indicates an operation on the client component of the accessed desktop cloud client, comprising:

[0012] In response to the event information, a current operation position in the virtual desktop is determined;

[0013] If the operation position falls within a first target position interval, it is determined that the current operation indicates an operation on the client component of the accessed desktop cloud client;

[0014] If the operation position does not fall within the first target position interval, it is determined that the current operation does not indicate an operation on the client component of the accessed desktop cloud client;

[0015] The first target position interval is a position interval corresponding to the client component on the virtual desktop.

[0016] In the above scheme, the method further comprises:

[0017] A first instruction or a second instruction sent by the desktop cloud client is received, the first instruction instructing to stop executing a virtual desktop operation task, and the second instruction instructing to resume executing the virtual desktop operation task;

[0018] In response to the event information representing the operation of the external device, it is identified whether the current operation indicates an operation on the client component of the accessed desktop cloud client, comprising:

[0019] Based on the received instruction, after determining that the current operation of the virtual desktop operation task is stopped, the event information is determined in response to the event information, and the client component of the desktop cloud client accessed by the operation is determined.

[0020] In the above scheme, the method comprises:

[0021] In the scenario where the external device has been mapped to the virtual machine, the event information is received based on the mapping channel between the desktop cloud client and the virtual machine.

[0022] Based on the event information, the virtual desktop is controlled to perform a virtual desktop operation task.

[0023] The received event information is second information sent by the external device, and the second information is transmitted to the virtual machine through the desktop cloud client.

[0024] In the above scheme, the first information is sent to the desktop cloud client based on the event information of the current operation, comprising:

[0025] Based on the event information of the current operation and the current operation position, the first information is generated.

[0026] Based on the mapping channel between the desktop cloud client and the virtual machine, the first information is sent to the desktop cloud client.

[0027] In the above scheme, the external device comprises at least one of the following: keyboard, mouse and trackball; the event information comprises at least one of the following: keyboard key event information, mouse movement event information, mouse key event information, mouse wheel event information, trackball scroll event information and trackball key event information.

[0028] In a second aspect, the embodiments of the present application provide an information processing method of a desktop cloud system, applied to a desktop cloud client, the desktop cloud client running a client component, the method comprising:

[0029] In the scenario where the external device has been mapped to the accessed virtual machine, the event information representing the operation of the external device is received.

[0030] If it is determined that the received event information is first information sent by the virtual machine, then based on the first information, a visual image is rendered and / or a client operation task is performed.

[0031] The desktop cloud client is connected to the external device, and the virtual desktop is running on the virtual machine.

[0032] In the above scheme, the first information includes event information of the current operation and a current operation position; and the rendering of the visual image and / or the execution of the client operation task based on the first information includes:

[0033] determining a rendering position based on the current operation position carried by the first information;

[0034] rendering the visual image at the rendering position based on the event information carried by the first information; and / or,

[0035] determining a corresponding target client operation task based on the current operation position carried by the first information;

[0036] if the event information carried by the first information indicates the execution of the task, executing the target client operation task.

[0037] In the above scheme, the method further includes:

[0038] if the current operation position falls into a second target position interval and the event information of the current operation indicates the execution of a first target task based on the first information, sending a first instruction to the virtual machine; the first instruction indicates the stop of the execution of the virtual desktop operation task;

[0039] if the current operation position falls into a third target position interval and the event information of the current operation indicates the execution of a second target task based on the first information after the sending of the first instruction, sending a second instruction to the virtual machine; the second instruction indicates the resumption of the execution of the virtual desktop operation task;

[0040] wherein the second target position interval and the third target position interval are determined based on a current position interval of the client component.

[0041] In the above scheme, in the scenario where the external device has been mapped to the accessed virtual machine, the event information representing the operation of the external device includes:

[0042] In the scenario where the external device has been mapped to the accessed virtual machine, receiving the first information sent by the virtual machine based on a mapping channel between the virtual machine and the external device; and,

[0043] receiving the second information sent by the external device based on a connection interface of the external device;

[0044] The method further includes:

[0045] In the scenario where the external device has been mapped to the accessed virtual machine, forwarding the received second information to the virtual machine based on a mapping channel between the virtual machine and the external device.

[0046] In the foregoing solution, the external device comprises at least one of a keyboard, a mouse, and a trackball; and the event information comprises at least one of a keyboard key event, a mouse movement event, a mouse key event, a mouse scroll wheel event, a trackball scroll event, and a trackball key event.

[0047] In a third aspect, the embodiments of the present application provide an information processing apparatus of a desktop cloud system, applied to a virtual machine, wherein a virtual desktop is running on the virtual machine, and the information processing apparatus comprises:

[0048] a recognition module, configured to, in a scenario where an external device has been mapped to the virtual machine, in response to event information representing an operation of the external device, recognize whether the current operation indicates an operation on a client component of a desktop cloud client;

[0049] a first sending module, configured to, if it is determined that the current operation indicates an operation on the client component, send first information to the desktop cloud client based on the event information of the current operation;

[0050] wherein the desktop cloud client is connected to the external device; and the first information is used to instruct the desktop cloud client to render a visual image and / or execute a client operation task.

[0051] In a fourth aspect, the embodiments of the present application provide an information processing apparatus of a desktop cloud system, applied to a desktop cloud client, wherein a client component is running on the desktop cloud client, and the information processing apparatus comprises:

[0052] a first receiving module, configured to, in a scenario where an external device has been mapped to an accessed virtual machine, receive event information representing an operation of the external device;

[0053] a first execution module, configured to, if it is determined that the received event information is first information sent by the accessed virtual machine, render a visual image and / or execute a client operation task based on the first information;

[0054] wherein the desktop cloud client is connected to the external device; and the virtual machine is running a virtual desktop.

[0055] In a fifth aspect, the embodiments of the present application provide a server, configured to run a virtual machine of a desktop cloud system, wherein a virtual desktop is running on the virtual machine, and the server comprises a processor and a memory for storing a computer program capable of running on the processor, wherein the processor is configured to run the computer program, and execute the steps of the method in the first aspect.

[0056] In a sixth aspect, an embodiment of the present application provides a desktop cloud client connected to an external device, comprising a processor and a memory for storing a computer program capable of running on the processor, and the processor is configured to run the computer program to perform the steps of the method in the second aspect.

[0057] In a seventh aspect, an embodiment of the present application provides a storage medium having a computer program stored thereon, and the computer program, when executed by a processor, implements the steps of the method in the first aspect and the second aspect.

[0058] In an eighth aspect, an embodiment of the present application provides a computer program product comprising a computer program, and the computer program, when executed by a processor, implements the steps of the method in the first aspect and the second aspect.

[0059] The technical scheme provided by the embodiments of the present application is applied to a virtual machine, and a virtual desktop runs on the virtual machine. The method comprises the following steps: in a scenario where an external device has been mapped to the virtual machine, in response to event information representing an operation of the external device, it is identified whether the current operation indicates a client component of a desktop cloud client accessed by the operation; if it is determined that the current operation indicates the client component, first information is sent to the desktop cloud client based on the event information of the current operation; and the desktop cloud client is connected to the external device; and the first information is used to instruct the desktop cloud client to render a visual image and / or execute a client operation task. In this way, the embodiments of the present application take into account the problem that in the scenario where the desktop cloud is mapped to use the external device, the client component of the desktop cloud client cannot be operated by the external device. After the virtual machine determines that the current operation indicates the client component, the parsed event information is returned to the desktop cloud client, which instructs the desktop cloud client to render a visual image and / or execute a client operation task. Thus, the desktop cloud system supports both the custom functions of the external device and the operation of the client component and the virtual desktop by the external device, improves the compatibility of the desktop cloud system to the external device, and the user cannot perceive the change of the operation object when using the desktop cloud system, thereby improving the user experience. BRIEF DESCRIPTION OF DRAWINGS

[0060] Figure 1 FIG. 1 is a flowchart of an information processing method of a desktop cloud system according to an embodiment of the present application;

[0061] Figure 2 FIG. 2 is a control scenario diagram of a desktop cloud system in the related art;

[0062] Figure 3 FIG. 3 is a control scenario diagram of another desktop cloud system in the related art;

[0063] Figure 4A FIG. 4 is a schematic diagram of a client component according to an embodiment of the present application;

[0064] Figure 4B FIG. 2 is a schematic diagram of a client component according to another embodiment of the present application;

[0065] Figure 4C FIG. 3 is a schematic diagram of a display interface of a desktop cloud system according to the related art;

[0066] Figure 5 FIG. 4 is a schematic diagram of a flow of an information processing method of a desktop cloud system according to another embodiment of the present application;

[0067] Figure 6 FIG. 5 is a schematic diagram of a display interface of a desktop cloud system according to an embodiment of the present application;

[0068] Figure 7 FIG. 6 is a schematic diagram of a flow of an information processing method of a desktop cloud system according to an application example of the present application;

[0069] Figure 8 FIG. 7 is a schematic diagram of a structure of an information processing device of a desktop cloud system according to an embodiment of the present application;

[0070] Figure 9 FIG. 8 is a schematic diagram of a structure of an information processing device of a desktop cloud system according to another embodiment of the present application;

[0071] Figure 10 FIG. 9 is a schematic diagram of a structure of a server according to an embodiment of the present application;

[0072] Figure 11 FIG. 10 is a schematic diagram of a structure of a desktop cloud client according to an embodiment of the present application. DETAILED DESCRIPTION

[0073] The present application will be further described below in conjunction with the accompanying drawings and embodiments.

[0074] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used in the description herein is for describing particular embodiments only and is not intended to be limiting of the application.

[0075] An information processing method of a desktop cloud system is provided according to an embodiment of the present application, which is applied to a virtual machine of the desktop cloud system, and a virtual desktop is run on the virtual machine, such as Figure 1 As shown in FIG. 1, the method comprises:

[0076] In step 101, in a scenario where an external device is mapped to a virtual machine, in response to event information representing an operation of the external device, it is identified whether the current operation indicates a client component of a desktop cloud client accessed by the operation.

[0077] In step 102, if it is determined that the operation client component is indicated by the current operation, first information is sent to the desktop cloud client based on event information of the current operation.

[0078] The desktop cloud client is connected to an external device, and the first information is used to instruct the desktop cloud client to render a visual image and / or execute a client operation task.

[0079] Here, the desktop cloud system of the embodiment of the present application is implemented based on a virtual desktop infrastructure (VDI). Based on the VDI architecture, a desktop operating system and an application program can be separated from a physical device by virtualization technology, and run and managed on a data center server.

[0080] Here, in the embodiment of the present application, the desktop cloud system includes a virtual machine and a desktop cloud client. The virtual machine is centrally deployed on a data center server or a cloud server, and is used to run a virtual desktop. The desktop cloud client, also known as a thin terminal or aDesk, is an access terminal of the desktop cloud system, and can be connected to the virtual machine through a network to access the virtual desktop, and transmit a graphical interface to a connected local display terminal using a remote desktop protocol, that is, in the VDI structure, the server on which the virtual machine is deployed is used to centrally store and operate data, and the desktop cloud client only transmits image information.

[0081] It should be noted that the desktop cloud client of the embodiment of the present application can be a lightweight computing terminal specially used for remote access, or an electronic terminal such as a computer configured to support connection of a virtual machine of the desktop cloud; the desktop cloud client can be an ARM architecture terminal with high running efficiency, or an X86 architecture terminal with high system compatibility, and the type of the desktop cloud client of the desktop cloud system is not limited in the embodiment of the present application.

[0082] It should be noted that the desktop cloud client is provided with a plurality of externally connected interfaces for connecting external devices, wherein the external devices include but are not limited to a keyboard, a mouse, a trackball, a click wheel, a touchpad, and a touch screen.

[0083] It should be noted that the desktop cloud client can also be connected to a storage terminal, a display terminal, and other terminal devices with different forms and functions based on the externally connected interfaces, and in the embodiment of the present application, the external devices connected to the desktop cloud client only refer to devices that can be operated to operate the virtual desktop and the client component.

[0084] Correspondingly, if the external device is a keyboard, the event information representing the operation of the keyboard includes, but is not limited to, keyboard key event information; if the external device is a mouse, the event information representing the operation of the mouse includes, but is not limited to, mouse movement event information, mouse key event information, and mouse scroll wheel event information; if the external device is a trackball, the event information representing the operation of the trackball includes, but is not limited to, trackball scroll event information and trackball key event information.

[0085] Here, the keyboard key event information includes keyboard letter key event information, keyboard number key event information, and keyboard special key event information; the mouse movement event information includes mouse up movement event information, mouse down movement event information, mouse left movement event information, and mouse right movement event information; the mouse key event information includes mouse left key event information and mouse right key event information; and the mouse scroll wheel event information includes mouse up scroll event information and mouse down scroll event information. It should be noted that based on the above examples of some external devices and event information representing the operation of the external devices, those skilled in the art can fully understand the specific connotations of the external devices and the event information in the embodiments of the present application, and thus no further examples are provided herein.

[0086] Here, the client component is a module component generated by the desktop cloud client, and can provide services such as virtual machine access, virtual machine exit, and screen locking for the user. In some embodiments, in order to facilitate the user to call the related services provided by the client component, the client component is displayed in the form of a specific icon in a specific interval of the display interface, where the specific interval can be an interval outside the virtual desktop window, or an interval fully or partially overlapping with the virtual desktop window. The user can use the external device to operate the client component, so that the desktop cloud client performs a corresponding task, i.e., a client operation task. For example, the user moves the mouse to the position corresponding to the screen locking icon of the client component and clicks the left mouse button, and the desktop cloud client performs a screen locking task after processing the corresponding event information.

[0087] Here, the visual form of the client component includes, but is not limited to, a navigation bar, a screen locking interface, and a floating window. In some embodiments, the client component is visually displayed in the form of a navigation bar, as shown in FIG. 4A; in some embodiments, the client component is visually displayed in the form of a floating window, as shown in FIG. 4B. It is easy to understand that the visual form of the client component is not specifically limited in the embodiments of the present application. Figure 4A Figure 4B

[0088] ​​Here, the services that can be provided by the desktop cloud client include, but are not limited to, switching access to a virtual machine, closing a session window, querying a network status, USB device management, self-service, restoring a snapshot, inputting a password in a lock screen interface, and logging out in a lock screen interface. The services are executed by the user operating the client component using the external device.

[0089] It can be understood that, when the user uses the desktop cloud system, a display interface displayed by the display terminal is generated by the virtual machine and the desktop cloud client. The virtual machine generates a virtual desktop window image, and the desktop cloud client generates an image including at least an icon of the client component.

[0090] It can be understood that, because the user uses the desktop cloud system, most of the operations are performed on the virtual desktop, and the number of operations on the client component is small. Therefore, when the user operates the virtual desktop, the client component is usually displayed on a top layer of a virtual desktop image interface, so as to facilitate the user to operate the client component when needed.

[0091] It should be noted that, in the related art, the desktop cloud system usually supports two control scenarios of external device operation, to implement operation of the virtual desktop through the external device. The first control scenario is a local drive scenario, as shown in FIG. 1. The desktop cloud client installs a drive program of the external device. When the user operates the external device, the desktop cloud client loads the drive program and parses received information into event information representing operation of the external device, and sends the event information to the virtual machine through a specific keyboard and mouse channel. The virtual machine parses the received event information based on a pre-installed drive program, and sends the parsed event information to a corresponding application programming interface (API) to respond to the operation. Figure 2

[0092] It can be understood that, based on the local drive scenario, a conventional operation of the external device can be parsed by the desktop cloud client and the virtual machine.

[0093] ​It should be noted that in order to simplify the architecture and functions of the desktop cloud client, the desktop cloud client only supports the driver of the standard USB protocol, that is, the keyboard and mouse channel between the desktop cloud client and the virtual machine only supports the transmission of event information based on the standard USB protocol; some external devices with custom multifunctional need to install a non-standard USB protocol driver in order to realize the user's custom setting function (for example, in addition to the left key, right key and scroll wheel, the mouse sets an additional key to operate the custom function), and the non-standard USB protocol driver may not be installed in the desktop cloud client, therefore, in the local drive scenario, such event information cannot be parsed and sent to the virtual machine, for example, the mouse has left and right scroll functions, which are non-standard functions of the mouse, when the mouse is scrolled left and right, the desktop cloud client cannot parse and send such event information.

[0094] It should be noted that based on the non-standard USB protocol driver of the external device, part of the operation of the external device may be customized by the user as other functions different from the original function, and since the virtual machine does not install the driver of the external device, it can only parse the event information according to the pre-installed driver, so that the virtual machine cannot accurately parse the custom function corresponding to such event information. For example, by modifying the driver, the F1 key of the keyboard is set as a function key indicating volume increase, and since the virtual machine does not install the driver of the keyboard, the volume control service is called after receiving the keyboard F1 key event information, and the image related to the volume control is rendered.

[0095] It can be understood that in the local drive scenario, the desktop cloud system usually does not support the custom function of the external device.

[0096] Here, in another control scenario, the custom multifunctional external device can be normally used in the virtual machine. Specifically, the second control scenario is a mapping control scenario, as shown in Figure 3 The desktop cloud system uses USB mapping technology to directly map the external device connected to the physical USB interface of the desktop cloud client to the virtual machine, so that the virtual machine can directly use the external device based on the virtual operating system running on the virtual machine, and the virtual machine installs the official driver of the external device to support the normal operation of the custom function of the external device.

[0097] It should be noted that in the mapping control scenario, the desktop cloud client does not load the driver, but only forwards the original event information representing the operation of the external device, that is, the external device is directly connected to the virtual machine for use.

[0098] However, based on the USB mapping technology, although the user can use the customized multifunction peripheral device to operate the virtual desktop running on the virtual machine, the peripheral device has already existed in the virtual machine through the mapping channel, and the desktop cloud client does not parse the event information sent by the peripheral device, at this time, the user cannot use the peripheral device to operate the client component, for example, when the user wants to operate the client component to realize the lock screen, as shown in Figure 4C The operation cursor is only rendered on the virtual desktop, and the operation cursor rendered on the virtual desktop overlaps with the icon of the client component placed on the top layer, the user cannot see the operation cursor rendered on the virtual desktop, and the keyboard key event information for setting the lock screen password cannot be parsed by the desktop cloud client, and the desktop cloud client cannot execute the lock screen task.

[0099] Therefore, in the related art, if the user needs to exit the virtual machine access or perform other client component operations, the user needs to plug in or plug out the peripheral device or other ways to make the peripheral device exit the mapping, and then use the peripheral device to operate the client component after the desktop cloud client re-recognizes the peripheral device, in other words, in the related art, for the use of the customized multifunction peripheral device, the virtual machine and the desktop cloud client of the desktop cloud system cannot simultaneously respond to the operation, which seriously affects the user experience.

[0100] It should be noted that, to solve the problem that the desktop cloud system cannot support the user to use the customized multifunction peripheral device to switch between the virtual desktop and the client component, the virtual machine of the embodiment of the present application adopts the method of event message feedback, which improves the compatibility of the desktop cloud system to the peripheral device.

[0101] It should be noted that the information processing method of the desktop cloud system of the embodiment of the present application is executed in the scenario that the peripheral device has been mapped to the virtual machine, that is, the embodiment of the present application is implemented on the basis of the above mapping control scenario.

[0102] Based on this, the method comprises: in the scenario that the peripheral device has been mapped to the virtual machine, receiving event information based on the mapping channel between the desktop cloud client; based on the event information, controlling the virtual desktop to execute a virtual desktop operation task; wherein the received event information is second information sent by the peripheral device, and the second information is transmitted to the virtual machine by the desktop cloud client.

[0103] It can be understood that the second information is the original event information sent by the peripheral device in response to the operation, and the desktop cloud client does not parse the second information.

[0104] It can be understood that, based on the USB mapping technology, a USB mapping channel is established between the virtual machine and the accessed desktop cloud client; the second information generated by the user using the external device is directly transmitted to the virtual machine through the desktop cloud client via the USB mapping channel.

[0105] Here, the Agent component runs on the virtual machine of the desktop cloud system, and the Agent component captures the event information in real time through the function provided by the API after the user operates the external device.

[0106] It should be noted that, in the related art, after the virtual machine receives the event information based on the mapping channel, the event information is directly parsed, and a virtual desktop operation task is directly executed after parsing, and / or a visual image is rendered at a corresponding position of the virtual desktop. For example, if this operation is a left mouse movement, the virtual machine determines that this operation does not need to start a new task process, and then renders a left operation cursor on the virtual desktop; but in the embodiment of the present application, after the virtual machine parses the event information, the corresponding task is not directly executed and / or the corresponding image is not directly rendered, but the user operation intention corresponding to this operation is identified.

[0107] Here, the user operation intention includes operating the virtual desktop and operating the client component of the accessed desktop cloud client.

[0108] It can be understood that, in the embodiment of the present application, the virtual machine identifies the user operation intention corresponding to this operation to determine whether the event information of this operation needs to be synchronized with the desktop cloud client; since the virtual machine supports normal use of each function of the self-defined multifunctional external device, and the virtual machine and the accessed desktop cloud client can receive and transmit instruction information through the network, after the virtual machine instructs the operation of the client component according to this operation, the event information is returned to the desktop cloud client. The returned event information can be used to instruct the desktop cloud client to execute the corresponding task and render the visual image, whether the desktop cloud client supports installing the driver of the external device or not, since the virtual machine can parse the event information, based on the information processing method of mapping + return, the user can use the external device to operate the virtual desktop window and the client component, which improves the compatibility of the desktop cloud system to the external device.

[0109] It should be noted that, in the embodiment of the present application, if the virtual machine determines that this operation does not instruct the operation of the client component, the virtual machine does not send the first information to the desktop cloud client, and based on the event information of this operation, the virtual machine executes a virtual desktop operation task, and / or renders a visual image on the virtual desktop.

[0110] Exemplarily, sending the first information to the desktop cloud client based on the event information of this operation includes: generating the first information based on the event information of this operation and the current operation position; and sending the first information to the desktop cloud client based on the mapping channel with the desktop cloud client.

[0111] Here, the event information carried in the first information is event information that can be parsed by the desktop cloud client after being processed by the virtual machine, so as to prevent the original event information of the customized function of the external device from being unable to be accurately parsed by the desktop cloud client.

[0112] It can be understood that in the embodiment of the present application, since the desktop cloud client does not parse event information when the user operates the virtual desktop, the desktop cloud client cannot determine the current operation location based solely on the event information returned by the virtual machine. Therefore, the first information returned also carries the current operation location, allowing the desktop cloud client to determine the desktop cloud operation tasks that need to be executed and the rendering location of the visual image based on the current operation location.

[0113] It should be noted that since the virtual desktop window and the client component area may overlap, the image rendered by the virtual machine in the overlapping area will be covered by the client component icon placed on the top layer. In order to make the image representing the external device operation and related images visible, in an embodiment of the present application, if the external device operation is used to operate the client component, the image rendering synchronized with this operation is implemented by the desktop cloud client, so that the image corresponding to this operation is visualized, and the user cannot perceive the changes in the operation object when using the desktop cloud system.

[0114] It can be understood that the embodiment of the present application takes into account the problem that the client components of the desktop cloud client cannot be operated through external devices in the scenario where external devices are used for desktop cloud mapping. After the virtual machine determines that the operation indicates the client component, it returns the parsed event information to the desktop cloud client, instructing the desktop cloud client to render the visual image and / or perform the client operation task, so that the desktop cloud system supports both the customized functions of external devices and the operation of client components and virtual desktops by external devices, thereby improving the compatibility of the desktop cloud system with external devices, and users cannot perceive changes in the operation object when using the desktop cloud system, thereby improving the user experience.

[0115] In an embodiment of the present application, a method for a virtual machine to identify the user operation intention corresponding to the current operation is also provided.

[0116] Exemplarily, in response to the event information representing the operation of the external device, identifying whether the current operation indicates the operation of the client component of the desktop cloud client accessed by the operation includes: determining the current operation position in the virtual desktop in response to the event information; if the operation position falls within the first target position interval, determining that the current operation indicates the operation of the client component of the desktop cloud client accessed by the operation; if the operation position does not fall within the first target position interval, determining that the current operation does not indicate the operation of the client component of the desktop cloud client accessed by the operation; wherein the first target position interval is a position interval corresponding to the client component on the virtual desktop.

[0117] Here, after the desktop cloud client and the virtual machine establish a connection, the virtual machine pre-acquires the initial position interval of the client component of the desktop cloud client, and determines the first target position interval.

[0118] It can be understood that when the user operates the client component using the external device, the operation cursor needs to be moved to overlap the client component; here, the operation cursor is generated based on the operation position, and the virtual machine can determine the user operation intention of the current operation based on whether the operation position falls within the first target position interval.

[0119] Here, the event information can be event information indicating updating of the operation position, such as mouse left movement event information, or event information not indicating updating of the operation position, such as keyboard key event information; after the virtual machine responds to and analyzes the event information of the current operation, it identifies whether the current operation indicates the operation of the client component of the desktop cloud client accessed by the operation.

[0120] In an example, if the operation position does not fall within the first target position interval, the virtual machine does not send the first information; in response to the mouse movement event information, based on the current operation, the operation position is updated to fall within the first target position interval, the virtual machine sends the first information to the desktop cloud client based on the mouse movement event information.

[0121] In an example, if the operation position falls within the first target position interval, the virtual machine sends the first information; in response to the keyboard key event information, based on the current operation, the operation position does not change, the virtual machine sends the first information to the desktop cloud client again based on the keyboard key event information.

[0122] Exemplarily, the method further includes: receiving the first instruction or the second instruction sent by the desktop cloud client; the first instruction indicates to stop executing the virtual desktop operation task, and the second instruction indicates to resume executing the virtual desktop operation task.

[0123] Exemplarily, in response to event information characterizing an external device operation, identifying whether the current operation indicates an operation on a client component of a desktop cloud client to which the operation is connected includes: based on a received instruction, determining that the current virtual desktop operation task is stopped, and then, in response to the event information, determining that the current operation indicates an operation on a client component of a desktop cloud client to which the operation is connected.

[0124] It should be noted that during the operation of the client component, the range of the client component may change. For example, the client component pops up a drop-down menu, and the change in the range of the client component during the operation cannot be obtained and determined by the virtual machine, resulting in when the user operates the drop-down menu, the virtual machine determines that the current operation position does not fall into the first target position interval, and fails to recognize that this operation indicates the operation of the client component; therefore, the embodiment of the present application also provides an active interaction mechanism between the desktop cloud client and the virtual machine, where the desktop cloud client sends instructions to the virtual machine, and the virtual machine can determine that the event information received within a specific time period all indicates the operation of the client component based only on the received instructions, and transmits all the event information back to the desktop cloud client.

[0125] It is understandable that in order to avoid the same event information being responded to and executed simultaneously by the virtual machine and the desktop cloud client, after the virtual machine receives the first instruction, regardless of whether the current operation position falls within the first target position range, it stops executing the virtual desktop operation task and resumes after receiving the second instruction.

[0126] Here, after receiving the first instruction, the virtual machine stops rendering the image on the virtual desktop based on the event information, regardless of whether the rendering position of the image is within the range of the client component, and resumes after receiving the second instruction. Based on the aforementioned information processing method for the desktop cloud system applied to the virtual machine, the embodiment of the present application also provides an information processing method for the desktop cloud client, such as Figure 5 As shown, the method includes:

[0127] Step 501: In a scenario where an external device has been mapped to an accessed virtual machine, event information representing an operation of the external device is received.

[0128] Step 502: If it is determined that the received event information is the first information sent by the virtual machine, then based on the first information, a visual image is rendered and / or a client operation task is executed.

[0129] The desktop cloud client connects the external device, and the virtual machine runs a virtual desktop. Illustratively, in the scenario where the external device has been mapped to the accessed virtual machine, event information representing operation of the external device is received, including: in the scenario where the external device has been mapped to the accessed virtual machine, first information sent by the virtual machine is received based on a mapping channel between the virtual machine; and second information sent by the external device is received based on a connection interface of the external device.

[0130] Illustratively, the method further includes: in the scenario where the external device has been mapped to the accessed virtual machine, forwarding the received second information to the virtual machine based on the mapping channel between the virtual machine.

[0131] It can be understood that, in the scenario where the external device has been mapped to the accessed virtual machine, since the virtual machine supports normal use of each function of the customized multifunctional external device, and the desktop cloud client and the accessed virtual machine can receive and send instruction information through a network, in the embodiments of the present application, the desktop cloud client does not perform parsing processing on the received second information, directly transmits the original second information to the accessed virtual machine, and receives first information returned by the virtual machine, so that the desktop cloud client can respond to the operation of the external device based on the first information, render a visual image and / or execute a client operation task, regardless of whether the desktop cloud client supports installation of all drivers of the external device, solving the problem that the desktop cloud client cannot parse and process event information related to customized functions sent by the external device, and the problem that the desktop cloud client cannot directly render a visual image and / or execute a client operation task based on event information sent by the external device in a mapping control scenario, improving compatibility of the desktop cloud system to the external device. Here, the desktop cloud client of the embodiments of the present application installs at least a driver of a standard USB protocol of the external device; in some embodiments, after the desktop cloud client is started, before an access relationship with the virtual machine is established, a user can use a basic function of the external device to operate a client component, instruct to access the virtual machine, at which time the desktop cloud client controls the client component to execute a task based on the second information sent by the external device; after the access relationship with the virtual machine is established, the external device is mapped to the virtual machine through the mapping channel, at which time the desktop cloud client stops parsing and executing the second information.

[0132] Illustratively, the first information includes event information of the current operation and a current operation position; based on the first information, a visual image is rendered, including: based on the current operation position carried by the first information, a rendering position is determined; and based on the event information carried by the first information, the visual image is rendered at the rendering position.

[0133] In some embodiments, the visualized image rendered based on the first information comprises at least an operation cursor; in this embodiment, the desktop cloud client determines the current operation position as the rendering position of the operation cursor, and renders the visualized operation cursor at the determined rendering position. For example, based on the continuously received first information, the continuously updated operation position is obtained, and based on the updated track of the operation position, the visualized operation cursor is continuously rendered.

[0134] In some embodiments, the visualized image rendered based on the first information can also comprise a drop-down menu, an input window, a font image and other forms of visualized images; in this embodiment, the desktop cloud client determines the current operation position and the event information as the rendering position corresponding to each image, and renders the visualized corresponding image at the determined rendering position. For example, in the password input task scenario, based on the current operation position, the rendering position of the password font image is determined, and based on the keyboard key event information, the visualized font image is rendered at the rendering position.

[0135] It can be understood that the embodiments of the present application do not specifically limit the form of the visualized image rendered by the desktop cloud client, and any image display for prompting the user of the current client component operation belongs to the category of the visualized image rendered by the desktop cloud client.

[0136] It should be noted that in the embodiments of the present application, the visualized image rendered by the desktop cloud client based on the first information is placed on the top layer of the virtual desktop image in the same interval to achieve the visualized effect.

[0137] For example, based on the first information, the client operation task is executed, including: based on the current operation position carried by the first information, determining the corresponding target client operation task; if the event information carried by the first information indicates to execute the task, the target client operation task is executed.

[0138] It can be understood that the client component prompts the target client operation task corresponding to each icon position by different forms of task icons; the user moves the operation position to any icon position of the client component by operating the external device, and the desktop cloud client not only generates an overlaid operation cursor at the corresponding icon position, but also determines the corresponding target client operation task based on the operation position.

[0139] Here, the event information indicating to execute the task includes but is not limited to: mouse key event information and trackball key event information; the desktop cloud client executes the target client operation task based on the event information indicating to execute the task and the current operation position. For example, the current operation position is located at the position of the lock screen task icon, and the desktop cloud client starts to execute the lock screen task based on the mouse left key event information carried in the first information.

[0140] Exemplarily, the method further comprises: based on the first information, determining that the current operation position falls into a second target position interval and the event information of the current operation indicates that the first target task is executed, sending a first instruction to the virtual machine; the first instruction indicates to stop executing the virtual desktop operation task; after sending the first instruction, based on the first information, determining that the current operation position falls into a third target position interval and the event information of the current operation indicates that the second target task is executed, sending a second instruction to the virtual machine; the second instruction indicates to resume executing the virtual desktop operation task; wherein the second target position interval and the third target position interval are determined based on the position interval of the current client component.

[0141] It should be noted that, since the operation of the client component is only executed on the desktop cloud client, the virtual machine cannot determine the execution state of the current client operation task in real time, which may cause part of the event information indicating the operation of the client component to be unable to be accurately recognized by the virtual machine, so that the virtual machine does not return such event information, for example, a user operates the client component in the drop-down menu interval of the client component, since the position interval of the drop-down menu is not the initial position interval of the client component, and the virtual machine cannot recognize that the drop-down menu is popped up based on the previous external device operation, so the virtual machine does not return the event information of the operation position falling into the position interval of the drop-down menu to the desktop cloud client. For such a case, the embodiment of the present application further provides an active interaction mechanism between the desktop cloud client and the virtual machine, and the desktop cloud client sends an instruction to the virtual machine, and the virtual machine can determine that the event information received at a specific time all indicates the operation of the client component based on the received instruction, and returns the event information to the desktop cloud client.

[0142] It can be understood that, in order to avoid the same event information being simultaneously responded and executed by the virtual machine and the desktop cloud client, after the desktop cloud client sends the first instruction, the virtual machine stops the virtual desktop operation task execution and image rendering based on the received event information before the virtual machine receives the second instruction.

[0143] It should be noted that the embodiment of the present application does not make specific limitation on the target position interval and the target task for determining whether to send the first instruction or the second instruction.

[0144] In some embodiments, the task icon representing the freeze function is arranged on the client component, the position interval corresponding to the task icon representing the freeze function is the second target position interval and the third target position interval, and the first target task and the second target task are indicated to be executed by the mouse left key event information. It is easy to understand that in this embodiment, the user operates the external device to move the operation cursor to overlap the task icon representing the freeze function and clicks the mouse left key, and the desktop cloud client determines that the operation position falls within the second target position interval and the event information of this operation indicates to execute the first target task, sends a first instruction to the virtual machine, and the virtual machine executes the freeze mode based on the first instruction, that is, stops responding to execute the received event information, and returns the received event information to the desktop cloud client in the form of first information. After the user achieves the operation requirement of the client component, the operation cursor is moved to overlap the task icon representing the freeze function again by operating the external device, and the mouse left key is clicked, and the desktop cloud client determines that the operation position falls within the third target position interval and the event information of this operation indicates to execute the second target task, sends a second instruction to the virtual machine, and the virtual machine executes the unfreeze mode based on the second instruction, that is, restores the execution of the virtual desktop operation task and renders the visual image on the virtual desktop. In some embodiments, since the desktop cloud client can determine the interval range of the client component when operating the client component, the second target position interval and the third target position interval can also be determined based on the current interval range of the client component. For example, the second target position interval is the position interval corresponding to the task icon on the client component, the third target position interval is the position interval outside the current interval range of the client component, and the first target task and the second target task are indicated to be executed by the mouse left key event information. The user operates the external device to move the operation cursor to overlap any task icon and clicks the mouse left key, and the desktop cloud client determines that the operation position falls within the second target position interval and the event information of this operation indicates to execute the first target task, and sends a first instruction to the virtual machine. The user moves the operation cursor to any position outside the current interval range of the client component and clicks the mouse left key, and the desktop cloud client determines that the operation position falls within the third target position interval and the event information of this operation indicates to execute the second target task, and sends a second instruction to the virtual machine.

[0145] Illustratively, the method further comprises marking the event information received based on the mapping channel between the virtual machines.

[0146] Illustratively, determining that the event information is the first information sent by the virtual machine comprises judging whether the event information has a mark, and if the event information has the mark, determining that the event information is the first information sent by the virtual machine.

[0147] Exemplarily, the event information is determined as the second information sent by the external device, including: judging whether the event information exists a mark; if the event information does not exist the mark, determining the event information as the second information sent by the external device.

[0148] Here, the desktop cloud client sets an input subsystem for managing the connected external device, since the input subsystem does not directly receive the first information sent by the virtual machine, in order to enable the input subsystem to accurately identify the source of the event information, after the desktop cloud client receives the first information, the desktop cloud client performs legitimacy verification and marking on the first information, and transmits the marked first information to the input subsystem; the input subsystem distinguishes the source of the event information based on whether the event information is marked, if the event information does not exist the mark, the event information is transparently transmitted to the virtual machine, if the event information exists the mark, the event information is transmitted to a user interface (UI) component of the desktop cloud client for processing, and will not be transparently transmitted to the virtual machine, so as to avoid forming a loop in event information transmission.

[0149] Here, after the user interface component of the desktop cloud client receives the first information, the first information is processed, so that the user can use the external device to operate the client component to perform tasks such as exiting the virtual machine access and locking the screen.

[0150] It can be understood that, based on the information processing method of the desktop cloud system of the above-mentioned embodiments of the present application, as shown in Figure 6 In the mapping control scenario, the desktop cloud system can execute the client operation task and display the corresponding visual image based on the event information generated by the external device operation.

[0151] In an application example of the present application, an information processing method of a desktop cloud system is provided, as shown in Figure 7 The method comprises:

[0152] Step 701, the desktop cloud client receives event information sent by an external device, the event information representing an operation of the external device.

[0153] Here, the external device can be a keyboard and mouse, and the event information can be keyboard and mouse key event information.

[0154] Here, the input subsystem of the desktop cloud client receives the event information based on the interface of the external device.

[0155] Here, before step 701 is performed, the desktop cloud client has established an access relationship with the virtual machine.

[0156] Step 702, the input subsystem of the desktop cloud client judges whether the received event information exists a mark.

[0157] Step 703, the input subsystem determines that the received event information does not exist a mark, and transmits the event information to the virtual machine.

[0158] Here, after the desktop cloud client and the virtual machine have established an access relationship, the external device is directly mapped to the virtual machine based on the USB mapping channel, and the desktop cloud client does not process the event information sent by the external device, but directly transmits it to the virtual machine.

[0159] Step 704, the virtual machine parses the event information and identifies whether the current operation indicates operating the client component.

[0160] Here, the Agent component of the virtual machine captures the event information sent by the external device in real time through the function provided by the API interface.

[0161] Here, the method of identifying whether the current operation indicates operating the client component includes identifying the current operation position and based on the received instruction sent by the desktop cloud client.

[0162] Step 705, the virtual machine processes the event information.

[0163] Here, the virtual desktop running on the virtual machine includes multiple application programs, after the external device is mapped to the virtual machine, the user can use the external device to operate the application programs on the virtual desktop to provide business services, and if the virtual machine determines that the current operation does not indicate operating the client component, the corresponding task is executed based on the event information.

[0164] Here, the virtual desktop running on the virtual machine can support the installation of the driver of the non-standard USB protocol of the external device to realize the normal use of the customized function.

[0165] Step 706, the virtual machine sends the event information to the desktop cloud client.

[0166] Here, if the virtual machine determines that the current operation indicates operating the client component, the event information is returned to the desktop cloud client based on the USB mapping channel.

[0167] Here, the information returned to the desktop cloud client based on the USB mapping channel includes the current operation position synchronized with the event information, in addition to the event information.

[0168] Step 707, the desktop cloud client marks the received event information.

[0169] Here, the desktop cloud client marks the event information sent by the virtual machine after the legality verification, and sends the marked event information to the input subsystem.

[0170] Step 708, the input subsystem of the desktop cloud client judges whether the received event information exists a mark.

[0171] Step 709, the input subsystem determines that the received event information exists a mark, and transmits the event information to a user interface component of the desktop cloud client.

[0172] Here, the input subsystem determines the source of the event information based on whether the received event information exists a mark, and determines that the event information comes from the virtual machine, and needs to be processed, and transmits the event information to the processing user interface component.

[0173] Step 710, the user interface component processes the event information.

[0174] Here, the user interface component processes the event information, so that the user can operate the client component using the external device.

[0175] In order to implement the method of the embodiments of the present application, the embodiments of the present application also provide an information processing device of a desktop cloud system, which corresponds to the above-mentioned information processing method, and each step in the above-mentioned information processing method is fully applicable to the device embodiment.

[0176] As shown in Figure 8 The information processing device of the desktop cloud system applied to the virtual machine in the embodiments of the present application comprises: an identification module 801 and a first sending module 802. The identification module 801 is used to, in the case that the external device has been mapped to the virtual machine, respond to event information representing operation of the external device, and identify whether the current operation indicates operation of a client component of a desktop cloud client accessed by the operation. The first sending module 802 is used to, if it is determined that the current operation indicates operation of the client component, send first information to the desktop cloud client based on the event information of the current operation. The desktop cloud client is connected to the external device. The first information is used to instruct the desktop cloud client to render a visual image and / or execute a client operation task.

[0177] In some embodiments, the identification module 801 is specifically used to: respond to the event information, determine a current operation position in the virtual desktop, if the operation position falls within a first target position interval, determine that the current operation indicates operation of the client component of the desktop cloud client accessed by the operation, and if the operation position does not fall within the first target position interval, determine that the current operation does not indicate operation of the client component of the desktop cloud client accessed by the operation. The first target position interval is a position interval corresponding to the client component on the virtual desktop.

[0178] In some embodiments, the information processing device of the desktop cloud system applied to the virtual machine further comprises a first receiving module 803, which is used to: receive a first instruction or a second instruction sent by the desktop cloud client. The first instruction instructs to stop executing the virtual desktop operation task, and the second instruction instructs to resume executing the virtual desktop operation task.

[0179] In some embodiments, the identification module 801 is specifically configured to: based on the received instruction, determine, after stopping the current execution of the virtual desktop operation task, in response to the event information, that the current operation indicates operation access to the client component of the desktop cloud client.

[0180] In some embodiments, the first receiving module 803 is further configured to: in a scenario where the external device has been mapped to the virtual machine, receive the event information based on a mapping channel between the desktop cloud client.

[0181] In some embodiments, the received event information is second information sent by the external device, and the second information is transmitted to the virtual machine through the desktop cloud client.

[0182] In some embodiments, the information processing apparatus of the desktop cloud system applied to the virtual machine further comprises a first execution module 804, which is configured to: based on the event information, control the virtual desktop to execute a virtual desktop operation task.

[0183] In some embodiments, the first sending module 802 is specifically configured to: based on the event information of the current operation and the current operation position, generate first information; and based on a mapping channel between the desktop cloud client, send the first information to the desktop cloud client.

[0184] As shown in Figure 9 The information processing apparatus of the desktop cloud system applied to the desktop cloud client in the embodiments of the present application comprises: a first receiving module 901 and a first execution module 902. The first receiving module 901 is configured to, in a scenario where the external device has been mapped to the accessed virtual machine, receive event information representing operation of the external device; and the first execution module 902 is configured to, if it is determined that the received event information is first information sent by the accessed virtual machine, render a visual image and / or execute a client operation task based on the first information; wherein the desktop cloud client is connected to the external device, and the virtual machine runs a virtual desktop.

[0185] In some embodiments, the first execution module 902 is specifically configured to: based on the current operation position carried by the first information, determine a rendering position; based on the event information carried by the first information, render a visual image at the rendering position; and / or, based on the current operation position carried by the first information, determine a corresponding target client operation task; and if the event information carried by the first information indicates execution of a task, execute the target client operation task.

[0186] In some embodiments, the information processing apparatus of the desktop cloud system applied to the desktop cloud client further comprises a second sending module 903, configured to: based on the first information, determine that the current operation position falls into a second target position interval, and the event information of the current operation indicates that the first target task is executed, send a first instruction to the virtual machine; the first instruction indicates to stop executing the virtual desktop operation task; after sending the first instruction, based on the first information, determine that the current operation position falls into a third target position interval, and the event information of the current operation indicates that the second target task is executed, send a second instruction to the virtual machine; the second instruction indicates to resume executing the virtual desktop operation task; wherein the second target position interval and the third target position interval are determined based on the position interval of the current client component.

[0187] In some embodiments, the first receiving module 901 is specifically configured to: in a scenario where the external device has been mapped to the accessed virtual machine, based on a mapping channel between the virtual machine, receive the first information sent by the virtual machine; and based on a connection interface of the external device, receive the second information sent by the external device.

[0188] In some embodiments, the second sending module 903 is specifically configured to: in a scenario where the external device has been mapped to the accessed virtual machine, forward the received second information to the virtual machine based on the mapping channel between the virtual machine. It should be noted that the information processing apparatus provided in the above embodiments is only used as an example for the division of the above program modules during information processing. In actual applications, the above processing can be completed by different program modules according to needs, that is, the internal structure of the apparatus is divided into different program modules to complete all or part of the above processing. In addition, the information processing apparatus and the information processing method provided in the above embodiments belong to the same concept, and the specific implementation process is described in the method embodiments, which will not be repeated here.

[0189] Based on the hardware implementation of the above program modules, and in order to implement the method of the embodiments of the present application, the embodiments of the present application further provide a desktop cloud system, comprising a virtual machine and a desktop cloud client, wherein the virtual machine runs on a server, the virtual machine runs a virtual desktop, the desktop cloud client connects an external device, and the desktop cloud client and the virtual machine support establishing an access relationship.

[0190] As Figure 10As shown, the server 1000 for running the virtual machine of the desktop cloud system provided by the embodiments of the present application comprises at least one processor 1001, a memory 1002, a user interface 1003 and at least one network interface 1004. The various components in the server 1000 are coupled together by a bus system 1005. It can be understood that the bus system 1005 is used to realize the connection communication between the components. The bus system 1005 includes, in addition to the data bus, the power bus, the control bus and the status signal bus. However, for the purpose of clear illustration, all the buses are marked as the bus system 1005 in the Figure 10

[0191] The user interface 1003 can include a display, a keyboard, a mouse, a trackball, a click wheel, a key, a button, a touchpad or a touch screen, etc.

[0192] The memory 1002 in the embodiments of the present application is used to store various types of data to support the operation of the server 1000. Examples of the data include any computer program for operating on the server 1000.

[0193] The information processing method applied to the virtual machine disclosed by the embodiments of the present application can be applied in the processor 1001 or implemented by the processor 1001. The processor 1001 can be an integrated circuit chip with the processing capability of signals. In the implementation process, the steps of the information processing method can be completed by the integrated logic circuits or the instructions in the software form of the hardware in the processor 1001. The processor 1001 mentioned above can be a general processor, a digital signal processor (DSP), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 1001 can realize or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general processor can be a microprocessor or any conventional processor, etc. In combination with the steps of the method disclosed in the embodiments of the present application, the hardware decoding processor can be directly embodied to execute the steps, or the hardware and software modules in the decoding processor are combined to execute the steps. The software module can be located in the storage medium, which is located in the memory 1002. The processor 1001 reads the information in the memory 1002 and combines the hardware to complete the steps of the information processing method applied to the virtual machine provided by the embodiments of the present application.

[0194] ​In an exemplary embodiment, the server 1000 can be implemented by one or more Application Specific Integrated Circuits (ASICs), DSPs, Programmable Logic Devices (PLDs), Complex Programmable Logic Devices (CPLDs), FPGAs, general-purpose processors, controllers, microcontrollers (MCUs), microprocessors (Microprocessors), or other electronic elements for performing the aforementioned information processing method.

[0195] It can be appreciated that the memory 1002 can be volatile memory or nonvolatile memory, or both. Access to memory 1002 by other components of the computing device 1000 is, in one embodiment, controlled by memory controller 1004. In one embodiment, the nonvolatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable programmable ROM (EPROM), EEPROM, magnetic random access memory (FRAM), flash memory, magnetic surface storage, optical disk, or compact disk read-only memory (CD-ROM). The magnetic surface storage can be magnetic disk storage or magnetic tape storage. The volatile memory can be random access memory (RAM), which can be used as external cache. By way of example and not limitation, many forms of RAM can be used, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), SyncLink DRAM (SLDRAM), and direct Rambus RAM (DRRAM). The memory 1002 described herein is intended to include, without being limited to, these and any other suitable types of memory.

[0196] As Figure 11As shown, the desktop cloud client 1100 provided by the embodiments of the present application includes at least one processor 1101, a memory 1102, a user interface 1103, and at least one network interface 1104. The various components in the desktop cloud client 1100 are coupled together by a bus system 1105. It can be understood that the bus system 1105 is used to realize the connection communication between the components. The bus system 1105 includes, in addition to a data bus, a power supply bus, a control bus, and a status signal bus. However, for the purpose of clear illustration, all the buses are marked as the bus system 1105 in the following description. Figure 11

[0197] The user interface 1103 can include a display, a keyboard, a mouse, a trackball, a click wheel, a key, a button, a touchpad, or a touch screen, etc.

[0198] The memory 1102 in the embodiments of the present application is used to store various types of data to support the operation of the desktop cloud client 1100. Examples of the data include any computer program used to operate on the desktop cloud client 1100.

[0199] The information processing method applied to the desktop cloud client disclosed by the embodiments of the present application can be applied in the processor 1101 or implemented by the processor 1101. The processor 1101 can be an integrated circuit chip with a signal processing capability. In the implementation process, the steps of the information processing method can be completed by the integrated logic circuits or the instructions in the form of software in the processor 1101. The processor 1101 described above can be a general-purpose processor, a DSP, or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, etc. The processor 1101 can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor can be a microprocessor or any conventional processor, etc. In combination with the steps of the method disclosed in the embodiments of the present application, the steps can be directly embodied as a hardware coding processor to execute, or a combination of hardware and software modules in the coding processor to execute. The software module can be located in a storage medium, and the storage medium is located in the memory 1102. The processor 1101 reads the information in the memory 1102 and combines the hardware to complete the steps of the information processing method applied to the desktop cloud client provided by the embodiments of the present application.

[0200] In the exemplary embodiments, the desktop cloud client 1100 can be implemented by one or more ASICs, DSPs, PLDs, CPLDs, FPGAs, general-purpose processors, controllers, MCUs, microprocessors, or other electronic elements, to execute the foregoing information processing method.

[0201] ​It can be understood that the memory 1102 can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be ROM, PROM, EPROM, EEPROM, FRAM, Flash Memory, magnetic surface memory, optical disc, or read-only optical disc; the magnetic surface memory can be disk memory or tape memory. The volatile memory can be RAM used as an external cache. By way of example but not limitation, many forms of RAM can be used, such as SRAM, SSRAM, DRAM, SDRAM, DDRSDRAM, ESDRAM, SLDRAM, DRRAM. The memory 1102 described in the embodiments of the present application is intended to include but not limited to these and any other suitable types of memory.

[0202] In an exemplary embodiment, the embodiments of the present application also provide a storage medium, specifically a computer storage medium, for example, a computer readable storage medium, such as the memory 1002, 1102 storing the computer program executable by the processor 1001 of the server 1000 and the processor 1101 of the desktop cloud client 1100 to complete the steps of the information processing method described in the embodiments of the present application. The computer readable storage medium can be ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface memory, optical disc, or CD-ROM and the like.

[0203] In an exemplary embodiment, the embodiments of the present application also provide a computer program product comprising a computer program executable by the processor 1001 of the server 1000 and the processor 1101 of the desktop cloud client 1100 to complete the steps of the method described in the embodiments of the present application.

[0204] It should be noted that "first", "second", and the like are used to distinguish similar objects, and do not necessarily describe a specific order or sequence.

[0205] In addition, the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.

[0206] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. An information processing method for a desktop cloud system, characterized in that: Applied to a virtual machine running a virtual desktop, the method includes: In a scenario where an external device has been mapped to the virtual machine, in response to event information representing an operation of the external device, identifying whether the operation indicates an operation of a client component of the desktop cloud client to be accessed; If it is determined that the current operation indicates an operation of the client component, sending a first message to the desktop cloud client based on the event information of the current operation; The desktop cloud client is connected to an external device; and the first information is used to instruct the desktop cloud client to render a visual image and / or perform a client operation task.

2. The method according to claim 1, characterized in that The step of identifying, in response to event information representing an operation of an external device, whether the operation indicates an operation of a client component of the desktop cloud client to be accessed includes: In response to the event information, determining a current operation position in the virtual desktop; If the operation position falls within the first target position interval, determining the client component of the desktop cloud client to which the operation instruction is to be accessed; If the operation position does not fall within the first target position interval, determining that the current operation does not indicate an operation of a client component of the desktop cloud client to be accessed; The first target location interval is a location interval corresponding to the client component on the virtual desktop.

3. The method according to claim 1, characterized in that The method further comprises: receiving a first instruction or a second instruction sent by the desktop cloud client; wherein the first instruction instructs to stop executing the virtual desktop operation task, and the second instruction instructs to resume executing the virtual desktop operation task; The step of identifying, in response to event information representing an operation of an external device, whether the operation indicates an operation of a client component of the desktop cloud client to be accessed includes: After determining that the current virtual desktop operation task is stopped based on the received instruction, the client component of the desktop cloud client accessed by the current operation instruction is determined in response to the event information.

4. The method according to claim 1, wherein The method comprises: In a scenario where the external device has been mapped to the virtual machine, receiving the event information based on a mapping channel with the desktop cloud client; Based on the event information, controlling the virtual desktop to perform a virtual desktop operation task; The received event information is second information sent by the external device, and the second information is transparently transmitted to the virtual machine via the desktop cloud client.

5. The method according to claim 4, characterized in that The sending of the first information to the desktop cloud client based on the event information of the current operation includes: Generate first information based on event information of this operation and current operation position; Based on the mapping channel between the desktop cloud client and the desktop cloud client, the first information is sent to the desktop cloud client.

6. The method according to any one of claims 1 to 5, characterized in that The external device includes at least one of the following: a keyboard, a mouse and a trackball; the event information includes at least one of the following: keyboard key event information, mouse movement event information, mouse key event information, mouse wheel event information, trackball scroll event information and trackball key event information.

7. An information processing method for a desktop cloud system, characterized in that: Applied to a desktop cloud client, the desktop cloud client running a client component, the method includes: In a scenario where the external device has been mapped to the accessed virtual machine, receiving event information representing an operation of the external device; If it is determined that the received event information is the first information sent by the virtual machine, rendering a visual image and / or executing a client operation task based on the first information; The desktop cloud client is connected to an external device; and a virtual desktop is run on the virtual machine.

8. The method according to claim 7, characterized in that The first information includes event information of the current operation and the current operation location; and the rendering of a visual image and / or performing a client operation task based on the first information includes: determining a rendering position based on the current operation position carried in the first information; Rendering a visual image at the rendering position based on the event information carried by the first information; and / or, Determining a corresponding target client operation task based on the current operation location carried in the first information; If the event information carried in the first information indicates to execute a task, the target client operation task is executed.

9. The method according to claim 8, characterized in that The method further comprises: Based on the first information, it is determined that the current operation position falls within the second target position interval, and the event information of the current operation indicates the execution of the first target task, and then a first instruction is sent to the virtual machine; the first instruction instructs to stop executing the virtual desktop operation task; After sending the first instruction, based on the first information, it is determined that the current operation position falls within a third target position interval, and the event information of the current operation indicates execution of a second target task, then sending a second instruction to the virtual machine; the second instruction instructs to resume execution of the virtual desktop operation task; The second target location interval and the third target location interval are determined based on the current location interval of the client component.

10. The method according to claim 7, characterized in that The receiving of event information representing an operation of the external device in a scenario where the external device has been mapped to the accessed virtual machine includes: In a scenario where an external device has been mapped to an accessed virtual machine, receiving first information sent by the virtual machine based on a mapping channel between the virtual machine and the external device; and receiving second information sent by the external device based on a connection interface with the external device; The method further comprises: In a scenario where the external device has been mapped to the accessed virtual machine, the received second information is forwarded to the virtual machine based on the mapping channel between the external device and the virtual machine.

11. The method according to any one of claims 7 to 10, characterized in that The external device includes at least one of the following: a keyboard, a mouse and a trackball; the event information includes at least one of the following: keyboard key event information, mouse movement event information, mouse key event information, mouse wheel event information, trackball scroll event information and trackball key event information.

12. An information processing device for a desktop cloud system, characterized in that: Applied to a virtual machine running a virtual desktop, the information processing device includes: an identification module for, in a scenario where an external device has been mapped to the virtual machine, identifying, in response to event information representing an operation of the external device, whether the current operation indicates an operation of a client component of the desktop cloud client to be accessed; A first sending module, if it is determined that the current operation indicates an operation of the client component, sends first information to the desktop cloud client based on event information of the current operation; The desktop cloud client is connected to an external device; and the first information is used to instruct the desktop cloud client to render a visual image and / or perform a client operation task.

13. An information processing device for a desktop cloud system, characterized in that: Applied to a desktop cloud client, the desktop cloud client runs a client component, and the information processing device includes: A first receiving module is configured to receive event information representing an operation of the external device in a scenario where the external device has been mapped to the accessed virtual machine; A first execution module, configured to render a visual image and / or execute a client operation task based on the first information if it is determined that the received event information is first information sent by the accessed virtual machine; The desktop cloud client is connected to an external device; and a virtual desktop is run on the virtual machine.

14. A server, characterized in that: The server is used to run a virtual machine of a desktop cloud system, and a virtual desktop is run on the virtual machine. The server includes: a processor and a memory for storing a computer program that can be run on the processor. When the processor is used to run the computer program, it is used to execute the steps of the method according to any one of claims 1 to 6.

15. A desktop cloud client, characterized in that: The desktop cloud client is connected to an external device and includes: a processor and a memory for storing a computer program that can be run on the processor. When the processor is used to run the computer program, the steps of the method according to any one of claims 7 to 11 are executed.

16. A storage medium, characterized in that The storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented.

17. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the computer program implements the steps of the method according to any one of claims 1 to 11.

Images