Mouse control methods, cloud computer terminal device, cloud computer server, readable medium and computer program product

Abstract

Provided in the present disclosure is a mouse control method, which is applied to a cloud computer terminal device, wherein the cloud computer terminal device comprises a first display screen. The method comprises: determining the movement condition of a mouse cursor of the cloud computer terminal device between the first display screen and a second display screen of a handwriting display device, wherein the handwriting display device has been redirected to a cloud computer desktop by a cloud computer server corresponding to the cloud computer terminal device; and on the basis of the movement condition of the mouse cursor between the first display screen and the second display screen, switching a mouse of the cloud computer terminal device between a client mouse mode and a server mouse mode. Further provided in the present disclosure are a mouse control method applied to a cloud computer server, and a cloud computer terminal device, a cloud computer server, a computer-readable storage medium and a computer program product.

Description

Mouse control method, cloud computer terminal device, cloud computer server, readable medium and computer program product

[0001] Cross-reference to related applications

[0002] The present disclosure claims priority to Chinese Patent Application No. 202410832365.4, filed on June 25, 2024, the contents of which are incorporated herein by reference in their entirety. TECHNICAL FIELD

[0003] The present disclosure relates to the technical field of cloud desktop, and particularly relates to a mouse control method, a cloud computer terminal device, a cloud computer server, a computer readable storage medium and a computer program product. BACKGROUND

[0004] At present, the cloud computer mouse mode includes a client mouse mode and a server mouse mode. In the client mouse mode, the cloud computer terminal device sends the mouse position to the cloud computer server. However, in the scenario of a handwriting display device, the handwriting display device has been redirected to the cloud computer desktop, and the mouse cursor cannot be moved out of the desktop screen of the cloud computer server. Therefore, the mouse cursor cannot be moved to the handwriting display device, and the mouse operation cannot be performed on the handwriting display device. In the server mouse mode, the cloud computer terminal device sends the relative displacement of the mouse to the cloud computer server. This method is feasible in the scenario of the handwriting display device, and the mouse operation can be performed on the handwriting display device. However, the operation of the cloud computer desktop is not smooth using the server mouse mode, the toolbar outside the cloud computer window cannot be operated, and the user needs to manually switch the current mouse mode to the server mouse mode, which is inconvenient to use. Therefore, it is urgent to improve.

[0005] DISCLOSURE

[0006] The present disclosure provides a mouse control method, a cloud computer terminal device, a cloud computer server, a computer readable storage medium and a computer program product.

[0007] In a first aspect, the present disclosure provides a mouse control method applied to a cloud computer terminal device, wherein the cloud computer terminal device includes a first display screen. The method includes determining the movement of a mouse cursor of the cloud computer terminal device between the first display screen and a second display screen of a handwriting display device, wherein the handwriting display device has been redirected to a cloud computer desktop by a cloud computer server corresponding to the cloud computer terminal device; and switching the mouse of the cloud computer terminal device between a client mouse mode and a server mouse mode according to the movement of the mouse cursor between the first display screen and the second display screen.

[0008] In a second aspect, the present disclosure provides a mouse control method, applied to a cloud computer server, and the method comprises: activating a handwriting display device in a case where the handwriting display device is redirected to a cloud computer desktop; and sending second attribute information of a second display screen of the handwriting display device to a cloud computer terminal device corresponding to the cloud computer server.

[0009] In a third aspect, the present disclosure provides a cloud computer terminal device, comprising a memory and a processor, wherein the memory stores a computer program executable by the processor, and the computer program is executed by the processor to enable the processor to implement the mouse control method as described above.

[0010] In a fourth aspect, the present disclosure provides a cloud computer server, comprising a memory and a processor, wherein the memory stores a computer program executable by the processor, and the computer program is executed by the processor to enable the processor to implement the mouse control method as described above.

[0011] In a fifth aspect, the present disclosure provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to enable the processor to implement the mouse control method as described above.

[0012] In a sixth aspect, the present disclosure provides a computer program product, comprising a computer program, and the computer program is executed by a processor to enable the processor to implement the mouse control method as described above. BRIEF DESCRIPTION OF DRAWINGS

[0013] In the drawings of the present disclosure:

[0014] FIG. 1 is a system architecture diagram of a mouse control method provided by the present disclosure;

[0015] FIG. 2 is a flowchart of a mouse control method provided by the present disclosure, taking a cloud computer terminal device as an execution subject;

[0016] FIG. 3 is a schematic diagram of display screens of a cloud computer provided by the present disclosure;

[0017] FIG. 4 is a schematic diagram of a positional relationship of a second display screen relative to a first display screen provided by the present disclosure;

[0018] FIG. 5 is a flowchart of determining a moving condition of a mouse cursor between a first display screen and a second display screen provided by the present disclosure;

[0019] FIG. 6 is a flowchart of a mouse control method provided by the present disclosure, taking a cloud computer server as an execution subject;

[0020] Fig. 7 is a flow diagram illustrating a mouse operation using a handwriting screen in a cloud computer according to an example of the present disclosure;

[0021] Fig. 8 is a block diagram illustrating a cloud computer terminal device and a cloud computer server according to an example of the present disclosure. DETAILED DESCRIPTION

[0022] For those skilled in the art to better understand the technical solutions of the present disclosure, the embodiments of the present disclosure will be described in detail below with reference to the drawings.

[0023] The present disclosure will be described more fully hereinafter with reference to the accompanying drawings, in which example embodiments are shown. The present disclosure may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the present disclosure to those skilled in the art.

[0024] The accompanying drawings, which are included to provide a further understanding of the embodiments of the present disclosure and constitute a part of the specification, illustrate the embodiments of the present disclosure and together with the detailed description serve to explain the present disclosure. The above and other features and advantages of the present disclosure will become more apparent from the following detailed description, taken in conjunction with the accompanying drawings.

[0025] The present disclosure can be described with reference to plan views and / or sectional views by ideal schematic views of the present disclosure. Thus, the example illustrations can be modified according to manufacturing techniques and / or tolerances.

[0026] The embodiments of the present disclosure and the features thereof can be combined with each other in the case of no conflict.

[0027] The terms used in the present disclosure are merely used to describe specific embodiments and should not limit the present disclosure. As used in the present disclosure, the term "and / or" includes any and all combinations of one or more associated listed items. As used in the present disclosure, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. As used in the present disclosure, the terms "comprises," "comprising," "includes," "including," and the like are intended to specify the presence of stated features, integers, steps, operations, elements, components, and / or groups thereof, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0028] Unless otherwise defined, all terms used in the present disclosure, including technical terms and scientific terms, have the same meanings as those generally understood by those skilled in the art. It will also be understood that terms such as those defined in a generally used dictionary should be interpreted as having a meaning that is consistent with its meaning in the context of the relevant art and the present disclosure, and should not be interpreted in an idealized or overly formal sense, unless expressly so defined in the present disclosure.

[0029] The present disclosure is not limited to the embodiments and implementations shown in the drawings, but includes modifications of configurations formed based on manufacturing processes. Therefore, the regions illustrated in the drawings have a schematic property, and the shape of the regions shown in the drawings exemplifies a specific shape of a region of an element, but is not restrictive.

[0030] In some related technologies, the current industry cloud computer mouse mode mainly includes a client mouse mode and a server mouse mode. In the client mouse mode, the mouse is a mouse of a cloud computer terminal device, the cloud computer client sends an absolute position and a click event of the mouse to a cloud computer server, the cloud computer server moves a mouse of the cloud computer server to a specified position, and the cloud computer server notifies the cloud computer terminal device of the specified position. In the client mouse mode, the mouse response time is fast, the user experience is good, and the cloud computer terminal device displays a mouse cursor. In the server mouse mode, a local mouse cursor of the cloud computer terminal device is hidden, the cloud computer terminal device obtains a relative displacement of the mouse and sends the relative displacement to the cloud computer server, and the cloud computer server moves a mouse cursor in a cloud computer desktop according to the relative displacement. In the server mouse mode, the position is accurate, but the mouse cursor movement followability is poor, and the mouse operation can only be performed in the cloud computer window. In addition, the cloud computer terminal device control interface cannot be operated without additional means, and the user experience is poor. Therefore, the mainstream cloud computer mouse mode in the cloud computer desktop scenario is still the client mouse mode.

[0031] In the use scenario of redirecting a handwriting display device to a cloud computer desktop, the client mouse mode cannot be used because the mouse cursor cannot move out of the current cloud computer desktop screen in the client mouse mode, and the mouse cursor position is always in the current screen. Therefore, the client mouse mode cannot move the mouse cursor to the handwriting display device, and cannot perform related mouse operations in the handwriting display device. In the server mouse mode, the relative displacement of the client mouse is obtained, so that the mouse cursor in the cloud computer desktop can be moved by the relative displacement. The mouse cursor can be moved into the handwriting display device, and the mouse operation can be performed on the handwriting display device. However, if the server mouse mode is used, the user needs to manually switch the current mouse mode to the server mouse mode. In the handwriting display device scenario, always using the server mouse mode will reduce the operation experience of the user using the cloud computer.

[0032] To solve the above technical problems, an embodiment of the present disclosure provides a mouse control method. FIG. 1 is a system architecture diagram of the mouse control method provided by the embodiment of the present disclosure. As shown in FIG. 1, the system includes a cloud computer terminal device, a cloud computer server, and a handwriting display device. The cloud computer terminal device includes a cloud computer client, the cloud computer server includes a cloud computer server, the cloud computer server includes a cloud computer protocol component and a cloud computer desktop component, and the cloud computer client and the cloud computer server are not shown in FIG. 1.

[0033] The cloud PC client includes a handwriting display device information processing module, a mouse information capture and mode switching module, and a terminal peripheral management module. The terminal peripheral management module is configured to recognize the access of the handwriting display device and redirect it to the cloud PC desktop. The handwriting display device information processing module is configured to receive and store the display screen information of the handwriting display device sent by the cloud PC server, and, when the handwriting display device is activated, obtain its position and size, and, when the handwriting display device is removed, return the mouse cursor to the display screen position of the cloud PC terminal device. The mouse information capture and mode switching module is configured to obtain the mouse cursor position and relative displacement of the cloud PC device and send it to the cloud PC protocol component on the cloud PC server, and automatically switch the mouse mode based on the mouse cursor position.

[0034] The cloud computer protocol component includes a mouse position receiving module and a mouse position returning module. The mouse position receiving module is configured to receive the mouse cursor position or relative displacement sent by the mouse information capture and mode switching module of the cloud computer terminal device, convert the relative displacement into the mouse cursor position, and then send the mouse cursor position to the handwriting display device and mouse position processing module in the cloud computer desktop component. The mouse position returning module is configured to send the current mouse cursor position on the desktop to the mouse information capture and mode switching module of the cloud computer terminal in the client mouse mode (it does not return when the mouse cursor is in the handwriting display device).

[0035] The cloud computer desktop component includes a handwriting display device and mouse position processing module and a redirection module. The redirection module is configured to work with the terminal peripheral management module to complete the redirection operation of the handwriting display device. The handwriting display device and mouse position processing module is configured to activate or remove the handwriting display device, return the display screen information of the redirected handwriting display device to the handwriting display device information processing module in the cloud computer client, and convert and set the mouse cursor position transmitted from the mouse position receiving module in the cloud computer protocol component to the operating system to complete the mouse operation function.

[0036] As shown in Figures 1 and 2, the mouse control method provided in this embodiment is applied to a cloud computer terminal device, which includes a first display screen. The mouse control method includes the following steps: S11 and S12.

[0037] Step S11: Determine the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device; the handwriting display device has been redirected to the cloud computer desktop by the cloud computer server corresponding to the cloud computer terminal device.

[0038] In the embodiment of the present disclosure, the first display screen is a main screen, and the second display screen is a handwriting screen (i.e., the display screen of the handwriting display device). It should be noted that, before step S11, the handwriting display device has been redirected to the cloud computer desktop by the cloud computer server corresponding to the cloud computer terminal device, that is, the handwriting display device has been activated.

[0039] The moving condition of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device includes that the mouse cursor of the cloud computer terminal device moves from the first display screen to the second display screen, that is, the mouse cursor moves from the main screen to the handwriting screen, or the mouse cursor of the cloud computer terminal device moves from the second display screen to the first display screen, that is, the mouse cursor moves from the handwriting screen to the main screen. In this step, the mouse information capturing and mode switching module of the cloud computer terminal device determines whether the mouse cursor of the cloud computer terminal device currently moves from the main screen to the handwriting screen or moves from the handwriting screen to the main screen.

[0040] In step S12, the mouse of the cloud computer terminal device is switched between the client mouse mode and the server mouse mode according to the moving condition of the mouse cursor between the first display screen and the second display screen.

[0041] In this step, the mouse information capturing and mode switching module of the cloud computer terminal device can switch the mouse of the cloud computer terminal device from the client mouse mode to the server mouse mode, or from the server mouse mode to the client mouse mode according to whether the mouse cursor of the cloud computer terminal device currently moves from the main screen to the handwriting screen or moves from the handwriting screen to the main screen.

[0042] The mouse control method provided by the embodiment of the present disclosure is applied to a cloud computer terminal device, the cloud computer terminal device includes a first display screen, and the method includes: determining a moving condition of a mouse cursor of the cloud computer terminal device between the first display screen and a second display screen of a handwriting display device; the handwriting display device has been redirected to a cloud computer desktop by a cloud computer server corresponding to the cloud computer terminal device; and switching a mouse of the cloud computer terminal device between a client mouse mode and a server mouse mode according to the moving condition of the mouse cursor between the first display screen and the second display screen. According to the embodiment of the present disclosure, the mouse mode of the cloud computer desktop can be automatically switched between the client mouse mode and the server mouse mode according to the moving condition of the mouse cursor of the cloud computer terminal device, without the intervention of a user. The mouse can be used for operation on the external handwriting display device on the premise of ensuring the fluency of the cloud computer desktop, and the use is more convenient.

[0043] FIG. 3 is a schematic diagram of the displays of the cloud computer according to an embodiment of the present disclosure. As shown in FIG. 3, the main display of the cloud computer terminal is the first display, i.e., the display connected by the mouse in FIG. 3. The display of the handwriting display device is the second display, which is located on one side of the first display. The cloud computer server is remote from the first display and the second display.

[0044] In some embodiments, the switching of the mouse of the cloud computer terminal device between the client-side mouse mode and the server-side mouse mode according to the movement of the mouse cursor between the first display and the second display (i.e., step S12) comprises the following steps: in the case that the mouse of the cloud computer terminal device is in the client-side mouse mode and the mouse cursor moves from the first display to the second display, switching the mouse of the cloud computer terminal device from the client-side mouse mode to the server-side mouse mode; in the case that the mouse cursor moves from the second display to the first display, switching the mouse of the cloud computer terminal device from the server-side mouse mode to the client-side mouse mode.

[0045] If the mouse cursor of the cloud computer terminal device moves from the handwriting screen to the main screen, it indicates that the mouse of the cloud computer terminal device is currently in the server-side mouse mode. The cloud computer desktop can be used in both the client-side mouse mode and the server-side mouse mode, and the fluency of the cloud computer desktop is better in the client-side mouse mode. Therefore, in order to ensure the fluency of the cloud computer desktop, the mouse of the cloud computer terminal device can be switched from the server-side mouse mode to the client-side mouse mode.

[0046] In some embodiments, after the mouse of the cloud computer terminal device is switched from the client-side mouse mode to the server-side mouse mode, the mouse control method can further comprise the following steps: hiding the mouse cursor of the cloud computer terminal device and displaying the mouse cursor of the cloud computer server.

[0047] After the mouse of the cloud computer terminal device is switched from the client-side mouse mode to the server-side mouse mode, the mouse cursor of the cloud computer terminal device is hidden because the mouse cursor of the cloud computer server is displayed on the second display (i.e., the handwriting screen) in the server-side mouse mode. Therefore, two mouse cursors are not displayed on the second display, which avoids confusion with the mouse cursor that is being operated.

[0048] In some embodiments, after the mouse of the cloud computer terminal device is switched from the server-side mouse mode to the client-side mouse mode, the mouse control method can further comprise the following steps: displaying the mouse cursor of the cloud computer terminal device. That is, after the mouse of the cloud computer terminal device is switched from the server-side mouse mode to the client-side mouse mode, the mouse cursor is normally displayed on the cloud computer terminal device, i.e., the mouse cursor of the cloud computer terminal device is displayed on the first display.

[0049] In some embodiments, before the step of determining the moving condition of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device (i.e., step S11), the mouse control method can further include the following step: step S11', receiving the second attribute information of the second display screen sent by the cloud computer server, the second attribute information being sent by the cloud computer server after the handwriting display device is redirected to the cloud computer desktop.

[0050] Correspondingly, the step of determining the moving condition of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device (i.e., step S11) includes the following step: determining the moving condition of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device according to the second attribute information and the first attribute information of the first display screen.

[0051] The handwriting display device information processing module of the cloud computer terminal device receives the second attribute information of the second display screen of the handwriting display device sent by the handwriting display device and mouse position processing module of the cloud computer server, and the mouse information capturing and mode switching module of the cloud computer terminal device determines the moving condition of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device according to the second attribute information and the first attribute information of the first display screen.

[0052] In some embodiments, the second attribute information includes the position of the second display screen relative to the first display screen and the second resolution of the second display screen.

[0053] The position of the second display screen relative to the first display screen can include the orientation of the second display screen to the first display screen, and the orientation can include up, down, left, and right. The first attribute information can include the first resolution of the first display screen.

[0054] FIG. 4 is a schematic diagram of the position relationship of the second display screen relative to the first display screen according to an embodiment of the present disclosure. As shown in FIG. 4, the position of the second display screen b relative to the first display screen a is that the second display screen b is located on the left side of the first display screen a, and the position of the second display screen b relative to the first display screen a can be represented by a preset value.

[0055] Correspondingly, in combination with FIGS. 4 and 5, the step of determining the moving condition of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device according to the second attribute information and the first attribute information of the first display screen includes the following steps: S111 to S113.

[0056] Step S111, determining the target boundary of the first display screen according to the position of the second display screen relative to the first display screen; the target boundary is the boundary adjacent to the second display screen.

[0057] In this step, the mouse information capturing and mode switching module of the cloud computer terminal device determines a target boundary of the first display screen adjacent to the second display screen.

[0058] In step S112, the cursor moving range of the target boundary is determined according to the position of the second display screen relative to the first display screen, the second resolution and the first resolution.

[0059] The cursor moving range of the target boundary refers to the common area range of the adjacent boundary of the first display screen and the second display screen, in which the mouse cursor can move between the first display screen and the second display screen.

[0060] In step S113, it is determined that the mouse cursor of the cloud computer terminal device moves from the first display screen to the second display screen, if the distance between the current position of the mouse cursor of the cloud computer terminal device and the target boundary of the first display screen is less than a preset threshold and the mouse cursor of the cloud computer terminal device is within the cursor moving range.

[0061] If the difference between the current position of the mouse cursor of the cloud computer terminal device and the target boundary of the first display screen is less than a preset threshold and the mouse cursor of the cloud computer terminal device is within the cursor moving range, it means that the mouse cursor is adjacent to the target boundary within the first display screen and is about to enter the second display screen, and it is determined that the mouse cursor of the cloud computer terminal device moves from the first display screen to the second display screen.

[0062] FIG. 4 is a schematic diagram of the position relationship of the second display screen relative to the first display screen according to an embodiment of the present disclosure. As shown in FIG. 4, the second display screen b is located on the left side of the first display screen a, and the target boundary of the first display screen a is a1. It is assumed that the first resolution of the first display screen a is m1*n1, the second resolution of the second display screen b is m2*n2, m1 is the maximum pixel of the x-axis direction of the first display screen a, n1 is the maximum pixel of the y-axis direction of the first display screen a, m2 is the maximum pixel of the x-axis direction of the second display screen b, and n2 is the maximum pixel of the y-axis direction of the second display screen b. The current position of the mouse cursor of the cloud computer terminal device is a position p in the first display screen, the position p is within the cursor moving range and the distance s between the position p and the target boundary a1 is less than a preset threshold, and it is considered that the mouse cursor of the cloud computer terminal device moves from the first display screen a to the second display screen b.

[0063] Through steps S111 to S113, it can be determined that the mouse cursor of the cloud computer terminal device moves from the main screen to the handwriting screen.

[0064] In some embodiments, the mouse control method can further include the following steps: in the case of receiving the handwriting display device removal notification sent by the cloud computer server, switching the mouse of the cloud computer terminal device from the server mouse mode to the client mouse mode. That is, once the handwriting display device is removed from the cloud computer terminal device, the cloud computer server triggers the cloud computer terminal device to switch the mouse of the cloud computer terminal device from the server mouse mode to the client mouse mode, so that the mouse can be operated on the first display screen of the cloud computer terminal device and the mouse cursor is displayed.

[0065] In some embodiments, the determination of the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device (i.e., step S11) includes the following steps: in the case of receiving the mouse cursor position information sent by the cloud computer server, determining that the mouse cursor of the cloud computer terminal device moves from the second display screen to the first display screen.

[0066] Since the mouse cursor is in the second display screen, the mouse of the cloud computer terminal is in the server mouse mode, and the cloud computer server will not send the mouse cursor position of the cloud computer server to the cloud computer terminal device. Once the mouse cursor of the cloud computer terminal device moves from the second display screen to the first display screen, the mouse information capture and mode switching module of the cloud computer terminal device receives the mouse position of the cloud computer server sent by the mouse position return module of the cloud computer server. Therefore, once the cloud computer terminal device receives the mouse cursor position information sent by the cloud computer server, it can be determined that the mouse cursor of the cloud computer terminal device moves from the second display screen to the first display screen.

[0067] The embodiments of the present disclosure also provide a mouse control method, which is applied to a cloud computer server. As shown in FIG. 6, the method includes the following steps: S21 and S22.

[0068] Step S21, in the case of redirecting the handwriting display device to the cloud computer desktop, activating the handwriting display device.

[0069] The cloud computer terminal device initiates the operation of connecting the cloud computer desktop, and after successfully connecting the cloud computer desktop, triggers the handwriting display device inserted into the cloud computer terminal device to be redirected to the cloud computer desktop. The redirection module of the cloud computer server recognizes the access of the handwriting display device and activates the handwriting display device.

[0070] Step S22, sending the second attribute information of the second display screen of the handwriting display device to the corresponding cloud computer terminal device of the cloud computer server.

[0071] The handwriting display device and the mouse position processing module send second attribute information of the second display screen of the handwriting display device, i.e., the position of the second display screen relative to the first display screen of the cloud computer terminal device and the second resolution of the second display screen, to the cloud computer terminal device, and the cloud computer terminal device records the second attribute information so as to determine the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen.

[0072] The mouse control method of the embodiment of the present disclosure is applied to a cloud computer server, in the case of redirecting the handwriting display device to the cloud computer desktop, the handwriting display device is activated, and the second attribute information of the second display screen of the handwriting display device is sent to the corresponding cloud computer terminal device of the cloud computer server, so that the cloud computer terminal device determines the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen according to the second attribute information, and switches the mouse of the cloud computer terminal device between the client mouse mode and the server mouse mode without the intervention of the user; the mouse is used for operation on the external handwriting display device under the premise of ensuring the fluency of the cloud computer desktop, and the use is more convenient.

[0073] In some embodiments, the mouse control method can further include the following steps: in the case of determining that the handwriting display device is removed from the cloud computer terminal device, sending a handwriting display device removal notification to the cloud computer terminal device, the handwriting display device removal notification being used to instruct the cloud computer terminal device to switch the mouse from the server mouse mode to the client mouse mode. In this step, if the handwriting display device is removed from the cloud computer terminal device, the handwriting device and mouse position processing module of the cloud computer server sends a handwriting display device removal notification to the handwriting display device information processing module of the cloud computer terminal device to inform the cloud computer terminal device that the handwriting display device has been removed from the cloud computer desktop. Correspondingly, the mouse information capturing and mode switching module of the cloud computer terminal device switches the mouse of the cloud computer terminal device from the server mouse mode to the client mouse mode after receiving the handwriting display device removal notification. Since the mouse cursor of the cloud computer terminal device cannot be displayed on the handwriting display device, the mouse cursor of the cloud computer terminal device is displayed in the first display screen in the case of moving the mouse cursor to the first display screen of the cloud computer terminal device.

[0074] To clearly illustrate the technical solutions of the embodiments of the present disclosure, the mouse control scheme of the embodiments of the present disclosure is described in detail below with reference to FIG. 7.

[0075] As shown in FIG. 7, the screen of the cloud terminal device is a main screen, and the process of using the handwriting screen for mouse operation in the cloud computer includes the following steps 1 to 6.

[0076] Step 1, after the handwriting screen is inserted into the cloud computer terminal device, the cloud computer terminal device initiates a cloud computer desktop connection operation.

[0077] Step 2, after the cloud computer desktop connection succeeds, the cloud computer server triggers the redirection of the handwriting screen device to the cloud computer desktop, and the cloud computer server identifies the handwriting screen access and activates the handwriting screen.

[0078] Step 3, the cloud computer server sends the position information of the handwriting screen relative to the main screen and the resolution information of the handwriting screen to the cloud computer terminal device, and the cloud computer terminal device stores the position information of the handwriting screen relative to the main screen and the resolution information of the handwriting screen.

[0079] Step 4, the user operates the cloud computer mouse, and when the mouse cursor reaches the edge of the current screen, the cloud computer terminal device determines whether the mouse cursor is moved from the handwriting screen to the main screen or from the main screen to the handwriting screen.

[0080] When the user needs to use the mouse to operate the handwriting screen, the mouse cursor needs to be moved from the main screen to the handwriting screen, and after the mouse operation on the handwriting screen is completed, the mouse cursor needs to be moved from the handwriting screen to the main screen. The following describes two cases according to the movement of the mouse cursor between the main screen and the handwriting screen.

[0081] In the case where the mouse cursor is moved from the main screen to the handwriting screen, the following steps 101 to 105 are performed.

[0082] Step 101, in the case where the mouse of the cloud computer terminal device is in the client mouse mode, switch from the client mouse mode to the server mouse mode.

[0083] The cloud computer terminal device calls an interface for switching to the server mouse mode, and switches the mouse of the cloud computer terminal device from the client mouse mode to the server mouse mode.

[0084] Step 102, the cloud computer terminal device sends a server mouse mode switching notification message to the cloud computer server to notify the cloud computer server to switch the mouse mode, and after the cloud computer server switches to the server mouse mode, returns a server mouse mode switching response message to the cloud computer terminal device.

[0085] Step 103, the cloud computer terminal device hides the mouse cursor of the cloud computer terminal device on the main screen and displays the mouse cursor of the cloud computer server.

[0086] The execution order of step 103 and step 102 is not limited.

[0087] Step 104, the cloud computer terminal device sends the relative displacement of the mouse movement in the handwriting screen to the cloud computer server.

[0088] In the server mouse mode, when the cloud computer terminal device judges that the mouse cursor moves on the handwriting screen, the relative displacement of the mouse is sent to the cloud computer server. The cloud computer server does not send the position of the mouse in the cloud computer desktop to the cloud computer terminal device.

[0089] In step 105, the cloud computer server converts the relative displacement of the mouse moving in the handwriting screen into the position coordinates of the mouse cursor, and sets the position coordinates of the mouse cursor to the cloud computer desktop operating system, so as to realize the mouse operation in the handwriting screen.

[0090] In the case that the mouse cursor moves from the handwriting screen to the main screen, the following steps 201 to 206 are executed.

[0091] In step 201, when the cloud computer terminal device receives the position coordinates of the mouse cursor in the cloud computer desktop sent by the cloud computer server, the mouse of the cloud computer terminal is switched from the client mouse mode to the server mouse mode.

[0092] When the mouse cursor moves from the handwriting screen to the main screen, the mouse mode before moving out of the handwriting screen is the server mouse mode, and the cloud computer terminal device does not receive the current position coordinates of the mouse cursor in the cloud computer desktop. When the mouse cursor moves out of the handwriting screen and enters the main screen, the cloud computer terminal device receives the current position coordinates of the mouse cursor in the cloud computer desktop sent by the cloud computer server, which indicates that the mouse cursor is not in the handwriting screen at this time.

[0093] The cloud computer terminal device calls the interface for switching to the client mouse mode, and switches the mouse of the cloud computer terminal from the client mouse mode to the server mouse mode.

[0094] In step 202, the cloud computer terminal device sends a client mouse mode switching notification message to the cloud computer server to notify the cloud computer server to switch the mouse mode. After the cloud computer server switches to the client mouse mode, a client mouse mode switching response message is returned to the cloud computer terminal device.

[0095] In step 203, the mouse cursor of the cloud computer terminal device is displayed.

[0096] In step 204, the cloud computer terminal device sends the position coordinates of the mouse cursor to the cloud computer server.

[0097] The cloud computer terminal device sends the absolute position coordinates of the mouse cursor in the main screen to the cloud computer server.

[0098] In step 205, the cloud computer server sets the position coordinates of the mouse cursor to the cloud computer desktop operating system, so as to realize the mouse operation in the main screen.

[0099] In step 206, the cloud computer server sends the position coordinates of the mouse cursor in the cloud computer desktop to the cloud computer terminal device.

[0100] In step 5, when the handwriting screen is removed from the cloud computer terminal device, the cloud computer server sends a removal notification message to the cloud computer terminal.

[0101] In step 6, the cloud computer terminal device switches the mouse mode to the client mouse mode, and displays the mouse cursor of the cloud computer terminal device on the main screen after moving the mouse cursor to the main screen.

[0102] The mouse control method provided by the embodiments of the present disclosure can be applied to the scenario of mouse operation in the handwriting display device, and the mouse mode can be automatically switched through the area perception technology without user intervention. In the related art, when the handwriting display device is used in the cloud computer desktop, the mouse cursor of the cloud computer terminal needs to be moved to the handwriting display device that redirects the cloud computer desktop, and relevant mouse operations such as clicking a certain button are performed.

[0103] The embodiments of the present disclosure provide a mouse control method, which meets the demand of mouse operation on the handwriting display device while not reducing the user's experience of normal operation of the cloud computer. First, the cloud computer server identifies the handwriting display device accessing or exiting the cloud computer terminal device, redirects the handwriting display device to the cloud computer desktop or removes the redirected handwriting display device, activates or closes the handwriting display device of the cloud computer desktop, and notifies the cloud computer terminal device of relevant events and display screen information of the handwriting display device; the cloud computer terminal device automatically switches the mouse mode of the cloud computer terminal device through area perception, adopts the client mouse mode when the user operates the mouse on the display screen of the cloud computer terminal device, and switches the mouse mode to the server mouse mode when the user moves the mouse cursor into the display screen of the handwriting display device, so that the user can perform mouse operation in the handwriting display device without reducing the overall experience of the user's normal operation of the cloud computer.

[0104] It should be noted that in order to solve the problems existing in the use scenario of the handwriting display device being redirected to the cloud computer desktop, the embodiments of the present disclosure also provide two solutions. One solution is that an additional display screen is added to the cloud computer terminal device, the picture of the handwriting display device and the mouse cursor are displayed on the additional display screen, and the resolution of the additional display screen is changed to be consistent with the resolution of the display screen (i.e., the second display screen) of the handwriting display device, so that the button operation on the display screen of the handwriting display device can be completed by operating the mouse of the cloud computer terminal. Another solution is that the cloud computer terminal device does not need to add a display screen, but displays the picture of the handwriting display device and the picture of the cloud computer desktop in two windows of the display screen (i.e., the first display screen) of the cloud computer terminal device, so that the button operation on the display screen of the handwriting display device can also be completed by operating the mouse of the cloud computer terminal. The above two solutions can improve the experience of using the handwriting display device in the cloud computer and the convenience of mouse operation.

[0105] The embodiments of the present disclosure also provide a cloud computer terminal device, as shown in FIG. 8, which includes a memory 1 and a processor 2. The memory 1 stores a computer program executable by the processor. The computer program is executed by the processor, so that the processor implements the mouse control method of the embodiments of the present disclosure.

[0106] The embodiments of the present disclosure also provide a cloud computer server, as shown in FIG. 8, which includes a memory 1 and a processor 2. The memory 1 stores a computer program executable by the processor. The computer program is executed by the processor, so that the processor implements the mouse control method of the embodiments of the present disclosure.

[0107] The processor 2 is a device with data processing capability, including but not limited to a central processing unit (CPU) and the like; the memory is a device with data storage capability, including but not limited to a random access memory (RAM, more specifically SDRAM, DDR, etc.), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), and a flash memory (FLASH); the I / O interface (read-write interface) is connected between the processor and the memory, and can realize the information interaction between the memory 1 and the processor 2, including but not limited to a data bus (Bus) and the like.

[0108] The embodiments of the present disclosure also provide a computer readable storage medium having a computer program stored thereon. The computer program is executed by the processor, so that the processor implements the mouse control method of the embodiments of the present disclosure.

[0109] The embodiments of the present disclosure also provide a computer program product, including a computer program. The computer program is executed by the processor, so that the processor implements the mouse control method of the embodiments of the present disclosure.

[0110] Those of ordinary skill in the art will understand that the functional modules / units in all or some of the steps, systems, devices disclosed above can be implemented as software, firmware, hardware and appropriate combinations thereof.

[0111] In hardware implementation, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component can have multiple functions, or one function or step can be performed by several physical components in cooperation.

[0112] Some or all of the physical components can be implemented as software executed by a processor (such as a central processing unit (CPU), a digital signal processor or a microprocessor) or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software can be distributed on computer readable media, which can include computer storage media (or non-transitory media) and communication media (or transitory media). As is well known to those of ordinary skill in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media include, but are not limited to, random access memory (RAM, more specifically SDRAM, DDR, etc.), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), FLASH memory or other memory technologies; compact disc read only memories (CD-ROMs), digital versatile discs (DVDs) or other optical disk storage; magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices; any other medium that can be used to store the desired information and that can be accessed by a computer. Further, it should be understood by those of ordinary skill in the art that communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and can include any information delivery media.

[0113] The present disclosure has disclosed example embodiments, and although the specific terms are employed, they are used in a generic sense only and should not be construed to be limited to the specific embodiments described herein. In some instances, it will be apparent to those skilled in the art from the foregoing disclosure that various modifications and variations can be made in the described embodiments, in terms of the specifics of the construction, the techniques used, and the general design principles underlying the application. Thus, it will be understood that various changes can be made and equivalents can be substituted for elements thereof without departing from the scope of the disclosure as set forth in the appended claims.

Claims

1. A mouse control method applied to a cloud computer terminal device, the cloud computer terminal device including a first display screen, the method comprising: The movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device is determined; wherein the handwriting display device has been redirected to the cloud computer desktop by the cloud computer server corresponding to the cloud computer terminal device; Based on the movement of the mouse cursor between the first display screen and the second display screen, the mouse of the cloud computer terminal device is switched between client mouse mode and server mouse mode.

2. The method according to claim 1, wherein, The step of switching the mouse of the cloud computer terminal device between client mouse mode and server mouse mode based on the movement of the mouse cursor between the first display screen and the second display screen includes: When the mouse of the cloud computer terminal device is in client mouse mode and the mouse cursor moves from the first display screen to the second display screen, the mouse of the cloud computer terminal device is switched from client mouse mode to server mouse mode. When the mouse cursor moves from the second display screen to the first display screen, the mouse of the cloud computer terminal device is switched from server mouse mode to client mouse mode.

3. The method according to claim 2, further comprising: After switching the mouse of the cloud computer terminal device from client mouse mode to server mouse mode, the mouse cursor of the cloud computer terminal device is hidden, and the mouse cursor of the cloud computer server is displayed.

4. The method according to claim 2, further comprising: After switching the mouse of the cloud computer terminal device from server mouse mode to client mouse mode, the mouse cursor of the cloud computer terminal device is displayed.

5. The method according to claim 1, further comprising: Before determining the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device, the system receives the second attribute information of the second display screen sent by the cloud computer server. The second attribute information is sent by the cloud computer server after redirecting the handwriting display device to the cloud computer desktop. The step of determining the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device includes: Based on the second attribute information and the first attribute information of the first display screen, the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device is determined.

6. The method according to claim 5, wherein, The second attribute information includes the position of the second display screen relative to the first display screen and the second resolution of the second display screen, while the first attribute information includes the first resolution of the first display screen; The step of determining the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device based on the second attribute information and the first attribute information of the first display screen includes: Based on the position of the second display screen relative to the first display screen, the target boundary of the first display screen is determined; the target boundary is the boundary adjacent to the second display screen. The cursor movement range of the target boundary is determined based on the position of the second display screen relative to the first display screen, the second resolution, and the first resolution. If the distance between the current position of the mouse cursor on the cloud computer terminal device and the target boundary of the first display screen is less than a preset threshold and the mouse cursor on the cloud computer terminal device is within the cursor movement range, it is determined that the mouse cursor on the cloud computer terminal device moves from the first display screen to the second display screen.

7. The method according to claim 1, further comprising: Upon receiving a notification from the cloud computer server that the handwriting display device has been removed, the mouse of the cloud computer terminal device is switched from server-side mouse mode to client-side mouse mode.

8. The method according to claim 1, wherein, The step of determining the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device includes: Upon receiving mouse cursor position information sent by the cloud computer server, it is determined that the mouse cursor of the cloud computer terminal device has moved from the second display screen to the first display screen.

9. A mouse control method applied to a cloud computer server, the method comprising: When the handwriting display device is redirected to the cloud computer desktop, the handwriting display device is activated; The second attribute information of the second display screen of the handwriting display device is sent to the cloud computer terminal device corresponding to the cloud computer server.

10. The method of claim 9, further comprising: If it is determined that the handwriting display device has been removed from the cloud computer terminal device, a handwriting display device removal notification is sent to the cloud computer terminal device; The handwriting display device removal notification is used to instruct the cloud computer terminal device to switch the mouse from server mouse mode to client mouse mode.

11. A cloud computer terminal device, comprising a memory and a processor; the memory stores a computer program executable by the processor, the computer program being executed by the processor to enable the processor to implement the mouse control method according to any one of claims 1 to 8.

12. A cloud computer server, comprising a memory and a processor; the memory stores a computer program executable by the processor, the computer program being executed by the processor to enable the processor to implement the mouse control method of claim 9 or 10.

13. A computer-readable storage medium having a computer program stored thereon, the computer program being executed by a processor such that the processor implements the mouse control method of any one of claims 1 to 8, or the mouse control method of claim 9 or 10.

14. A computer program product comprising a computer program executed by a processor, such that the processor implements the mouse control method of any one of claims 1 to 8, or the mouse control method of claim 9 or 10.

Images