Mouse control method, cloud computer terminal device, cloud computer server, readable medium and computer program product

Abstract

The invention provides a mouse control method, which is applied to cloud computer terminal equipment, the cloud computer terminal equipment comprises a first display screen, and the method comprises the following steps: determining a movement condition of a mouse cursor of the cloud computer terminal equipment between the first display screen and a second display screen of handwriting display equipment; wherein the handwriting display equipment is redirected to a cloud computer desktop by a cloud computer server corresponding to the cloud computer terminal equipment; switching a mouse of the cloud computer terminal equipment between a client mouse mode and a server mouse mode according to the movement condition of the mouse cursor between the first display screen and the second display screen; according to the method, the client mouse mode and the server mouse mode can be automatically switched, on the premise that the smoothness of a cloud computer desktop is guaranteed, the mouse can be used for operation on the external handwriting display device, and use is more convenient. The invention further provides a cloud computer terminal, a cloud computer server, a readable medium and a computer program product.

Description

Technical Field

[0001] This disclosure relates to the field of cloud desktop technology, and in particular to a mouse control method, cloud computer terminal device, cloud computer server, readable medium, and computer program product. Background Technology

[0002] Currently, cloud computer mouse modes include client-side mouse mode and server-side mouse mode. In client-side mouse mode, the terminal sends the mouse position to the cloud computer server. However, in handwriting display device scenarios, the handwriting display device is redirected to the cloud computer desktop, making it impossible to move the mouse cursor off the cloud computer server's desktop screen. Therefore, the mouse cursor cannot be moved to the handwriting display device, making mouse operations impossible. Server-side mouse mode involves the cloud computer terminal sending the relative mouse position to the cloud computer server. This method is feasible in handwriting display device scenarios, allowing mouse operations on the handwriting display device. However, operating the cloud computer desktop using server-side mouse mode is not smooth, and it's impossible to operate the toolbar outside the cloud computer window. Furthermore, if server-side mouse mode is used, the user needs to manually switch the current mouse mode to server-side mouse mode, which is inconvenient. Therefore, improvements are urgently needed. Summary of the Invention

[0003] This disclosure provides a mouse control method, a cloud computer terminal device, a cloud computer server, a readable medium, and a computer program product.

[0004] In a first aspect, embodiments of this disclosure provide a mouse control method applied to a cloud computer terminal device, the cloud computer terminal device including a first display screen, the method comprising:

[0005] The movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device is determined; wherein the handwriting display device has been redirected to the cloud computer desktop by the cloud computer server corresponding to the cloud computer terminal device;

[0006] Based on the movement of the mouse cursor between the first display screen and the second display screen, the mouse of the cloud computer terminal device is switched between client mouse mode and server mouse mode.

[0007] Secondly, this disclosure also provides a mouse control method applied to a cloud computer server, the method comprising:

[0008] When the handwriting display device is redirected to the cloud computer desktop, the handwriting display device is activated;

[0009] The second attribute information of the second display screen of the handwriting display device is sent to the cloud computer terminal device corresponding to the cloud computer server.

[0010] In a third aspect, the embodiments of the present disclosure further provide a cloud computer terminal device, comprising a memory and a processor; the memory stores a computer program which can be executed by the processor, and the computer program is executed by the processor to implement the mouse control method as described above.

[0011] In a fourth aspect, the embodiments of the present disclosure further provide a cloud computer server, comprising a memory and a processor; the memory stores a computer program which can be executed by the processor, and the computer program is executed by the processor to implement the mouse control method as described above.

[0012] In a fifth aspect, the embodiments of the present disclosure further provide a computer readable medium, which stores a computer program, and the computer program is executed by a processor to implement the mouse control method as described above.

[0013] In a sixth aspect, the embodiments of the present disclosure further provide a computer program product, comprising a computer program, and the computer program is executed by a processor to implement the mouse control method as described above.

[0014] The mouse control method provided by the embodiments of the present disclosure is applied to a cloud computer terminal device, the cloud computer terminal device comprises a first display screen, and the method comprises the following steps: determining the movement of a mouse cursor of the cloud computer terminal device between the first display screen and a second display screen of a handwriting display device; wherein the handwriting display device has been redirected to a cloud computer desktop by a cloud computer server corresponding to the cloud computer terminal device; and switching the mouse of the cloud computer terminal device between a client mouse mode and a server mouse mode according to the movement of the mouse cursor between the first display screen and the second display screen. The embodiments of the present disclosure can automatically switch the mouse mode of the cloud computer desktop between the client mouse mode and the server mouse mode according to the movement of the mouse cursor of the cloud computer terminal device, without the intervention of the user; and the user can use the mouse to operate on the external handwriting display device on the premise of ensuring the fluency of the cloud computer desktop, and the operation is more convenient. BRIEF DESCRIPTION OF DRAWINGS

[0015] In the drawings of the embodiments of the present disclosure:

[0016] Figure 1 The system architecture diagram of the mouse control method provided by the embodiments of the present disclosure;

[0017] Figure 2 The flowchart of the mouse control method provided by the embodiments of the present disclosure, taking the cloud computer terminal device as the execution subject;

[0018] Figure 3 The schematic diagram of the display screens of the cloud computer provided by the embodiments of the present disclosure;

[0019] Figure 4 A schematic diagram of a position relationship of the second display screen relative to the first display screen is provided for the embodiments of the present disclosure.

[0020] Figure 5 A flowchart of determining a moving condition of the mouse cursor between the first display screen and the second display screen is provided for the embodiments of the present disclosure.

[0021] Figure 6 A flowchart of the mouse control method with the cloud computer server as an execution subject is provided for the embodiments of the present disclosure.

[0022] Figure 7 A flowchart of using the handwriting screen for mouse operation in the cloud computer is provided for the embodiments of the present disclosure.

[0023] Figure 8 A block diagram of the cloud computer terminal device and the cloud computer server is provided for the embodiments of the present disclosure. DETAILED DESCRIPTION

[0024] In order for those skilled in the art to better understand the technical solutions of the present disclosure, the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0025] The present disclosure will be described more fully hereinafter with reference to the accompanying drawings, in which embodiments of the present disclosure are shown. This present disclosure may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the present disclosure to those skilled in the art.

[0026] The accompanying drawings, which are included to provide a further understanding of the embodiments of the present disclosure and constitute a part of the specification, illustrate the embodiments of the present disclosure and together with the detailed description serve to explain the present disclosure. The above and other features and advantages of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

[0027] The present disclosure can be described with reference to plan views and / or cross-sectional views by idealized schematic illustrations of the ideal schematic diagrams of the present disclosure. Therefore, the exemplary illustrations can be modified according to manufacturing techniques and / or tolerances.

[0028] The embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0029] The terminology used by the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the present disclosure. As used in the present disclosure, the term "and / or" includes any and all combinations of one or more of the associated listed items. As used in the present disclosure, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. As used in the present disclosure, the terms "comprises," "comprising," "made of," and "made from" specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0030] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the present disclosure, and will not be interpreted in an overly literal or overly formal sense unless expressly so defined herein.

[0031] The present disclosure is not limited to the embodiments shown in the drawings, but includes modifications of the configuration formed based on a manufacturing process. Therefore, the regions exemplified in the drawings have a schematic property, and the shape of the regions shown in the drawings exemplifies a specific shape of the region of the element, but is not intended to be restrictive.

[0032] In some related technologies, the current industry cloud computer mouse mode is mainly a client mouse mode and a server mouse mode. The mouse of the client mouse mode is the mouse of the cloud computer terminal device. The cloud computer client sends the absolute position and click event of the mouse to the cloud computer server. The cloud computer server moves the mouse of the cloud computer server to the specified position, and then notifies the cloud computer terminal device of the specified position. The mouse of the cloud computer client mouse mode has fast response time and good user experience, and the cloud computer terminal device displays the mouse cursor. The server mouse mode hides the local mouse cursor of the cloud computer terminal device. The cloud computer terminal device obtains the relative displacement of the mouse and sends it to the cloud computer server. The cloud computer server moves the mouse cursor in the cloud computer desktop according to the relative displacement. The server mouse mode has accurate position, but the mouse cursor has poor follow-up performance, and can only operate the mouse in the cloud computer window. It is difficult to operate the toolbar, and additional means are needed to operate the control interface of the cloud computer terminal device. The user experience is poor. Therefore, the mainstream in the cloud computer desktop scene is still the client mouse mode.

[0033] In scenarios where the handwriting display device is redirected to the cloud computer desktop, client-side mouse mode is unusable because the mouse cursor cannot move outside the current cloud computer desktop screen; the cursor position remains permanently within the current screen. Therefore, client-side mouse mode cannot move the cursor to the handwriting display device, making mouse operations impossible. Server-side mouse mode, on the other hand, obtains the relative displacement of the client mouse, allowing control of the cursor movement within the cloud computer desktop. This enables the cursor to be moved into the handwriting display device, allowing mouse operations. However, using server-side mouse mode requires the user to manually switch from the current mouse mode to server-side mouse mode, which degrades the user experience when using the cloud computer in a handwriting display device scenario.

[0034] To address the aforementioned technical problems, this disclosure provides a mouse control method. Figure 1 A system architecture diagram of the mouse control method provided in the embodiments of this disclosure. (See diagram below.) Figure 1 As shown, the system includes a cloud computer terminal device, a cloud computer server, and a handwriting display device. The cloud computer terminal device includes a cloud computer client, and the cloud computer server includes a cloud computer server component. The cloud computer server component includes a cloud computer protocol component and a cloud computer desktop component. The cloud computer client and the cloud computer server are... Figure 1 Not shown.

[0035] The cloud PC client includes a handwriting display device information processing module, a mouse information capture and mode switching module, and a terminal peripheral management module. The terminal peripheral management module identifies the access of the handwriting display device and redirects it to the cloud PC desktop. The handwriting display device information processing module receives and stores the display screen information of the handwriting display device sent by the cloud PC server; it also acquires the position and size of the handwriting display device when it is activated, and returns the mouse cursor to the display screen position of the cloud PC terminal device when it is removed. The mouse information capture and mode switching module acquires the mouse cursor position and relative displacement of the cloud PC device and sends it to the cloud PC protocol component on the cloud PC server; it also automatically switches the mouse mode based on the mouse cursor position.

[0036] The cloud computer protocol component comprises a mouse position receiving module and a mouse position returning module. The mouse position receiving module is configured to receive the mouse cursor position or relative displacement sent by the mouse information capturing and mode switching module of the cloud computer terminal device, convert the relative displacement into the mouse cursor position, and then send the mouse cursor position to the handwriting display device and the mouse position processing module in the cloud computer desktop component. The mouse position returning module is configured to send the mouse cursor position in the current desktop to the mouse information capturing and mode switching module of the cloud computer terminal in the client mouse mode (not returned when the mouse cursor is in the handwriting display device).

[0037] The cloud computer desktop component comprises a handwriting display device and mouse position processing module and a redirection module. The redirection module is configured to complete the redirection operation of the handwriting display device in cooperation with the terminal peripheral management module. The handwriting display device and mouse position processing module are configured to activate or remove the handwriting display device, return the display screen information of the redirected handwriting display device to the handwriting display device information processing module in the cloud computer client, and set the mouse cursor position transmitted by the mouse position receiving module in the cloud computer protocol component to the operating system after conversion, thereby completing the operation function of the mouse.

[0038] In combination with FIGS. 1 to 3, Figure 1 and Figure 2 The mouse control method provided by the embodiments of the present disclosure is applied to a cloud computer terminal device, and the cloud computer terminal device comprises a first display screen. The mouse control method comprises the following steps:

[0039] In step S11, the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device is determined. The handwriting display device has been redirected to the cloud computer desktop by the cloud computer server corresponding to the cloud computer terminal device, that is, the handwriting display device has been activated.

[0040] In the embodiments of the present disclosure, the first display screen is a main screen, and the second display screen is a handwriting screen. It should be noted that, before step S11, the handwriting display device has been redirected to the cloud computer desktop by the cloud computer server corresponding to the cloud computer terminal device, that is, the handwriting display device has been activated.

[0041] The movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device comprises: the mouse cursor of the cloud computer terminal device moves from the first display screen to the second display screen, that is, the mouse cursor moves from the main screen to the handwriting screen, or the mouse cursor of the cloud computer terminal device moves from the second display screen to the first display screen, that is, the mouse cursor moves from the handwriting screen to the main screen. In this step, the mouse information capturing and mode switching module of the cloud computer terminal device determines whether the mouse cursor of the cloud computer terminal device currently moves from the main screen to the handwriting screen or moves from the handwriting screen to the main screen.

[0042] Step S12, according to the movement of the mouse cursor between the first display screen and the second display screen, the mouse of the cloud computer terminal device is switched between the client mouse mode and the server mouse mode.

[0043] In this step, the mouse information capturing and mode switching module of the cloud computer terminal device can switch the mouse of the cloud computer terminal device from the client mouse mode to the server mouse mode, or from the server mouse mode to the client mouse mode, according to whether the mouse cursor of the cloud computer terminal device is currently moving from the main screen to the handwriting screen or moving from the handwriting screen to the main screen.

[0044] The mouse control method provided by the embodiments of the present disclosure is applied to a cloud computer terminal device, the cloud computer terminal device includes a first display screen, and the method includes: determining the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of a handwriting display device; wherein the handwriting display device has been redirected to a cloud computer desktop by a cloud computer server corresponding to the cloud computer terminal device; and switching the mouse of the cloud computer terminal device between a client mouse mode and a server mouse mode according to the movement of the mouse cursor between the first display screen and the second display screen. The embodiments of the present disclosure can automatically switch the mouse mode of the cloud computer desktop between the client mouse mode and the server mouse mode according to the movement of the mouse cursor of the cloud computer terminal device, without the need for user intervention. The mouse can be used for operation on an external handwriting display device under the premise of ensuring the fluency of the cloud computer desktop, and the use is more convenient.

[0045] Figure 3 A schematic diagram of the display screens of the cloud computer provided by the embodiments of the present disclosure is shown in FIG. 1. Figure 3 As shown in FIG. 1, the main display screen of the cloud computer terminal is the first display screen, that is, the display screen to which the mouse is connected. Figure 3 The display screen of the handwriting display device is the second display screen, and the second display screen is located on one side of the first display screen. The cloud computer server is remote from the first display screen and the second display screen.

[0046] In some embodiments, the switching of the mouse of the cloud computer terminal device between the client mouse mode and the server mouse mode according to the movement of the mouse cursor between the first display screen and the second display screen (i.e., step S12) includes the following steps: in the case that the mouse of the cloud computer terminal device is in the client mouse mode and the mouse cursor moves from the first display screen to the second display screen, the mouse of the cloud computer terminal device is switched from the client mouse mode to the server mouse mode; and in the case that the mouse cursor moves from the second display screen to the first display screen, the mouse of the cloud computer terminal device is switched from the server mouse mode to the client mouse mode.

[0047] If the mouse cursor of the cloud computer terminal device moves from the handwriting screen to the main screen, it indicates that the mouse of the cloud computer terminal device is currently in the server mouse mode, and the cloud computer terminal device can use both the client mouse mode and the server mouse mode, and the client mouse mode is more smooth, so as to ensure the smoothness of the cloud computer desktop, the mouse of the cloud computer terminal device can be switched from the server mouse mode to the client mouse mode.

[0048] In some embodiments, after the mouse of the cloud computer terminal device is switched from the client mouse mode to the server mouse mode, the mouse control method can further include the following steps: hiding the mouse cursor of the cloud computer terminal device and displaying the mouse cursor of the cloud computer server.

[0049] After the mouse of the cloud computer terminal device is switched from the client mouse mode to the server mouse mode, since the mouse cursor of the cloud computer server is displayed on the second display screen (i.e. the handwriting screen) in the server mouse mode, the mouse cursor of the cloud computer terminal device is hidden, so as to avoid displaying two mouse cursors on the second display screen and avoid confusion with the mouse cursor that is currently being operated.

[0050] In some embodiments, after the mouse of the cloud computer terminal device is switched from the server mouse mode to the client mouse mode, the mouse control method can further include the following steps: displaying the mouse cursor of the cloud computer terminal device. That is, after the mouse of the cloud computer terminal device is switched from the server mouse mode to the client mouse mode, the mouse cursor is normally displayed on the cloud computer terminal device, i.e. the mouse cursor of the cloud computer terminal device is displayed on the first display screen.

[0051] In some embodiments, before the mouse control method determines the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device (i.e. step S11), the mouse control method can further include the following step: step S11', receiving the second attribute information of the second display screen sent by the cloud computer server, the second attribute information being sent by the cloud computer server after the handwriting display device is redirected to the cloud computer desktop.

[0052] Correspondingly, the mouse control method of determining the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device (i.e. step S11) includes the following steps: according to the second attribute information and the first attribute information of the first display screen, determining the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device.

[0053] The handwriting display device information processing module of the cloud computer terminal device receives the second attribute information of the second display screen of the handwriting display device sent by the handwriting display device and mouse position processing module of the cloud computer server, and the mouse information capturing and mode switching module of the cloud computer terminal device determines the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device according to the second attribute information and the first attribute information of the first display screen.

[0054] In some embodiments, the second attribute information includes the position of the second display screen relative to the first display screen and the second resolution of the second display screen.

[0055] The position of the second display screen relative to the first display screen can include the orientation of the second display screen relative to the first display screen, and the orientation can include up, down, left, and right. The first attribute information can include the first resolution of the first display screen.

[0056] Figure 4 A schematic diagram of the position relationship of the second display screen relative to the first display screen provided by the embodiments of the present disclosure is shown in Figure 4 As shown, the position of the second display screen b relative to the first display screen a is that the second display screen b is located on the left side of the first display screen a. Specifically, the position of the second display screen b relative to the first display screen a can be represented by a preset value.

[0057] Correspondingly, according to Figure 4 and Figure 5 , the step of determining the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device according to the second attribute information and the first attribute information of the first display screen includes the following steps:

[0058] Step S111, determining a target boundary of the first display screen according to the position of the second display screen relative to the first display screen; the target boundary is the boundary adjacent to the second display screen.

[0059] In this step, the mouse information capturing and mode switching module of the cloud computer terminal device determines the target boundary adjacent to the second display screen in the first display screen.

[0060] Step S112, determining the cursor movement range of the target boundary according to the position of the second display screen relative to the first display screen, the second resolution, and the first resolution.

[0061] The cursor movement range of the target boundary refers to the common area range of the adjacent boundaries of the first display screen and the second display screen. Within this range, the mouse cursor can move between the first display screen and the second display screen.

[0062] Step S113, in a case that the distance between the current position of the mouse cursor of the cloud computer terminal device and the target boundary of the first display screen is less than the preset threshold and the mouse cursor of the cloud computer terminal device is within the cursor moving range, it is determined that the mouse cursor of the cloud computer terminal device moves from the first display screen to the second display screen.

[0063] If the difference between the current position of the mouse cursor of the cloud computer terminal device and the target boundary of the first display screen is less than the preset threshold and the mouse cursor of the cloud computer terminal device is within the cursor moving range, it means that the mouse cursor is adjacent to the target boundary within the first display screen and is about to enter the second display screen, and then it is determined that the mouse cursor of the cloud computer terminal device moves from the first display screen to the second display screen.

[0064] Figure 4 A schematic diagram of the position relationship of the second display screen relative to the first display screen provided by the embodiment of the present disclosure is shown in FIG. 2. Figure 4 As shown in FIG. 2, the second display screen b is located on the left side of the first display screen a, and the target boundary of the first display screen a is a1. Assuming that the first resolution of the first display screen a is m1*n1, the second resolution of the second display screen b is m2*n2, m1 is the maximum pixel of the x-axis direction of the first display screen a, n1 is the maximum pixel of the y-axis direction of the first display screen a; m2 is the maximum pixel of the x-axis direction of the second display screen b, and n2 is the maximum pixel of the y-axis direction of the second display screen b. The current position of the mouse cursor of the cloud computer terminal device is a position p in the first display screen, the distance s between the position p and the target boundary a1 is less than the preset threshold, and then it is considered that the mouse cursor of the cloud computer terminal device moves from the first display screen a to the second display screen b.

[0065] Through steps S111-S113, it can be determined that the mouse cursor of the cloud computer terminal device moves from the main screen to the handwriting screen.

[0066] In some embodiments, the mouse control method can further include the following steps: in a case that the handwriting display device removal notification sent by the cloud computer server is received, switching the mouse of the cloud computer terminal device from the server-side mouse mode to the client-side mouse mode. That is, once the handwriting display device is removed from the cloud computer terminal device, the cloud computer server triggers to notify the cloud computer terminal device, and accordingly, the mouse of the cloud computer terminal device is switched from the server-side mouse mode to the client-side mouse mode, so that the mouse can be operated on the first display screen of the cloud computer terminal device, and the mouse cursor can be displayed.

[0067] In some embodiments, the determining of the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device (i.e., step S11) comprises the following step: in the case that the mouse cursor position information sent by the cloud computer server is received, it is determined that the mouse cursor of the cloud computer terminal device moves from the second display screen to the first display screen.

[0068] Since the mouse cursor is in the second display screen, the mouse of the cloud computer terminal is in the server mouse mode, and the cloud computer server will not send the mouse cursor position of the cloud computer server to the cloud computer terminal device. Once the mouse cursor of the cloud computer terminal device moves from the second display screen to the first display screen, the mouse information capturing and mode switching module of the cloud computer terminal device receives the mouse cursor position of the cloud computer server sent by the mouse position returning module of the cloud computer server. Therefore, once the cloud computer terminal device receives the mouse cursor position information sent by the cloud computer server, it can be determined that the mouse cursor of the cloud computer terminal device moves from the second display screen to the first display screen.

[0069] The embodiments of the present disclosure also provide a mouse control method, which is applied to a cloud computer server, as shown in the following Figure 6 The method comprises the following steps:

[0070] Step S21, in the case that the handwriting display device is redirected to the cloud computer desktop, the handwriting display device is activated.

[0071] The cloud computer terminal device initiates a connection operation to the cloud computer desktop, and after the connection to the cloud computer desktop is successful, the handwriting display device inserted into the cloud computer terminal device is redirected to the cloud computer desktop. The redirection module of the cloud computer server recognizes the access of the handwriting display device and activates the handwriting display device.

[0072] Step S22, the second attribute information of the second display screen of the handwriting display device is sent to the corresponding cloud computer terminal device of the cloud computer server.

[0073] The handwriting display device and the mouse position processing module send the second attribute information of the second display screen of the handwriting display device, i.e., the position of the second display screen relative to the first display screen of the cloud computer terminal device and the second resolution of the second display screen, to the cloud computer terminal device, and the cloud computer terminal device records the second attribute information so as to determine the movement of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen.

[0074] The mouse control method of the embodiment of the present disclosure is applied to a cloud computer server. In the case of redirecting a handwriting display device to a cloud computer desktop, the handwriting display device is activated, and second attribute information of a second display screen of the handwriting display device is sent to a corresponding cloud computer terminal device of the cloud computer server, so that the cloud computer terminal device judges the movement of a mouse cursor of the cloud computer terminal device between the first display screen and the second display screen according to the second attribute information, and switches the mouse of the cloud computer terminal device between a client mouse mode and a server mouse mode without the intervention of a user. The mouse can be used for operation on the external handwriting display device under the premise of ensuring the fluency of the cloud computer desktop, and the operation is more convenient.

[0075] In some embodiments, the mouse control method can further include the following steps: in the case of determining that the handwriting display device is removed from the cloud computer terminal device, sending handwriting display device removal notification to the cloud computer terminal device, wherein the handwriting display device removal notification is used to instruct the cloud computer terminal device to switch the mouse from the server mouse mode to the client mouse mode. In this step, if the handwriting display device is removed from the cloud computer terminal device, the handwriting device and mouse position processing module of the cloud computer server sends handwriting display device removal notification to the handwriting display device information processing module of the cloud computer terminal device to inform the cloud computer terminal device that the handwriting display device has been removed from the cloud computer desktop. Correspondingly, the mouse information capture and mode switching module of the cloud computer terminal device switches the mouse of the cloud computer terminal device from the server mouse mode to the client mouse mode after receiving the handwriting display device removal notification. Since the mouse cursor of the cloud computer terminal device cannot be displayed on the handwriting display device, the mouse cursor of the cloud computer terminal device is displayed in the first display screen when the mouse cursor is moved to the first display screen of the cloud computer terminal device.

[0076] To clearly illustrate the technical solutions of the embodiments of the present disclosure, the following describes the embodiments of the present disclosure in detail Figure 7 The mouse control scheme of the embodiments of the present disclosure is described in detail.

[0077] As shown in FIG. 1, the screen of the cloud terminal device is a main screen, and the process of using the handwriting screen for mouse operation in the cloud computer is as follows: Figure 7

[0078] Step 1: After the handwriting screen is inserted into the cloud computer terminal device, the cloud computer terminal device initiates cloud computer desktop connection operation.

[0079] Step 2: The cloud computer desktop connection is successful, triggering the cloud computer server to redirect the handwriting screen device to the cloud computer desktop. The cloud computer server identifies the handwriting screen access and activates the handwriting screen.

[0080] ​Step 3, the cloud computer server sends the position information of the handwriting screen relative to the main screen and the resolution information of the handwriting screen to the cloud computer terminal device, and the cloud computer terminal device stores the position information of the handwriting screen relative to the main screen and the resolution information of the handwriting screen.

[0081] Step 4, the user operates the cloud computer mouse, and when the mouse cursor reaches the edge of the current screen, the cloud computer terminal device judges whether the mouse cursor is moved from the handwriting screen to the main screen or from the main screen to the handwriting screen.

[0082] When the user needs to operate the handwriting screen by using the mouse, the mouse cursor needs to be moved from the main screen to the handwriting screen, and after the mouse operation of the handwriting screen is completed, the mouse cursor needs to be moved from the handwriting screen to the main screen. The following describes two cases according to the movement of the mouse cursor between the main screen and the handwriting screen.

[0083] In the case that the mouse cursor is moved from the main screen to the handwriting screen, the following steps 101-105 are executed:

[0084] Step 101, in the case that the mouse of the cloud computer terminal device is in the client mouse mode, switching from the client mouse mode to the server mouse mode.

[0085] The cloud computer terminal device calls an interface for switching to the server mouse mode, and switches the mouse of the cloud computer terminal device from the client mouse mode to the server mouse mode.

[0086] Step 102, the cloud computer terminal device sends a server mouse mode switching notification message to the cloud computer server to notify the cloud computer server to switch the mouse mode, and after the cloud computer server switches to the server mouse mode, returns a server mouse mode switching response message to the cloud computer terminal device.

[0087] Step 103, the cloud computer terminal device hides the mouse cursor of the cloud computer terminal device on the main screen and displays the mouse cursor of the cloud computer server.

[0088] The execution sequence of step 103 and step 102 is not limited.

[0089] Step 104, the cloud computer terminal device sends the relative displacement of the mouse moving in the handwriting screen to the cloud computer server.

[0090] In the server mouse mode, when the cloud computer terminal device judges that the mouse cursor moves on the handwriting screen, the relative displacement of the mouse is sent to the cloud computer server. The cloud computer server does not send the position of the mouse in the cloud computer desktop to the cloud computer terminal device.

[0091] Step 105, the cloud computer server converts the relative displacement of the mouse moving in the handwriting screen into the position coordinates of the mouse cursor, and sets the position coordinates of the mouse cursor to the cloud computer desktop operating system, so as to realize the mouse operation in the handwriting screen.

[0092] In the case that the mouse cursor moves from the handwriting screen to the main screen, the following steps 201-206 are executed:

[0093] Step 201, in the case that the cloud computer terminal device receives the position coordinates of the mouse cursor in the cloud computer desktop sent by the cloud computer server, the mouse of the cloud computer terminal is switched from the client mouse mode to the server mouse mode.

[0094] When the mouse cursor moves from the handwriting screen to the main screen, the mouse mode before moving out of the handwriting screen is the server mouse mode, and the cloud computer terminal device will not receive the current position coordinates of the mouse cursor in the cloud computer desktop. After the mouse cursor moves out of the handwriting screen and enters the main screen, the cloud computer terminal device will receive the current position coordinates of the mouse cursor in the cloud computer desktop sent by the cloud computer server, which means that the mouse cursor is not in the handwriting screen at this time.

[0095] The cloud computer terminal device calls the interface for switching to the client mouse mode, and switches the mouse of the cloud computer terminal from the client mouse mode to the server mouse mode.

[0096] Step 202, the cloud computer terminal device sends a client mouse mode switching notification message to the cloud computer server to notify the cloud computer server to switch the mouse mode. After the cloud computer server switches to the client mouse mode, a client mouse mode switching response message is returned to the cloud computer terminal device.

[0097] Step 203, display the mouse cursor of the cloud computer terminal device.

[0098] Step 204, the cloud computer terminal device sends the position coordinates of the mouse cursor to the cloud computer server.

[0099] The cloud computer terminal device sends the absolute position coordinates of the mouse cursor in the main screen to the cloud computer server.

[0100] Step 205, the cloud computer server sets the position coordinates of the mouse cursor to the cloud computer desktop operating system, so as to realize the mouse operation in the main screen.

[0101] Step 206, the cloud computer server sends the position coordinates of the mouse cursor in the cloud computer desktop to the cloud computer terminal device.

[0102] Step 5, when the handwriting screen is removed from the cloud computer terminal device, the cloud computer server sends a removal notification message to the cloud computer terminal.

[0103] Step 6, the cloud computer terminal device switches the mouse mode to the client mouse mode, and after moving the mouse cursor to the main screen, displays the mouse cursor of the cloud computer terminal device on the main screen.

[0104] The embodiment of the present disclosure can be applied to the scenario of mouse operation in a handwriting display device, and can automatically switch the mouse mode through the area perception technology without user intervention. In the related art, when a handwriting display device is used in a cloud computer desktop, the mouse cursor of the cloud computer terminal device needs to be moved to the handwriting display device that redirects the cloud computer desktop, and relevant mouse operations such as clicking a certain button are performed.

[0105] The embodiment of the present disclosure provides a mouse control method, which meets the demand of mouse operation on a handwriting display device while not reducing the user experience of normal operation of the cloud computer. First, the cloud computer server identifies that the handwriting display device accesses or exits the cloud computer terminal device, redirects the handwriting display device to the cloud computer desktop or removes the redirected handwriting display device, activates / closes the handwriting display device of the cloud computer desktop, and notifies the cloud computer terminal device of relevant events and display screen information of the handwriting display device; the cloud computer terminal device automatically switches the mouse mode of the cloud computer terminal device through area perception, adopts the client mouse mode when the user operates the mouse on the display screen of the cloud computer terminal device, and switches the mouse mode to the server mouse mode when the user moves the mouse cursor into the display screen of the handwriting display device, so that the user can perform mouse operation in the handwriting display device without reducing the overall experience of normal operation of the cloud computer.

[0106] It should be noted that in order to solve the problems existing in the use scenario of redirecting the handwriting display device to the cloud computer desktop, the embodiment of the present disclosure further provides two solutions. One solution is to additionally add a display screen on the cloud computer terminal device, display the picture and mouse cursor of the handwriting display device on the added display screen, and change the resolution of the added display screen to be consistent with the resolution of the display screen (i.e., the second display screen) of the handwriting display device, so that the button operation on the display screen of the handwriting display device can be completed by operating the mouse of the cloud computer terminal. The other solution is that the cloud computer terminal device does not need to add a display screen, but displays the picture of the handwriting display device and the picture of the cloud computer desktop in two windows of the display screen (i.e., the first display screen) of the cloud computer terminal device, so that the button operation on the display screen of the handwriting display device can also be completed by operating the mouse of the cloud computer terminal. The above two solutions can improve the user experience and mouse operation convenience of using the handwriting display device in the cloud computer.

[0107] The embodiment of the present disclosure further provides a cloud computer terminal device, such as Figure 8As shown, it includes a memory 1, a processor 2; the memory 1 stores a computer program executable by the processor, and the computer program is executed by the processor to implement any one of the mouse control methods of the embodiments of the present disclosure.

[0108] The embodiments of the present disclosure also provide a cloud computer server, which comprises a memory 1 and a processor 2. Figure 8 As shown, it includes a memory 1, a processor 2; the memory 1 stores a computer program executable by the processor, and the computer program is executed by the processor to implement any one of the mouse control methods of the embodiments of the present disclosure.

[0109] The processor 2 is a device with data processing capability, including but not limited to a central processing unit (CPU) and the like; the memory is a device with data storage capability, including but not limited to a random access memory (RAM, more specifically SDRAM, DDR, etc.), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a flash memory (FLASH); the I / O interface (read-write interface) is connected between the processor and the memory, and can realize information interaction between the memory 1 and the processor 2, including but not limited to a data bus (Bus) and the like.

[0110] The embodiments of the present disclosure also provide a computer readable medium having a computer program stored thereon, and the computer program is executed by the processor to implement any one of the mouse control methods of the embodiments of the present disclosure.

[0111] The embodiments of the present disclosure also provide a computer program product, comprising a computer program, and the computer program is executed by the processor to implement any one of the mouse control methods of the embodiments of the present disclosure.

[0112] Those skilled in the art can understand that all or some of the functional modules / units in the above disclosed steps, systems and devices can be implemented as software, firmware, hardware and their appropriate combinations.

[0113] In the hardware implementation, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component can have multiple functions, or one function or step can be executed by several physical components in cooperation.

[0114] Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit (CPU), a digital signal processor, or a microprocessor, or hardware, or a combination of software and / or hardware. Such software can be distributed on computer readable media, which can comprise computer storage media (or non-transitory media), and communication media (or transitory media). Computer storage media, as used herein, includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, random access memory (RAM), such as SDRAM, DDR, or other RAM, read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory, or other memory technology, compact disc read only memory (CD-ROM), digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and that can be accessed by a computer. Further, it should be appreciated by those skilled in the art that computer storage media generally includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Examples of communication media include, but are not limited to, ionized gases, or other propagation techniques.

[0115] The present disclosure has disclosed example embodiments, and while specific terminology has been employed, it is merely in the nature of a general description and is not intended to be limiting. In some instances, it will be apparent to those skilled in the art that features, characteristics or / and elements described in connection with a particular embodiment can be used in conjunction with other embodiments unless otherwise explicitly stated. As such, those skilled in the art will appreciate that a variety of changes can be made without departing from the scope of the present disclosure as set forth in the claims that follow.

Claims

1. A mouse control method, applied to a cloud computer terminal device, the cloud computer terminal device comprising a first display screen, the method comprising: determining a movement condition of a mouse cursor of the cloud computer terminal device between the first display screen and a second display screen of a handwriting display device, wherein the handwriting display device has been redirected to a cloud computer desktop by a cloud computer server corresponding to the cloud computer terminal device; and switching a mouse of the cloud computer terminal device between a client mouse mode and a server mouse mode according to the movement condition of the mouse cursor between the first display screen and the second display screen. The switching of the mouse of the cloud computer terminal device between the client mouse mode and the server mouse mode according to the movement condition of the mouse cursor between the first display screen and the second display screen comprises: switching the mouse of the cloud computer terminal device from the client mouse mode to the server mouse mode when the mouse of the cloud computer terminal device is in the client mouse mode and the mouse cursor moves from the first display screen to the second display screen; and switching the mouse of the cloud computer terminal device from the server mouse mode to the client mouse mode when the mouse cursor moves from the second display screen to the first display screen. After switching the mouse of the cloud computer terminal device from the client mouse mode to the server mouse mode, the method further comprises: hiding the mouse cursor of the cloud computer terminal device and displaying a mouse cursor of the cloud computer server.

2. The method of claim 1, wherein, After switching the mouse of the cloud computer terminal device from the server mouse mode to the client mouse mode, the method further comprises: displaying the mouse cursor of the cloud computer terminal device. Before the determining of the movement condition of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device, the method further comprises: receiving second attribute information of the second display screen sent by the cloud computer server, the second attribute information being sent by the cloud computer server after the handwriting display device is redirected to the cloud computer desktop; and The determining of the movement condition of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device comprises: determining the movement condition of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device according to the second attribute information and first attribute information of the first display screen.

3. The method of claim 2, wherein, The second attribute information comprises a position of the second display screen relative to the first display screen and a second resolution of the second display screen, and the first attribute information comprises a first resolution of the first display screen. The determining of the movement condition of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device according to the second attribute information and the first attribute information of the first display screen comprises:

4. The method of claim 2, wherein, ​ ​ 5. The method of claim 1, wherein, ​ ​ ​ ​ 6. The method of claim 5, wherein, ​ ​ determining a target boundary of the first display screen according to a position of the second display screen relative to the first display screen; the target boundary being a boundary adjacent to the second display screen; determining a cursor moving range of the target boundary according to the position of the second display screen relative to the first display screen, the second resolution and the first resolution; determining that the mouse cursor of the cloud computer terminal device moves from the first display screen to the second display screen in a case that a distance between a current position of the mouse cursor of the cloud computer terminal device and the target boundary of the first display screen is less than a preset threshold and the mouse cursor of the cloud computer terminal device is in the cursor moving range.

7. The method of claim 1, wherein, The method further comprises: switching the mouse of the cloud computer terminal device from a server mouse mode to a client mouse mode in a case that a handwriting display device removal notification sent by the cloud computer server is received.

8. The method of claim 1, wherein, The determining of the moving of the mouse cursor of the cloud computer terminal device between the first display screen and the second display screen of the handwriting display device comprises: determining that the mouse cursor of the cloud computer terminal device moves from the second display screen to the first display screen in a case that mouse cursor position information sent by the cloud computer server is received. 9.A mouse control method, applied to a cloud computer server, the method comprising: activating a handwriting display device in a case that the handwriting display device is redirected to a cloud computer desktop; sending second attribute information of a second display screen of the handwriting display device to a cloud computer terminal device corresponding to the cloud computer server.

10. The method of claim 9, wherein, The method further comprises: sending a handwriting display device removal notification to the cloud computer terminal device in a case that it is determined that the handwriting display device is removed from the cloud computer terminal device; the handwriting display device removal notification being used to instruct the cloud computer terminal device to switch a mouse from a server mouse mode to a client mouse mode. 11.A cloud computer terminal device, comprising a memory and a processor; the memory stores a computer program executable by the processor; the computer program is executed by the processor to implement the mouse control method in any one of claims 1-8. 12.A cloud computer server, comprising a memory and a processor; the memory stores a computer program executable by the processor; the computer program is executed by the processor to implement the mouse control method in claim 9 or 10. 13.A computer readable medium, storing a computer program; the computer program is executed by a processor to implement the mouse control method in any one of claims 1-8, or the mouse control method in claim 9 or 10. 14.A computer program product, comprising a computer program; the computer program is executed by a processor to implement the mouse control method in any one of claims 1-8, or the mouse control method in claim 9 or 10.

Images