Mouse position processing method and system, computing device and storage medium

Abstract

A mouse position processing method and system, a computing device, and a storage medium. The method comprises: in response to a mouse movement instruction, determining interface position information of a mouse cursor on a display interface; on the basis of device screen information of an end-side device, desktop screen information of a cloud desktop, and the interface position information, determining current position information of the mouse cursor on the cloud desktop; determining previous position information of the mouse cursor on the cloud desktop, the previous position information being sent by a cloud-side device running the cloud desktop; and, on the basis of the current position information and the previous position information, determining target position information of the mouse cursor on the cloud desktop, and sending the target position information to the cloud-side device, such that on the basis of the target position information, the cloud-side device controls the mouse cursor to move on the cloud desktop.

Description

Mouse position processing method and system, computing device, and storage medium Cross-reference to related applications

[0001] The present disclosure claims priority to Chinese Patent Application No. 202411099544.8, filed on August 09, 2024, the entire contents of which are incorporated herein by reference. TECHNICAL FIELD

[0002] Embodiments of the present disclosure relate to the technical field of computer, and particularly relate to a mouse position processing method and system, a computing device, and a storage medium. BACKGROUND

[0003] A cloud desktop is a desktop service based on cloud computing technology. A user can access the cloud desktop through a network to realize remote office and collaboration. Generally, an end-side device can display the cloud desktop to the user through a display interface, and a cloud-side device can be used to provide the cloud desktop service.

[0004] However, when the user operates the cloud desktop displayed by the end-side device using a mouse, the display of the mouse pointer on the cloud desktop is delayed due to the fact that the cloud desktop runs on the cloud-side device, which leads to a decline in user experience. Therefore, there is an urgent need for an effective technical solution to solve the above problem. SUMMARY

[0005] In view of this, the present disclosure provides a mouse position processing method. One or more embodiments of the present disclosure also provide a mouse position processing device, a mouse position processing system, a computing device, a computer-readable storage medium, and a computer program product to solve the technical defect of the delay of the mouse pointer on the cloud desktop in the prior art.

[0006] According to a first aspect of embodiments of the present disclosure, a mouse position processing method is provided, applied to an end-side device, the end-side device being configured to display a cloud desktop, the cloud desktop running a display interface of a target application, the method comprising: in response to a mouse movement instruction, determining interface position information of a mouse pointer in the display interface; determining current position information of the mouse pointer in the cloud desktop according to device screen information of the end-side device, desktop screen information of the cloud desktop, and the interface position information; determining previous position information of the mouse pointer in the cloud desktop, wherein the previous position information is sent by a cloud-side device running the cloud desktop; determining target position information of the mouse pointer in the cloud desktop according to the current position information and the previous position information, and sending the target position information to the cloud-side device, so that the cloud-side device controls the mouse pointer to move on the cloud desktop according to the target position information.

[0007] According to a second aspect of the embodiments of the present disclosure, a mouse position processing apparatus is provided, which is applied to an end-side device configured to display a cloud desktop, the cloud desktop running a display interface of a target application, and the apparatus comprises: a first determining module configured to determine interface position information of a mouse pointer in the display interface in response to a mouse moving instruction; a second determining module configured to determine current position information of the mouse pointer in the cloud desktop according to device screen information of the end-side device, desktop screen information of the cloud desktop, and the interface position information; a third determining module configured to determine previous position information of the mouse pointer in the cloud desktop, wherein the previous position information is sent by a cloud-side device running the cloud desktop; and a fourth determining module configured to determine target position information of the mouse pointer in the cloud desktop according to the current position information and the previous position information, and send the target position information to the cloud-side device, so that the cloud-side device controls the mouse pointer to move on the cloud desktop according to the target position information.

[0008] According to a third aspect of the embodiments of the present disclosure, a mouse position processing system is provided, which comprises an end-side device and a cloud-side device, the end-side device is configured to display a cloud desktop, the cloud desktop running a display interface of a target application, and the cloud-side device is configured to run the cloud desktop, wherein the end-side device is configured to determine interface position information of a mouse pointer in the display interface in response to a mouse moving instruction, determine current position information of the mouse pointer in the cloud desktop according to device screen information of the end-side device, desktop screen information of the cloud desktop, and the interface position information, determine previous position information of the mouse pointer in the cloud desktop, wherein the previous position information is sent by a cloud-side device running the cloud desktop, and determine target position information of the mouse pointer in the cloud desktop according to the current position information and the previous position information, and send the target position information to the cloud-side device; and the cloud-side device is configured to control the mouse pointer to move on the cloud desktop according to the target position information.

[0009] According to a fourth aspect of the embodiments of the present disclosure, a computing device is provided, which comprises: a memory and a processor; the memory is configured to store computer programs / instructions, and the processor is configured to execute the computer programs / instructions, and the computer programs / instructions are configured to implement the steps of the above method when executed by the processor.

[0010] According to a fifth aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, which stores computer programs / instructions, and the computer programs / instructions are configured to implement the steps of the above method when executed by a processor.

[0011] According to a sixth aspect of the embodiments of the present disclosure, a computer program product is provided, comprising computer programs / instructions which, when executed by a processor, implement the steps of the above method.

[0012] In the mouse position processing method provided by one embodiment of the present disclosure, the end-side device determines the interface position information of the mouse pointer on the display interface of the end-side device in response to the mouse movement instruction, and determines the current position information of the mouse pointer on the cloud desktop according to the device screen information of the end-side device, the desktop screen information of the cloud desktop, and the interface position information. The current position information of the mouse pointer on the cloud desktop is converted into the target position information of the mouse pointer on the cloud desktop by using the screen difference between the cloud-side device and the end-side device, and the last position information of the mouse pointer on the cloud desktop is determined. Then, the target position information is sent to the cloud-side device, so that the cloud-side device controls the mouse pointer to move on the cloud desktop according to the target position information. Through the message negotiation between the end-side device and the cloud-side device, the delay of the mouse pointer moving on the cloud desktop is reduced, thereby ensuring the user's cloud desktop use experience. BRIEF DESCRIPTION OF DRAWINGS

[0013] FIG. 1 is a schematic diagram of an application scenario of a mouse position processing method according to one embodiment of the present disclosure;

[0014] FIG. 2 is a flowchart of a mouse position processing method according to one embodiment of the present disclosure;

[0015] FIG. 3 is a schematic diagram of various position information in a mouse position processing method according to one embodiment of the present disclosure;

[0016] FIG. 4 is a flowchart of a processing process of a mouse position processing method according to one embodiment of the present disclosure;

[0017] FIG. 5 is a schematic diagram of the structure of a mouse position processing apparatus according to one embodiment of the present disclosure;

[0018] FIG. 6 is a schematic diagram of the structure of a mouse position processing system according to one embodiment of the present disclosure;

[0019] FIG. 7 is a structural block diagram of a computing device according to one embodiment of the present disclosure. DETAILED DESCRIPTION

[0020] In the following description, a lot of specific details are set forth in order to facilitate a thorough understanding of the present disclosure. However, the present disclosure can be practiced in many different ways beyond the specific details disclosed herein, and a person skilled in the art can make similar extensions without departing from the spirit of the present disclosure, so the present disclosure is not limited to the specific implementation disclosed below.

[0021] The terminology used in the one or more embodiments of the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of the present disclosure. As used in the one or more embodiments of the present disclosure and the appended claims, the singular forms "a," "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "and / or," as used in the one or more embodiments of the present disclosure, refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0022] It will be understood that, although the terms first, second, etc. can be used herein to describe various information, these terms are not intended to denote a temporal sequence, but to distinguish between different types of information. For example, without departing from the scope of the one or more embodiments of the present disclosure, first can be termed second, and similarly, second can be termed first. Depending on the context, the word "if' as used herein can be interpreted to mean "when" or "in response to determining."

[0023] In addition, it should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the one or more embodiments of the present disclosure are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation portal for user to choose authorization or refusal.

[0024] First, the nomenclature involved in the one or more embodiments of the present disclosure is explained.

[0025] Cloud desktop: A desktop service based on cloud computing technology, users can access their desktop environment through the Internet, realizing remote office and collaboration.

[0026] End cloud: A computing mode that deploys computing resources on the cloud, users can access the computing resources on the cloud through the network, realizing efficient computing and storage.

[0027] Message negotiation: A technology that resolves ambiguities and misunderstandings in information exchange through negotiation, commonly used in online meetings and collaboration scenarios.

[0028] Guest reaction: A technology in the operating system for simulating user behavior, commonly used for testing and evaluating the performance and stability of software.

[0029] Screen size: Refers to the number and arrangement of pixels displayed on the screen, commonly used to evaluate the display effect and performance of the display.

[0030] Absolute coordinate value: refers to the absolute position of a pixel point on the screen, usually used for positioning and drawing operations.

[0031] Mouse position information: refers to the absolute coordinate value of the mouse on the screen, usually used to specify the position and operation of the mouse.

[0032] Zoom ratio: refers to the size ratio of the image or text displayed on the screen, usually used to adjust the display effect of images and text.

[0033] Real coordinate value: refers to the real position of a pixel point on the screen, usually used for drawing and positioning operations.

[0034] Relative position: refers to the relative position of the mouse on the screen, usually used to specify the operation direction and distance of the mouse.

[0035] dx: refers to the horizontal movement distance of the mouse, usually used to specify the operation direction of the mouse.

[0036] dy: refers to the vertical movement distance of the mouse, usually used to specify the operation direction of the mouse.

[0037] realDx: refers to the horizontal movement distance of the mouse, relative to the proportion of the screen width, usually used to specify the operation direction of the mouse.

[0038] realDy: refers to the vertical movement distance of the mouse, relative to the proportion of the screen height, usually used to specify the operation direction of the mouse.

[0039] In actual application, when using cloud desktop, the mouse pointer moves in the browser on the terminal, the captured mouse event only has the absolute coordinate value of the mouse pointer, the cloud side device cannot perceive the difference of the mouse coordinate change before and after the mouse pointer moves, resulting in delay of the mouse pointer movement, and the user cannot obtain similar experience as using local software, therefore, an effective technical solution is needed to solve the above problems.

[0040] In the present disclosure, a mouse position processing method is provided, and the present disclosure also relates to a mouse position processing device, a mouse position processing system, a computing device, a computer readable storage medium and a computer program product, which are described in detail one by one in the following embodiments.

[0041] Referring to FIG. 1, FIG. 1 shows an application scenario diagram of a mouse position processing method according to an embodiment of the present disclosure.

[0042] The terminal side device 102 and the cloud side device 104 are included in FIG. 1, the cloud side device 104 is used to provide cloud desktop service, the terminal side device 102 is used to display the cloud desktop, and the cloud desktop can run the display interface of the target application.

[0043] In a specific implementation, when a user uses the cloud desktop through the terminal device 102, the user moves a mouse, and the terminal device 102 determines, in response to a mouse movement instruction, interface position information of a mouse pointer on an interface of the terminal device 102, determines, according to device screen information of the terminal device 102, desktop screen information of the cloud desktop, and the interface position information, current position information of the mouse pointer on the cloud desktop, determines previous position information of the mouse pointer on the cloud desktop, and calculates, according to the previous position information and the current position information, target position information of the mouse pointer on the cloud desktop, and sends the target position information to the cloud device 104, so that the cloud device 104 controls the mouse pointer to move on the cloud desktop according to the target position information. Through message negotiation between the terminal device 102 and the cloud device 104, the delay of the mouse pointer moving on the cloud desktop is reduced, thereby ensuring the user's cloud desktop use experience.

[0044] The terminal device 102 can include a browser, an APP (Application), or a web application such as an H5 (Hyper Text Markup Language 5) application, or a light application (also known as a small program, a lightweight application program), or a cloud application, and the like. The terminal device can be developed based on a software development kit (SDK) of a corresponding service provided by a server, such as an RTC (Real Time Communication) SDK, and the like. The terminal device can be deployed in an electronic device, and needs to be run in dependence on a device or some APP in the device, and the like. The electronic device can have a display screen and support information browsing, such as a personal mobile terminal such as a mobile phone, a tablet computer, a personal computer, and the like. Various other types of applications can also be configured in the electronic device, for example, human-computer dialogue applications, model training applications, text processing applications, web browser applications, shopping applications, search applications, instant communication tools, mailbox clients, social platform software, and the like.

[0045] The cloud-side device 104 can be understood as a server providing various services, including a physical server, a cloud server, for example, a server providing a communication service for multiple clients, for example, a server for background training supporting a model used on a client, for example, a server processing data sent by a client, and the like. It should be noted that the cloud-side device 104 can be implemented as a distributed server cluster composed of multiple servers, or as a single server. The cloud-side device 104 can also be a server of a distributed system, or a server combined with a blockchain. The cloud-side device 104 can also be a cloud server of a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, middleware service, domain name service, security service, content distribution network (CDN, Content Delivery Network), and a big data and artificial intelligence platform, or an intelligent cloud computing server or intelligent cloud host with artificial intelligence technology.

[0046] Referring to FIG. 2, FIG. 2 shows a flowchart of a mouse position processing method according to an embodiment of the present disclosure, applied to an end-side device for displaying a cloud desktop, the cloud desktop running a display interface of a target application, specifically including the following steps.

[0047] Step 202: In response to a mouse movement instruction, determining interface position information of a mouse pointer in the display interface.

[0048] Specifically, the mouse position processing method provided by the embodiments of the present disclosure can be used in the field of cloud desktops. The end-side device is used to display a cloud desktop, and the cloud desktop can run a target application. A user can remotely control and operate on the display interface of the target application through the cloud desktop displayed by the end-side device. The target application can be a game or design software, for example. For example, the cloud desktop can run a game, and the user can operate the display interface of the game on the cloud desktop through the end-side device. Alternatively, the cloud desktop can also run a design software, and the user can operate the display interface of the design software running on the cloud desktop through the device. The design software can include image design software, video editing software, and the like.

[0049] The mouse movement instruction can be understood as a mouse movement instruction issued by a user moving a mouse in communication connection with the end-side device. The interface position information of the mouse pointer in the display interface can be understood as absolute position information of the mouse pointer in the display interface, for example, absolute coordinate values of the mouse pointer in the display interface. Alternatively, after responding to the mouse movement instruction, the interface position information of the mouse pointer in the display interface after the mouse pointer stops moving can be determined.

[0050] Based on this, the user can move the mouse connected in communication with the terminal-side device, and the terminal-side device determines the interface position information of the mouse pointer on the display interface of the target application in response to the mouse movement instruction issued by the mouse.

[0051] For example, referring to FIG. 3, FIG. 3 shows a schematic diagram of various position information in a mouse position processing method according to an embodiment of the present disclosure. As shown in FIG. 3, the interface position information of the mouse pointer on the display interface of the target application can be an absolute coordinate value (x, y) relative to the upper left corner coordinate (0, 0) of the display interface, where x represents the width and y represents the height.

[0052] In a specific implementation, the terminal-side device determines the interface position information of the mouse pointer on the display interface of the target application in response to the mouse movement instruction, including: determining a mouse movement event corresponding to the mouse movement instruction in response to the mouse movement instruction; and capturing the interface position information of the mouse pointer on the display interface of the target application according to the mouse movement event.

[0053] In this embodiment, the terminal-side device can be deployed with an event capture module, which can be used to process events from the mouse.

[0054] Based on this, the event capture module of the terminal-side device can determine a mouse movement event corresponding to the mouse movement instruction in response to the mouse movement instruction, and capture the interface position information of the mouse pointer on the display interface of the target application according to the mouse movement event.

[0055] In actual applications, in combination with FIG. 3, the position information of the event capture module (i.e., Event layer) is consistent with the position information of the display interface of the target application, with a width of cw and a height of ch. The display interface of the target application can be a browser window displayed on the cloud desktop of the terminal-side device, and can be used to represent a user viewable window.

[0056] In summary, when the mouse moves on the browser of the terminal, the absolute position information of the mouse pointer on the display interface of the target application is determined by capturing the mouse movement event, thereby providing a data basis for subsequent calculation of relative position information.

[0057] Step 204: determining the current position information of the mouse pointer on the cloud desktop according to the device screen information of the terminal-side device, the desktop screen information of the cloud desktop, and the interface position information.

[0058] The device screen information of the end-side device can be understood as screen information of a display interface of a target application running on the cloud desktop displayed on the end-side device, and can include size information, resolution information, and screen density information of the display interface. The desktop screen information of the cloud desktop can be understood as screen information of the cloud desktop, and can include size information, resolution information, and screen density information of the cloud desktop.

[0059] In actual applications, the desktop screen information of the cloud desktop can be determined according to a Guest reaction of the cloud-side device. The Guest reaction is a technology for simulating user behavior in an operating system, and is usually used to evaluate the display effect and performance of a display.

[0060] In combination with the above FIG. 3, the device screen information of the end-side device can include size information of the display interface, such as a width cw and a height ch, and screen density information pixRatio of the display interface. The desktop screen information of the cloud desktop can include size information of the cloud desktop, such as a width sw and a height sh, and screen density information dpi of the cloud desktop.

[0061] In specific implementations, the determination of the current position information of the mouse pointer on the cloud desktop according to the device screen information of the end-side device, the desktop screen information of the cloud desktop, and the interface position information includes: determining a screen ratio between the display interface and the cloud desktop according to the device screen information of the end-side device and the desktop screen information of the cloud desktop; and determining the current position information of the mouse pointer on the cloud desktop according to the screen ratio and the interface position information.

[0062] The current position information of the mouse pointer on the cloud desktop can be understood as real position information of the mouse pointer on the cloud desktop. It can be understood that, because the screen sizes of the cloud desktop and the display interface are different, the position information of the mouse pointer on the display interface is different from the position information of the mouse pointer on the cloud desktop. Therefore, the position information of the mouse pointer on the display interface needs to be converted into the position information of the mouse pointer on the cloud desktop.

[0063] Based on this, the screen ratio between the display interface and the cloud desktop can be determined according to the device screen information of the end-side device and the desktop screen information of the cloud desktop. The real position information of the mouse pointer on the cloud desktop can be determined according to the screen ratio and the interface position information.

[0064] In actual applications, the screen ratio can be a scaling ratio.

[0065] In summary, by calculating the screen ratio, the conversion from the position information of the mouse pointer on the display interface to the position information of the mouse pointer on the cloud desktop is realized, so as to realize the synchronization of the mouse positions of the terminal-side device and the cloud-side device.

[0066] Further, the screen ratio between the display interface and the cloud desktop is determined according to the device screen information of the terminal-side device and the desktop screen information of the cloud desktop, comprising: determining the device screen size information of the terminal-side device from the device screen information of the terminal-side device; determining the desktop screen size information of the cloud desktop from the desktop screen information of the cloud desktop; and calculating the screen ratio between the display interface and the cloud desktop according to the device screen size information and the desktop screen size information.

[0067] The device screen size information of the terminal-side device can be understood as the size information of the display interface, and the desktop screen size information of the cloud desktop can be understood as the size information of the cloud desktop. The device screen size information and the desktop screen size information both include width size information and height size information. Then, the screen ratio between the display interface and the cloud desktop can be understood as the screen size ratio between the display interface and the cloud desktop, and the screen size ratio can include width size ratio and height size ratio.

[0068] Based on this, the width size information and the height size information of the display interface of the terminal-side device can be determined from the device screen information of the terminal-side device, the width size information and the height size information of the cloud desktop can be determined from the desktop screen information of the cloud desktop, and the screen ratio between the display interface and the cloud desktop can be calculated according to the width size information and the height size information of the display interface, the width size information and the height size information of the cloud desktop.

[0069] In practical applications, the first size ratio surfaceRatio of the cloud desktop can be calculated according to the width size information sw of the cloud desktop and the height size information sh of the cloud desktop, and the second size ratio clientRatio of the display interface can be calculated according to the width size information cw of the display interface and the height size information ch of the display interface, as shown in the following formula. surfaceRatio = sw / sh clientRatio = cw / ch

[0070] In the case where the first size ratio is greater than the second size ratio, the width size information cw of the display interface is determined as the target width CSSWidth, and the target height CSSHeight is determined according to the width size information cw of the display interface and the first size ratio, as shown in the following formula. CSSWidth = cw CSSHeight = cw / surfaceRatio

[0071] In a case where it is determined that the first size ratio is less than or equal to the second size ratio, a target width CSSWidth is determined according to the height size information ch of the display interface, and the first size ratio, and the height size information ch of the display interface is determined as a target height CSSHeight, as shown in the following formula. CSSWidth = ch * surfaceRatio CSSHeight = ch

[0072] Then, the calculation formula of the width size ratio scaleX and the height size ratio scaleY is as follows. scaleX = surfaceWidth / CSSWidth scaleY = surfaceHeight / CSSHeight

[0073] Wherein, surfaceWidth is sw, and surfaceHeight is sh.

[0074] Further, the current position information of the mouse pointer on the cloud desktop can include a width coordinate value and a height coordinate value, and the calculation formula of the width coordinate value realX and the height coordinate value realY is as follows. realX = x * scaleX realY = y * scaleY

[0075] In addition, the current position information of the mouse pointer on the cloud desktop can also be calculated according to other information in the device screen information and the desktop screen information, such as can be calculated according to the resolution, etc., which is not limited in the embodiments of the present disclosure.

[0076] In summary, by calculating the width size ratio and the height size ratio between the display interface and the cloud desktop, the real position information of the mouse pointer on the cloud desktop can be obtained subsequently, and the conversion of the absolute position information from the display interface of the terminal device to the cloud desktop of the cloud device is realized, which is convenient for further calculating the target position information.

[0077] Step 206: determining the previous position information of the mouse pointer on the cloud desktop, wherein the previous position information is sent by the cloud device running the cloud desktop.

[0078] Wherein, the previous position information of the mouse pointer on the cloud desktop can be understood as the position information of the mouse pointer before responding to the mouse moving instruction. The previous position information of the mouse pointer on the cloud desktop can be the relative position of the mouse pointer, including the width position information and the height position information. The relative position can be understood as the position of the mouse pointer relative to the previous position information. For example, the mouse pointer moves from position 1 to position 2, and then the position 2 is the position information of the mouse pointer relative to the position 1.

[0079] In a specific implementation, the method further includes: determining the last position information of the mouse pointer on the cloud desktop according to the mouse mode information sent by the cloud-side device, wherein the mouse mode information is used to indicate that the mouse mode of the cloud desktop is a relative mouse mode.

[0080] The relative mouse mode is a mouse input processing mode, which records the relative distance moved by the mouse since the last frame or a reference point. In the mode, the data of the mouse movement is represented in the form of pixel increments, indicating the relative movement distance of the mouse in the x-axis and y-axis directions. The mouse mode information can be used to indicate the mouse mode of the cloud desktop.

[0081] Based on this, in a case where the mouse mode information sent by the cloud-side device indicates that the mouse mode of the cloud desktop is a relative mouse mode, the last position information of the mouse pointer on the cloud desktop can be determined.

[0082] In actual application, the end-side device can receive the last position information of the mouse pointer on the cloud desktop sent by the cloud-side device before responding to the mouse movement instruction. Alternatively, the end-side device can send an information acquisition request to the cloud-side device after responding to the mouse movement instruction, and receive the last position information of the mouse pointer on the cloud desktop sent by the cloud-side device according to the information acquisition request. Alternatively, the last position information of the mouse pointer on the cloud desktop can also be obtained from the memory of the end-side device, which is not limited in the embodiments of the present disclosure.

[0083] In summary, by determining the last position information of the mouse pointer on the cloud desktop in a case where the mouse mode of the cloud desktop is a relative mouse mode, the relative position can be calculated subsequently, so that the mouse pointer can move according to the relative position.

[0084] In addition, the method further includes: in a case where the mouse mode of the cloud desktop is determined to be an absolute mouse mode according to the mouse mode information, sending the current position information of the mouse pointer on the cloud desktop to the cloud-side device, so that the cloud-side device controls the mouse pointer to move on the cloud desktop according to the current position information; wherein the absolute mouse mode is used to indicate that the mouse pointer moves on the cloud desktop according to an absolute position.

[0085] The absolute mouse mode is a mouse input processing mode, which returns the absolute coordinate position of the mouse in the screen or window. The absolute position can be understood as a specific, fixed point represented by a scientific coordinate system, such as the coordinate value (4, 5), which indicates the absolute position of the mouse pointer.

[0086] Then, in the case that the mouse mode information sent by the cloud-side device indicates that the mouse mode of the cloud desktop is the absolute mouse mode, the current position information of the mouse pointer on the cloud desktop can be directly sent to the cloud-side device without subsequent calculation of the relative position, so that the cloud-side device controls the mouse pointer to move on the cloud desktop according to the current position.

[0087] In summary, in the case that the mouse mode of the cloud desktop is determined to be the absolute mouse mode, the current position information is directly sent to the cloud-side device, so that the mouse pointer can move according to the absolute position.

[0088] Step 208: determining target position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information, and sending the target position information to the cloud-side device, so that the cloud-side device controls the mouse pointer to move on the cloud desktop according to the target position information.

[0089] Specifically, after the current position information and the previous position information are determined, the target position information of the mouse pointer on the cloud desktop can be calculated according to the current position information and the previous position information, and the target position information is sent to the cloud-side device, so that the cloud-side device updates the previous position information according to the target position information, and controls the mouse pointer to move on the cloud desktop according to the target position information.

[0090] In specific implementation, the determining of the target position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information includes: calculating relative position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information; and performing scaling processing on the relative position information according to the desktop screen information to determine the target position information of the mouse pointer on the cloud desktop.

[0091] The relative position information of the mouse pointer on the cloud desktop can include width information and height information of the mouse pointer on the cloud desktop.

[0092] Specifically, the difference between the current position information and the previous position information can be calculated as the relative position information of the mouse pointer on the cloud desktop, and the scaling processing is performed on the relative position information according to the desktop density information in the desktop screen information to obtain the target position information of the mouse pointer on the cloud desktop.

[0093] In practical application, the formula for calculating the relative position information (dx, dy) is as follows. dx = realX-relativeX dy = realY-relativeY

[0094] Wherein, relativeX and relativeY are the last position information, relativeX is the width information in the last position information, and relativeY is the height information in the last position information.

[0095] The formula for calculating the target position information (realDx, realDy) is as follows. realDx = 100 * dx / dpi realDy = 100 * dy / dpi

[0096] Wherein, dpi is the desktop density information, realDx is the width information in the target position information, and realDy is the height information in the target position information.

[0097] In summary, by converting the relative position information according to the desktop density information, the target position information of the mouse pointer on the cloud desktop can be obtained, which facilitates the subsequent control of the mouse pointer movement by the cloud-side device according to the target position information.

[0098] In addition, after receiving the target position information, the cloud-side device can update the target position information to the last position information, that is, send the target position information as the updated last position information to the terminal-side device. In response to the next mouse movement instruction, the terminal-side device continues to calculate the target position information according to the updated last position information, so as to realize the cycle iteration process of the mouse pointer movement.

[0099] In one embodiment of the present disclosure, after determining the last position information of the mouse pointer on the cloud desktop, the method further comprises: calculating relative position information of the mouse pointer on the cloud desktop according to the current position information and the last position information; and sending the relative position information to the cloud-side device, so that the cloud-side device performs scaling processing on the relative position information according to the desktop screen information, and determines the target position information of the mouse pointer on the cloud desktop.

[0100] Specifically, after determining the last position information of the mouse pointer on the cloud desktop, the terminal-side device can calculate the relative position information of the mouse pointer on the cloud desktop according to the current position information and the last position information, and send the relative position information to the cloud-side device. The cloud-side device performs scaling processing on the relative position information according to the screen density information in the desktop screen information, and determines the target position information of the mouse pointer on the cloud desktop.

[0101] It can be understood that the specific process of calculating the target position information of the mouse pointer on the cloud desktop by the cloud-side device is similar to the specific process of calculating the target position information of the mouse pointer on the cloud desktop by the terminal-side device, and the embodiments of the present disclosure will not be repeated here.

[0102] The mouse position processing method provided by one embodiment of the present disclosure comprises the following steps.

[0103] The mouse position processing method provided by one embodiment of the present disclosure is further described below in the application of the mouse position processing method in a cloud desktop with reference to FIG. 4. FIG. 4 is a flow chart of the processing process of the mouse position processing method provided by one embodiment of the present disclosure, which comprises the following steps.

[0104] Step 402: The end-side device determines a mouse movement event corresponding to the mouse movement instruction in response to the mouse movement instruction.

[0105] Specifically, the cloud-side device can provide a cloud desktop service, and the cloud desktop can be displayed on the end-side device. The cloud desktop can run a target application (such as a game or design software), and the cloud desktop can display a display interface (i.e., a browser window) of the target application.

[0106] When a user uses the target application running on the cloud desktop, the user can move a mouse in communication connection with the end-side device. The event capture module of the end-side device can determine a mouse movement event corresponding to the mouse movement instruction in response to the mouse movement instruction.

[0107] Step 404: The end-side device captures interface position information of a mouse pointer in the display interface according to the mouse movement event.

[0108] Specifically, the event capture module captures the interface position information (x, y) of the mouse pointer in the display interface according to the mouse movement event.

[0109] Step 406: The end-side device determines a screen ratio between the display interface and the cloud desktop according to device screen information of the end-side device and desktop screen information of the cloud desktop.

[0110] Specifically, the terminal-side device can determine the width size information cw and the height size information ch of the display interface of the terminal-side device from the device screen information of the terminal-side device, determine the width size information sw and the height size information sh of the cloud desktop from the desktop screen information of the cloud desktop, and calculate the screen scale scaleX and scaleY between the display interface and the cloud desktop according to the width size information cw and the height size information ch of the display interface and the width size information sw and the height size information sh of the cloud desktop.

[0111] Step 408: The terminal-side device determines the current position information of the mouse pointer on the cloud desktop according to the screen scale and the interface position information.

[0112] Specifically, the terminal-side device can determine the current position information realX and realY of the mouse pointer on the cloud desktop according to the screen scale scaleX and scaleY and the interface position information (x, y).

[0113] Step 410: In a case where the terminal-side device determines, according to the mouse mode information sent by the cloud-side device, that the mouse mode of the cloud desktop is a relative mouse mode, the terminal-side device determines the previous position information of the mouse pointer on the cloud desktop.

[0114] Specifically, the terminal-side device can determine the previous position information relativeX and relativeY of the mouse pointer on the cloud desktop.

[0115] Step 412: The terminal-side device calculates the relative position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information.

[0116] Specifically, the terminal-side device can calculate the relative position information (dx, dy) of the mouse pointer on the cloud desktop according to the current position information realX and realY and the previous position information relativeX and relativeY.

[0117] Step 414: The terminal-side device performs scaling processing on the relative position information according to the desktop screen information, determines the target position information of the mouse pointer on the cloud desktop, and sends the target position information to the cloud-side device.

[0118] Specifically, the terminal-side device can perform scaling processing on the relative position information (dx, dy) according to the screen density information dpi in the desktop screen information to obtain the target position information realDx and realDy.

[0119] Step 416: The cloud-side device controls the mouse pointer to move on the cloud desktop according to the target position information.

[0120] In addition, the cloud-side device can send the target position information as updated previous position information to the terminal-side device in a case where it is determined that the desktop mode of the cloud desktop is the relative mouse mode, and the terminal-side device can continue to calculate relative position information according to the updated previous position information in response to a next mouse movement instruction, so as to realize a loop process of mouse position processing.

[0121] In the mouse position processing method provided by one embodiment of the present disclosure, the terminal-side device determines interface position information of a mouse pointer on a display interface of the terminal-side device in response to a mouse movement instruction, and determines current position information of the mouse pointer on a cloud desktop according to device screen information of the terminal-side device, desktop screen information of the cloud desktop, and the interface position information. The current position information of the mouse pointer on the cloud desktop is converted into the current position information of the mouse pointer on the cloud desktop by conversion calculation according to screen differences between the cloud-side device and the terminal-side device, and previous position information of the mouse pointer on the cloud desktop is determined. The target position information of the mouse pointer on the cloud desktop is calculated according to the previous position information and the current position information, the target position information is sent to the cloud-side device, the cloud-side device controls the mouse pointer to move on the cloud desktop according to the target position information, and the delay of the mouse pointer moving on the cloud desktop is reduced through message negotiation between the terminal-side device and the cloud-side device, so as to ensure the cloud desktop use experience of a user.

[0122] Corresponding to the method embodiments, the present disclosure further provides mouse position processing device embodiments. FIG. 5 shows a structural schematic diagram of a mouse position processing device according to one embodiment of the present disclosure. As shown in FIG. 5, the device includes: a first determination module 502 configured to determine interface position information of a mouse pointer on a display interface in response to a mouse movement instruction; a second determination module 504 configured to determine current position information of the mouse pointer on a cloud desktop according to device screen information of a terminal-side device, desktop screen information of the cloud desktop, and the interface position information; a third determination module 506 configured to determine previous position information of the mouse pointer on the cloud desktop, wherein the previous position information is sent by a cloud-side device running the cloud desktop; and a fourth determination module 508 configured to determine target position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information, and send the target position information to the cloud-side device, so that the cloud-side device controls the mouse pointer to move on the cloud desktop according to the target position information.

[0123] In an optional embodiment, the second determining module 504 is further configured to: determine a screen ratio between the display interface and the cloud desktop according to the device screen information of the terminal device and the desktop screen information of the cloud desktop; and determine the current position information of the mouse pointer on the cloud desktop according to the screen ratio and the interface position information.

[0124] In an optional embodiment, the second determining module 504 is further configured to: determine device screen size information of the terminal device from the device screen information of the terminal device; determine desktop screen size information of the cloud desktop from the desktop screen information of the cloud desktop; and calculate a screen ratio between the display interface and the cloud desktop according to the device screen size information and the desktop screen size information.

[0125] In an optional embodiment, the third determining module 506 is further configured to: in a case where the mouse mode of the cloud desktop is determined to be a relative mouse mode according to the mouse mode information sent by the cloud-side device, determine the previous position information of the mouse pointer on the cloud desktop, wherein the relative mouse mode is used to indicate that the mouse pointer moves on the cloud desktop according to a relative position.

[0126] In an optional embodiment, the third determining module 506 is further configured to: in a case where the mouse mode of the cloud desktop is determined to be an absolute mouse mode according to the mouse mode information, send the current position information of the mouse pointer on the cloud desktop to the cloud-side device, so that the cloud-side device controls the mouse pointer to move on the cloud desktop according to the current position information; wherein the absolute mouse mode is used to indicate that the mouse pointer moves on the cloud desktop according to an absolute position.

[0127] In an optional embodiment, the fourth determining module 508 is further configured to: calculate relative position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information; and perform scaling processing on the relative position information according to the desktop screen information to determine target position information of the mouse pointer on the cloud desktop.

[0128] In an optional embodiment, the fourth determining module 508 is further configured to: calculate relative position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information; and send the relative position information to the cloud-side device, so that the cloud-side device performs scaling processing on the relative position information according to the desktop screen information to determine the target position information of the mouse pointer on the cloud desktop.

[0129] In an optional embodiment, the first determining module 502 is further configured to: in response to the mouse movement instruction, determine a mouse movement event corresponding to the mouse movement instruction; and capture interface position information of the mouse pointer in the display interface according to the mouse movement event.

[0130] In the mouse position processing apparatus provided by one embodiment of the present disclosure, the endpoint device determines interface position information of a mouse pointer in a display interface of the endpoint device in response to a mouse movement instruction, and determines current position information of the mouse pointer in a cloud desktop according to device screen information of the endpoint device, desktop screen information of the cloud desktop, and the interface position information. The mouse pointer in the display interface is converted into the current position information of the mouse pointer in the cloud desktop by using the screen difference between the cloud-side device and the endpoint device and through conversion calculation, and previous position information of the mouse pointer in the cloud desktop is determined. Then, target position information of the mouse pointer in the cloud desktop is calculated according to the previous position information and the current position information, the target position information is sent to the cloud-side device, the cloud-side device controls the mouse pointer to move on the cloud desktop according to the target position information, the delay of the mouse pointer moving on the cloud desktop is reduced through message negotiation between the endpoint device and the cloud-side device, and therefore the cloud desktop use experience of the user is ensured.

[0131] The above is a schematic scheme of the mouse position processing apparatus of the present embodiment. It should be noted that the technical scheme of the mouse position processing apparatus and the technical scheme of the mouse position processing method described above belong to the same concept, and the details of the technical scheme of the mouse position processing apparatus that are not described in detail can be referred to the description of the technical scheme of the mouse position processing method.

[0132] Corresponding to the method embodiments described above, the disclosure also provides mouse position processing system embodiments. FIG. 6 shows a structural schematic diagram of a mouse position processing system according to an embodiment of the disclosure. As shown in FIG. 6, the system 600 includes an end-side device 602 and a cloud-side device 604, the end-side device 602 is configured to display a cloud desktop, the cloud desktop runs a display interface of a target application, and the cloud-side device 604 is configured to run the cloud desktop. The end-side device 602 is configured to, in response to a mouse movement instruction, determine interface position information of a mouse pointer in the display interface, determine current position information of the mouse pointer in the cloud desktop according to device screen information of the end-side device, desktop screen information of the cloud desktop, and the interface position information, determine previous position information of the mouse pointer in the cloud desktop, wherein the previous position information is sent by the cloud-side device running the cloud desktop, determine target position information of the mouse pointer in the cloud desktop according to the current position information and the previous position information, and send the target position information to the cloud-side device 604. The cloud-side device 604 is configured to control movement of the mouse pointer on the cloud desktop according to the target position information.

[0133] In an optional embodiment, the cloud-side device is further configured to: send the target position information to the end-side device as updated previous position information.

[0134] In the mouse position processing system provided by an embodiment of the disclosure, the end-side device determines interface position information of a mouse pointer in a display interface of the end-side device in response to a mouse movement instruction, and determines current position information of the mouse pointer in a cloud desktop according to device screen information of the end-side device, desktop screen information of the cloud desktop, and the interface position information. The screen difference between the cloud-side device and the end-side device is utilized to convert the interface position information of the mouse pointer in the display interface into the current position information of the mouse pointer in the cloud desktop through conversion calculation, and the previous position information of the mouse pointer in the cloud desktop is determined. Then, the target position information of the mouse pointer in the cloud desktop is calculated according to the previous position information and the current position information, the target position information is sent to the cloud-side device, the cloud-side device controls movement of the mouse pointer on the cloud desktop according to the target position information, the message negotiation between the end-side device and the cloud-side device reduces the delay of movement of the mouse pointer on the cloud desktop, and thus the cloud desktop use experience of the user is ensured.

[0135] The above is a schematic scheme of a mouse position processing system according to an embodiment of the disclosure. It should be noted that the technical scheme of the mouse position processing system belongs to the same concept as the technical scheme of the mouse position processing method described above. Details of the technical scheme of the mouse position processing system that are not described in detail can be referred to the description of the technical scheme of the mouse position processing method.

[0136] FIG. 7 illustrates a structural block diagram of a computing device 700 according to one embodiment of the present disclosure. The components of the computing device 700 include, but are not limited to, a memory 710 and a processor 720. The processor 720 is connected with the memory 710 through a bus 730, and a database 750 is used to save data.

[0137] The computing device 700 also includes an access device 740, which enables the computing device 700 to communicate via one or more networks 760. Examples of these networks include the public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or a combination of communication networks such as the Internet. The access device 740 can include one or more of any type of network interface (e.g., a network interface card (NIC)), wired or wireless, such as an IEEE 802.11 wireless local area network (WLAN) wireless interface, a Worldwide Interoperability for Microwave Access (Wi-MAX) interface, an Ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a Bluetooth interface, a Near Field Communication (NFC) interface, and the like.

[0138] In one embodiment of the present disclosure, the above-mentioned components of the computing device 700 and other components not shown in FIG. 7 can also be connected with each other, for example, through a bus. It should be understood that the structural block diagram of the computing device shown in FIG. 7 is merely for the purpose of example, and is not a limitation on the scope of the present disclosure. Other components can be added or replaced as needed by those skilled in the art.

[0139] The computing device 700 can be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., a tablet computer, a personal digital assistant, a laptop computer, a notebook computer, a netbook, etc.), a mobile phone (e.g., a smartphone), a wearable computing device (e.g., a smart watch, smart glasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or a personal computer (PC). The computing device 700 can also be a mobile or stationary server.

[0140] The processor 720 is configured to execute instructions of a computer program to implement the steps of the mouse position processing method.

[0141] The embodiments in the present disclosure are described in progressive manner, and the same or similar parts among the embodiments can be referred to each other. Each embodiment mainly describes the difference from other embodiments. Especially, the computing device embodiment is basically similar to the mouse position processing method embodiment, and thus the description is relatively simple, and the relevant part can be referred to the description of the mouse position processing method embodiment.

[0142] An embodiment of the present disclosure further provides a computer readable storage medium, which stores computer program / instructions, and the computer program / instructions are executed by a processor to implement the steps of the mouse position processing method.

[0143] The embodiments in the present disclosure are described in progressive manner, and the same or similar parts among the embodiments can be referred to each other. Each embodiment mainly describes the difference from other embodiments. Especially, the computer readable storage medium embodiment is basically similar to the mouse position processing method embodiment, and thus the description is relatively simple, and the relevant part can be referred to the description of the mouse position processing method embodiment.

[0144] An embodiment of the present disclosure further provides a computer program product, which includes computer program / instructions, and the computer program / instructions are executed by a processor to implement the steps of the mouse position processing method.

[0145] The above is a schematic scheme of the computer program product of the embodiment. It should be noted that the technical scheme of the computer program product and the technical scheme of the mouse position processing method belong to the same concept, and the details of the technical scheme of the computer program product which are not described in detail can be referred to the description of the technical scheme of the mouse position processing method.

[0146] The above describes particular embodiments of the present disclosure. Other embodiments are within the scope of the claims. In some cases, the actions or steps recited in the claims can be performed in a different order and still accomplish the desired result. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order to achieve the desired results. In certain implementations, multitasking and parallel processing can be advantageous or necessary.

[0147] The computer readable medium can include any entity or apparatus capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, software distribution medium, etc. It should be noted that the computer readable medium can include appropriate additions or subtractions according to the requirements of patent practice. For example, according to the patent practice in some regions, the computer readable medium does not include electrical carrier signals and telecommunication signals.

[0148] It should be noted that for the foregoing method embodiments, in order to facilitate description, they are all expressed as a combination of a series of actions, but those skilled in the art should know that the embodiments of the present disclosure are not limited by the order of the actions described, because according to the embodiments of the present disclosure, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily necessary for the embodiments of the present disclosure.

[0149] In the above embodiments, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the related description of other embodiments.

[0150] The preferred embodiments of the present disclosure disclosed above are only used to help explain the present disclosure. The alternative embodiments do not describe all the details and do not limit the invention to the specific embodiments described. Obviously, according to the content of the embodiments of the present disclosure, many modifications and changes can be made. The present disclosure selects and describes these embodiments in order to better explain the principles and practical applications of the embodiments of the present disclosure, so that those skilled in the art can well understand and utilize the present disclosure. The present disclosure is limited only by the claims and their full scope and equivalents.

Claims

1. A mouse position processing method applied to an end-side device, the end-side device being configured to display a cloud desktop, the cloud desktop running a display interface of a target application, the method comprising: determining interface position information of a mouse pointer on the display interface in response to a mouse movement instruction; determining current position information of the mouse pointer on the cloud desktop according to device screen information of the end-side device, desktop screen information of the cloud desktop, and the interface position information; determining previous position information of the mouse pointer on the cloud desktop, wherein the previous position information is sent by a cloud-side device running the cloud desktop; determining target position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information, and sending the target position information to the cloud-side device, so that the cloud-side device controls movement of the mouse pointer on the cloud desktop according to the target position information. 2.The mouse position processing method of claim 1, wherein the determining the current position information of the mouse pointer on the cloud desktop according to the device screen information of the end-side device, the desktop screen information of the cloud desktop, and the interface position information comprises: determining a screen ratio between the display interface and the cloud desktop according to the device screen information of the end-side device and the desktop screen information of the cloud desktop; and determining the current position information of the mouse pointer on the cloud desktop according to the screen ratio and the interface position information. 3.The mouse position processing method of claim 2, wherein the determining the screen ratio between the display interface and the cloud desktop according to the device screen information of the end-side device and the desktop screen information of the cloud desktop comprises: determining device screen size information of the end-side device from the device screen information of the end-side device; determining desktop screen size information of the cloud desktop from the desktop screen information of the cloud desktop; and calculating the screen ratio between the display interface and the cloud desktop according to the device screen size information and the desktop screen size information. 4.The mouse position processing method of claim 1, wherein the determining the previous position information of the mouse pointer on the cloud desktop comprises: in a case where a mouse mode of the cloud desktop is determined to be a relative mouse mode according to mouse mode information sent by the cloud-side device, the relative mouse mode being configured to indicate that the mouse pointer moves on the cloud desktop according to a relative position, determining the previous position information of the mouse pointer on the cloud desktop. 5.The mouse position processing method of claim 1, further comprising: in a case where a mouse mode of the cloud desktop is determined to be an absolute mouse mode according to the mouse mode information, sending the current position information of the mouse pointer on the cloud desktop to the cloud-side device, so that the cloud-side device controls movement of the mouse pointer on the cloud desktop according to the current position information. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ The absolute mouse mode is used to indicate that the mouse pointer moves on the cloud desktop according to an absolute position.

6. The mouse position processing method of claim 1, wherein the determining the target position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information comprises: calculating relative position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information; and scaling the relative position information according to the desktop screen information to determine the target position information of the mouse pointer on the cloud desktop.

7. The mouse position processing method of claim 1, wherein the determining the previous position information of the mouse pointer on the cloud desktop further comprises: calculating relative position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information; and sending the relative position information to the cloud-side device to enable the cloud-side device to scale the relative position information according to the desktop screen information to determine the target position information of the mouse pointer on the cloud desktop.

8. The mouse position processing method of any one of claims 1-7, wherein the determining the interface position information of the mouse pointer on the display interface in response to the mouse movement instruction comprises: determining a mouse movement event corresponding to the mouse movement instruction in response to the mouse movement instruction; and capturing the interface position information of the mouse pointer on the display interface according to the mouse movement event.

9. A mouse position processing system comprising an end-side device and a cloud-side device, the end-side device being configured to display a cloud desktop, the cloud desktop running a display interface of a target application, and the cloud-side device being configured to run the cloud desktop, wherein: the end-side device is configured to determine interface position information of a mouse pointer on the display interface in response to a mouse movement instruction; determine current position information of the mouse pointer on the cloud desktop according to device screen information of the end-side device, desktop screen information of the cloud desktop, and the interface position information; determine previous position information of the mouse pointer on the cloud desktop, wherein the previous position information is sent by the cloud-side device running the cloud desktop; determine target position information of the mouse pointer on the cloud desktop according to the current position information and the previous position information, and send the target position information to the cloud-side device; and the cloud-side device is configured to control movement of the mouse pointer on the cloud desktop according to the target position information.

10. The mouse position processing system of claim 9, wherein the cloud-side device is further configured to: send the target position information as updated previous position information to the end-side device.

11. A computing device comprising: a memory and a processor; the memory is configured to store computer programs / instructions, and the processor is configured to execute the computer programs / instructions, which, when executed by the processor, implement the steps of the method of any one of claims 1-8. ​ 12. A computer readable storage medium storing computer programs / instructions, which, when executed by a processor, implement the steps of the method of any one of claims 1 to 8.

13. A computer program product comprising computer programs / instructions, which, when executed by a processor, implement the steps of the method of any one of claims 1 to 8.

Images