Method and apparatus for controlling mouse function of display device

Abstract

The application provides a control method and device for mouse function of a display device. The method is applied to the display device and includes the following steps: receiving a pressing trigger event and position information of the pressing trigger event sent by a touch device, the pressing trigger event including any one of the following events: a pressing event, a pressing moving event and a pressing stopping event; determining a mouse event corresponding to the pressing trigger event according to the pressing trigger event, the position information of the pressing trigger event and a current state of a state machine contained by the display device, and controlling a position of a mouse pointer according to the mouse event, the state machine being used for indicating a state of the mouse; and keeping or switching the state of the state machine according to the mouse event. The application can increase the diversity of remote control of the mouse function of the display device, so that the remote touch control of the display device has higher practicability.

Description

Technical Field

[0001] This application relates to display device control technology, and more particularly to a control method and apparatus for the mouse function of a display device. Background Technology

[0002] A mouse is a common input device for display devices. It allows you to position a cursor on the screen and manipulate screen elements at the cursor's location using buttons and a scroll wheel. Mice generally include wired and wireless types, both of which require a relatively close distance to the display device to function. If the distance is too great, the cursor cannot be controlled. However, display devices need to be placed in different locations and spaces depending on actual needs, and constantly using a mouse for control can sometimes be inconvenient.

[0003] Based on this, technology has been developed to remotely control the mouse function of a display device using a touch device. For example, during a meeting, participants can use their mobile phones (touch devices) to control the cursor on the conference tablet (display device). When using a mouse to control the cursor, the display device implements cursor control based on mouse events, while the touch device inputs touch events. Therefore, touch events need to be converted into mouse events before they can be executed by the display device.

[0004] In existing technologies, the conversion of Touch events to Mouse events generally includes three types: TouchDown event to MouseDown event (left mouse button click down), TouchMove event to MouseMove event (mouse drag), and TouchUp event to MouseUp event (left mouse button click up to restore). However, mouse operations not only include left mouse button click down, mouse drag, and left mouse button click up to restore, but also right mouse button right-click, left-click selection of multiple objects, and right-click selection of multiple objects. Therefore, designing a method to remotely achieve multi-functional mouse control, making remote touch control of display devices more practical, remains a research area. Summary of the Invention

[0005] This application provides a method and apparatus for controlling the mouse function of a display device, thereby making remote touch control of the display device more practical.

[0006] On the one hand, this application provides a method for controlling the mouse function of a display device, applied to a display device, including:

[0007] Receive a press trigger event and the position information of the press trigger event sent by the touch device. The press trigger event includes any one of the following events: press event, press movement event, and press stop event.

[0008] Based on the press trigger event, the position information of the press trigger event, and the current state of the state machine included in the display device, the mouse event corresponding to the press trigger event is determined, and the position of the mouse pointer is controlled according to the mouse event. The state machine is used to represent the state of the mouse.

[0009] The state of the state machine is maintained or switched according to the mouse event.

[0010] In one embodiment, determining the mouse event corresponding to the press trigger event based on the press trigger event, the position information of the press trigger event, and the current state of the state machine, and controlling the position of the mouse pointer according to the mouse event includes:

[0011] When the state machine is in the first initial state and the press trigger event is the first press event, the first press event is converted into the first mouse press event;

[0012] The position indicated by the first mouse press event is determined based on the position information of the first press event, and the mouse pointer is moved based on the position indicated by the first mouse press event;

[0013] The step of maintaining or switching the state of the state machine based on the mouse event includes:

[0014] The state machine is transitioned from the first initial state to the pressed state based on the first mouse press event.

[0015] In one embodiment, determining the mouse event corresponding to the press trigger event based on the press trigger event, the position information of the press trigger event, and the current state of the state machine, and controlling the position of the mouse pointer based on the mouse event further includes:

[0016] When the state machine is in the pressing state and the pressing trigger event is a first pressing movement event, the first time difference between the occurrence time of the first pressing movement event and the occurrence time of the first pressing event is obtained;

[0017] When the first time difference is less than or equal to the first preset value, the first press-and-move event is converted into the first left mouse button press-and-move event;

[0018] The position indicated by the first left mouse button press and move event is determined based on the position information of the first press and move event, and the mouse pointer is moved based on the position indicated by the first left mouse button press and move event.

[0019] The step of maintaining or switching the state of the state machine based on the mouse event includes:

[0020] The state machine is switched from the pressing state to the left-click pressing and moving state based on the first left-click pressing and moving event.

[0021] In one embodiment, after obtaining the first time difference between the occurrence time of the first press-movement event and the occurrence time of the first press event, the method further includes:

[0022] When the first time difference is greater than the first preset value, the first press-and-move event is converted into a right-click press-and-move event.

[0023] The position indicated by the right mouse button press and move event is determined based on the position information of the first press and move event, and the mouse pointer is moved based on the position indicated by the right mouse button press and move event.

[0024] The step of maintaining or switching the state of the state machine based on the mouse event includes:

[0025] The state machine is switched from the pressing state to the right-click pressing and moving state based on the right-click pressing and moving event.

[0026] In one embodiment, determining the mouse event corresponding to the press trigger event based on the press trigger event, the position information of the press trigger event, and the current state of the state machine, and controlling the position of the mouse pointer based on the mouse event further includes:

[0027] When the state machine is in the left-click press-and-move state or the right-click press-and-move state, and the press-triggered event is the first press-stop event, the first press-stop event is converted into a mouse button press-stop event;

[0028] The position indicated by the mouse button press stop event is determined based on the position information of the first press stop event, and the mouse pointer is moved based on the position indicated by the mouse button press stop event;

[0029] The step of maintaining or switching the state of the state machine based on the mouse event includes:

[0030] Based on the first press stop event, the state machine is switched from the left-click press-to-move state or the right-click press-to-move state to the first initial state.

[0031] In one embodiment, it further includes:

[0032] When the state machine is in the left-click press-and-move state or the right-click press-and-move state, and the press-triggered event is a press event, the press event is ignored.

[0033] In one embodiment, determining the mouse event corresponding to the press trigger event based on the press trigger event, the position information of the press trigger event, and the current state of the state machine, and controlling the position of the mouse pointer based on the mouse event further includes:

[0034] When the state machine is in the pressing state and the pressing trigger event is the second pressing stop event, the second time difference between the occurrence time of the second pressing stop event and the occurrence time of the first pressing event is obtained;

[0035] When the second time difference is less than or equal to the second preset value, the second press stop event is converted into a left mouse click event;

[0036] The position indicated by the left mouse button click event is determined based on the position information of the second press stop event, and the mouse pointer is moved based on the position indicated by the left mouse button click event;

[0037] The step of maintaining or switching the state of the state machine based on the mouse event includes:

[0038] The state machine is switched from the pressed state to the left-click state based on the second press stop event.

[0039] In one embodiment, after the second press-to-stop event is converted into a left mouse click event, the method further includes:

[0040] When the state machine is in the left-click state and the press trigger event is the second press event, the third time difference between the occurrence time of the second press event and the occurrence time of the second press stop event, the first press position included in the first press event, and the second press position included in the second press event are obtained.

[0041] When the third time difference is less than or equal to the third preset value, and the distance between the first pressing position and the second pressing position is less than the preset distance, the second pressing event is converted into a left mouse button double-click event;

[0042] The position indicated by the left mouse button double-click event is determined based on the position information of the second press event, and the mouse pointer is moved based on the position indicated by the left mouse button double-click event;

[0043] The step of maintaining or switching the state of the state machine based on the mouse event includes:

[0044] The state machine is switched from the left mouse click state to the second initial state based on the second press event.

[0045] In one embodiment, maintaining or switching the state of the state machine based on the mouse event includes:

[0046] When the state machine is in the second initial state, and the press trigger event includes a second press move event and / or a third press stop event, the mouse event keeps the state machine in the second initial state.

[0047] The step of determining the mouse event corresponding to the press trigger event based on the press trigger event, the position information of the press trigger event, and the current state of the state machine, and controlling the position of the mouse pointer according to the mouse event includes:

[0048] The second press-and-move event is converted into a second left mouse button press-and-move event. The position indicated by the second left mouse button press-and-move event is determined based on the position information of the second press-and-move event. The mouse pointer is then moved based on the position indicated by the second left mouse button press-and-move event.

[0049] The third press-to-stop event is converted into a left mouse button press-to-stop event. The position indicated by the left mouse button press-to-stop event is determined based on the position information of the third press-to-stop event. The mouse pointer is then moved based on the position indicated by the left mouse button press-to-stop event.

[0050] In one embodiment, after obtaining the second time difference between the occurrence time of the second press-stop event and the occurrence time of the first press event, the method further includes:

[0051] When the second time difference is greater than the second preset value, the second press stop event is converted into a right mouse button event;

[0052] The position indicated by the right-click event is determined based on the position information of the second press-stop event, and the mouse pointer is moved based on the position indicated by the right-click event.

[0053] The step of maintaining or switching the state of the state machine based on the mouse event includes:

[0054] The state machine is restored from the pressing state to the first initial state based on the second press stop event.

[0055] On the other hand, this application provides a control device for the mouse function of a display device, comprising:

[0056] The communication module is used to receive a press trigger event and the position information of the press trigger event sent by the touch device. The press trigger event includes any one of the following events: press event, press movement event, and press stop event.

[0057] The processing module is used to determine the mouse event corresponding to the press trigger event based on the press trigger event, the position information of the press trigger event, and the current state of the state machine included in the display device, and to control the position of the mouse pointer according to the mouse event. The state machine is used to represent the state of the mouse.

[0058] The processing module is also used to maintain or switch the state of the state machine based on the mouse event.

[0059] On the other hand, this application provides a display device including a memory, a processor, and a transceiver. The memory is used to store instructions, the transceiver is used to communicate with other devices, and the processor is used to execute the instructions stored in the memory to cause the display device to perform a control method for the display device mouse function as described in the first aspect.

[0060] On the other hand, this application provides a computer-readable storage medium storing computer-executable instructions that, when executed, cause a computer to perform a control method for the display device mouse function as described in the first aspect.

[0061] On the other hand, this application provides a computer program product, including a computer program that, when executed by a processor, implements a control method for the mouse function of a display device as described in the first aspect.

[0062] In this application, the states of the state machine include an initial state, a pressed state, a left-click press-and-move state, and a right-click press-and-move state. Different press trigger events will trigger different states of the state machine, and the press trigger events received by the state machine in different states will also be converted into different mouse events. Therefore, various mouse events can be simulated based on the received press trigger events: left-click event, left-click press-and-move event, right-click press-and-move event, left-click double-click event, etc. Compared with the prior art, this application expands the remote touch control of display devices, adds multiple control methods, and increases the practicality of remote touch control of display devices. Attached Figure Description

[0063] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0064] Figure 1 This is a schematic diagram illustrating an application scenario of the control method for the mouse function of the display device provided in this application.

[0065] Figure 2This is a flowchart illustrating a method for controlling the mouse function of a display device according to Embodiment 1 of this application.

[0066] Figure 3 This is a flowchart illustrating the control method for the mouse function of a display device provided in Embodiment 2 of this application.

[0067] Figure 4 This is a flowchart illustrating the control method for the mouse function of a display device provided in Embodiment 3 of this application.

[0068] Figure 5 This is a schematic diagram illustrating the principle of a method for controlling the mouse function of a display device according to an embodiment of this application.

[0069] Figure 6 This is a schematic diagram of a control device for the mouse function of a display device provided in Embodiment 4 of this application.

[0070] Figure 7 A schematic diagram of a display device provided for one embodiment of this application.

[0071] The accompanying drawings have illustrated specific embodiments of this disclosure, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this disclosure to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0072] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0073] A mouse is a common input device for display devices. It allows you to position a cursor on the screen and manipulate screen elements at the cursor's location using buttons and a scroll wheel. Mice generally include wired and wireless types, both of which require a relatively close distance to the display device to function. If the distance is too great, the cursor cannot be controlled. However, display devices need to be placed in different locations and spaces depending on actual needs, and constantly using a mouse for control can sometimes be inconvenient.

[0074] Based on this, technology has been developed to remotely control the mouse function of a display device using a touch device. For example, during a meeting, participants can use their mobile phones (touch devices) to control the cursor on the conference tablet (display device). The touch device can also be a tablet computer or other touch-enabled device.

[0075] When using a mouse to control the cursor, the display device uses mouse events to control the cursor (mouse pointer), while the touch device uses touch events. Therefore, touch events need to be converted into mouse events before they can be executed by the display device.

[0076] In existing technologies, the conversion of Touch events to Mouse events generally includes three types: TouchDown event to MouseDown event (left mouse button click down), TouchMove event to MouseMove event (mouse drag), and TouchUp event to MouseUp event (left mouse button click up).

[0077] Mouse operations include not only left-click, dragging, and left-click to return, but also right-click, left-click to select multiple objects, and right-click to select multiple objects. Therefore, designing a method for remotely controlling multiple mouse functions to make remote touch control of display devices more practical remains a research area.

[0078] Based on this, this application provides a method and apparatus for controlling the mouse function of a display device. The method for controlling the mouse function of a display device utilizes a state machine contained in the display device to record the state of the state machine after each TouchEvent is received, and then determines which type of MouseEvent to convert the TouchEvent to based on the comparison result between the occurrence time of the new TouchEvent received by the state machine in different states and the previously received TouchEvent.

[0079] In this application, the states of the state machine include an initial state, a pressed state, a left-click-to-move state, and a right-click-to-move state. Different TouchEvent events trigger different states of the state machine, and the TouchEvent events received by the state machine in different states are converted into different MouseEvent events. Therefore, various mouse events can be simulated based on the received TouchEvent events: left-click event, left-click-to-move event, right-click-to-move event, left-click-double-click event, etc. Compared to existing technologies, this application expands the remote touch control of display devices, adds multiple control methods, and increases the practicality of remote touch control of display devices.

[0080] The method for controlling the mouse function of a display device provided in this application is applied to display devices such as conference tablets, computers, and tablet computers. Figure 1 This diagram illustrates the application of the control method for the mouse function of a display device provided in this application. In the diagram, the display device is communicatively connected to a touch device. The touch device sends a press touch event to the display device. Upon receiving the press touch event, the display device converts it into a corresponding mouse event based on the state of its own state machine, and controls the position of the mouse pointer based on the mouse event. Thus, the user can control the mouse pointer on the display device through touch operations on the touch device.

[0081] Please see Figure 2 This application provides a method for controlling the mouse function of a display device, applied to a display device. The method for controlling the mouse function of a display device includes:

[0082] S210, receive a press trigger event and the position information of the press trigger event sent by the touch device. The press trigger event includes any one of the following events: press event, press movement event, and press stop event.

[0083] The touch device generates the press trigger event based on user interaction. When the user presses the touchscreen of the touch device, and the pressed touch point on the touchscreen does not move, the touch device generates the press-and-move event based on user interaction. When the pressed touch point on the touchscreen moves, the touch device generates the press-and-stop event based on user interaction. When the user stops pressing the touchscreen of the touch device, the touch device generates the press-and-stop event based on user interaction.

[0084] After generating a press trigger event, the touch device sends both the press trigger event and its location information to the display device. The location information refers to the position of the touch point on the touch device screen (touch device display interface) at the time the press trigger event is generated. This location information refers to pixel coordinates. For example, if the touch device display interface has an area of ​​640*960 pixels (640 pixels horizontally and 960 pixels vertically), and the touch point's location at the time of the press event is 300*400, then the touch point is located at the 300th pixel horizontally and the 400th pixel vertically.

[0085] S220, based on the press trigger event, the position information of the press trigger event, and the current state of the state machine contained in the display device, determine the mouse event corresponding to the press trigger event, and control the position of the mouse pointer according to the mouse event. The state machine is used to represent the state of the mouse.

[0086] Optionally, the state of the state machine may include an initial state, a press state, and a press-move state. The state of the state machine is maintained or switched by the press trigger event, or as described in step S230, the state of the state machine is maintained or switched by the mouse event.

[0087] This state machine represents the mouse state. When the state machine is in the initial state, it means that neither the left nor right mouse button is selected. When the state machine is in the pressed state, it means that the simulated mouse is in a left or right button pressed state. When the state machine is in the pressed-and-moved state, it means that the simulated mouse is in a continuous left or right button press state, and the mouse wheel is moving.

[0088] When the display device determines the mouse event corresponding to the press-triggered event based on the press-triggered event, the location information of the press-triggered event, and the current state of the state machine, it needs to judge the press-triggered event based on the current state of the state machine to convert it into the corresponding mouse event. When determining the corresponding mouse event based on the current state of the state machine, the correspondence between the state machine state and the press-triggered event and the mouse event can be set according to actual needs.

[0089] For example, if the current state of the state machine is the initial state, and the display device receives a press event, the corresponding mouse event is a mouse button press event, at which point the state machine switches from the initial state to the press state. If the display device then receives a press stop event, the corresponding mouse event is a mouse button click event, and the state machine returns to the initial state. If the display device receives a press event after receiving the press stop event, the corresponding mouse event is a mouse double-click event.

[0090] For example, if the current state of the state machine is the initial state, and the display device receives a press event followed by a press-move event, then the corresponding mouse event is the mouse button press-move event. At this time, the state of the state machine changes from the initial state to the press-move state.

[0091] Optionally, when determining mouse button press events, mouse button click events, and mouse button press-and-move events, the duration of the press or other reference standards can be used to determine whether it is a left-click mouse press event or a right-click mouse press event, a left-click mouse click event or a right-click mouse click event, or a left-click-and-move mouse click event or a right-click-and-move mouse click event.

[0092] When converting to the corresponding mouse event, the position information of the press trigger event is also converted to the position information indicated by the corresponding mouse event. During the position information conversion, the display device stores the proportional relationship between the pixel area of ​​the touch device and the display interface of the display device. The trigger point pixel position of the press trigger event can be converted according to the proportional relationship to obtain the position information indicated by the mouse event.

[0093] S230, maintain or switch the state of the state machine based on the mouse event.

[0094] Please refer to the relevant description in step S220. Maintaining or switching the state of the state machine according to the mouse event is used to determine the corresponding mouse event in step S220. The state of the state machine can determine the mouse event corresponding to the press trigger event. Therefore, adding states of the state machine as needed, as well as adding the correspondence between the state machine states, the press trigger event, and the corresponding mouse event, can add remotely controllable mouse functionality.

[0095] In summary, the control method for the mouse function of the display device provided in this application can determine the corresponding mouse event based on the state of the state machine and the press trigger event. When the state machine is set to switch between many states, the corresponding mouse event can be set for each state to receive different press trigger events, thereby achieving the purpose of simulating multiple mouse functions using a touch device. Therefore, compared with the prior art, this application expands the remote touch control of display devices, adds multiple control methods, and increases the practicality of remote touch control of display devices.

[0096] Please see Figure 3 Embodiment 2 of this application provides a method for controlling the mouse function of a display device, applied to a display device, including:

[0097] S310 receives a press trigger event and the location information of the press trigger event sent by the touch device.

[0098] For a description of step S310, please refer to the description of step S210, which will not be repeated here.

[0099] S320, when the state machine of the display device is in the first initial state and the press trigger event is the first press event, the first press event is converted into the first mouse press event, and the state machine is converted from the first initial state to the press state according to the first mouse press event;

[0100] The first press event is generated by the touch device based on the user's operation. The first initial state refers to the state machine not receiving any press trigger event, or the state where the mouse event has been completed.

[0101] After the first press event is converted into the first mouse press event, it is still impossible to distinguish whether it is a left mouse button press event or a right mouse button press event. Therefore, the state of the state machine needs to be converted from the first initial state to the press state so that it can receive press-move events or press-release events in the press state.

[0102] S330, when the state machine is in the pressing state and the pressing trigger event is the first pressing movement event, obtain the first time difference between the occurrence time of the first pressing movement event and the occurrence time of the first pressing event.

[0103] The occurrence time of the first press-movement event refers to the generation time information identified by the touch device when the first press-movement event is generated. Similarly, the time of the first press event refers to the generation time information identified by the touch device when the first press event is generated. The first time difference can also be understood as the time interval between the generation time of the first press-movement event and the generation time of the first press event.

[0104] S340, when the first time difference is less than or equal to the first preset value, the first press-and-move event is converted into a first left mouse button press-and-move event, and the state machine is switched from the press state to the left mouse button press-and-move state according to the first left mouse button press-and-move event.

[0105] The first preset value is, for example, 1.5 seconds. When the first time difference is less than or equal to 1.5 seconds, the first press-and-move event is converted into the first left mouse button press-and-move event. That is, when the first time difference is less than or equal to the preset value, the left mouse button press-and-move is simulated.

[0106] At this point, the state machine generates MoseLeftDown and MouseLeftDown|MouseMove messages, and the display device simulates left mouse button movement based on the MoseLeftDown and MouseLeftDown|MouseMove messages.

[0107] When a user continuously presses and moves a touch point on the touch device, the device in the pressed state receives continuously transmitted first press-and-move events. Each first press-and-move event has location information and an occurrence time. Therefore, when the first time difference is less than or equal to the first preset value, the first press-and-move event will continuously be converted into the first left mouse button press-and-move event.

[0108] If the time difference between the last received first press-and-move event and the first press event is still less than or equal to the first preset value, it can be determined that the user is simulating left mouse button movement. Here, the last received first press-and-move event refers to the first press-and-move event before the display device receives the press-stop event.

[0109] Upon determining the first left-click mouse movement event, the state machine switches from the pressed state to the left-click mouse movement state. If the state machine in the left-click mouse movement state receives a press-and-release event from the touch device, it can end the simulated left-click mouse movement. After ending the simulated left-click mouse movement, the state machine returns to the first initial state.

[0110] S350, determine the position indicated by the first left mouse button press and move event based on the position information of the first press and move event, and move the mouse pointer based on the position indicated by the first left mouse button press and move event.

[0111] As described in step S340, the display device continuously receives the first press-and-move events sent by the touch device, and each first press-and-move event has position information. Therefore, in this step, the display device determines the position indicated by the corresponding first left mouse button press-and-move event based on the position information of each of the continuously received first press-and-move events.

[0112] When the mouse pointer is moved to the position indicated by multiple first left mouse button press and move events, the mouse pointer appears to move continuously on the display device's interface. Based on these first left mouse button press and move events, users can perform left-click drawing and multi-selection of interface elements on the display device.

[0113] As described in step S220, during the position information conversion, the display device stores the proportional relationship between the pixel area of ​​the touch device and the display interface of the display device. The pixel position of the trigger point of the first press-move event can be converted according to the proportional relationship to obtain the position information indicated by the left mouse button press-move event.

[0114] S360, when the first time difference is greater than the first preset value, the first press-and-move event is converted into a right mouse button press-and-move event, and the state machine is switched from the press state to the right mouse button press-and-move state according to the right mouse button press-and-move event.

[0115] As described in step S340, the display device continuously receives the first press-and-move event sent by the touch device. When the first time difference between the occurrence time of the first press-and-move event received by the display device and the occurrence time of the first press event is greater than a first preset value, it indicates that the user is pressing and holding the touch device, and the first press-and-move event is converted into a right-click mouse press-and-move event. That is, when the first time difference is greater than the first preset value, the movement of the right mouse button is simulated.

[0116] At this point, the state machine generates MoseRightDown and MouseRightDown|MouseMove messages, and the display device simulates right-click movement of the mouse based on the MoseRightDown and MouseRightDown|MouseMove messages.

[0117] Upon detecting the right-click movement event, the state machine switches from the pressed state to the right-click movement state. If the state machine in the right-click movement state receives a press-and-release event from the touch device, it can end the simulated right-click movement. After ending the simulated right-click movement, the state machine returns to its initial state.

[0118] On some display devices, after simulating right-click movement, some option buttons will appear on the display device's interface, similar to the option buttons on a computer that appear after simulating right-click movement, including "View, sorting method, refresh... display settings, personalization".

[0119] S370, determine the position indicated by the right mouse button press-and-move event based on the position information of the first press-and-move event, and move the mouse pointer based on the position indicated by the right mouse button press-and-move event.

[0120] Please refer to the description of the left mouse button movement event in step S350. The display device continuously receives the first press movement event sent by the touch device, and each first press movement event has position information. Therefore, in this step, the display device determines the position indicated by the corresponding first left mouse button press movement event based on the position information of each of the continuously received first press movement events.

[0121] When the mouse pointer is moved to multiple positions indicated by the right-click and move events, the mouse pointer appears to move continuously on the display device's interface. Based on these right-click and move events, users can right-click to draw boxes or select multiple elements on the display device's interface.

[0122] As described in step S220, during the position information conversion, the display device stores the proportional relationship between the pixel area of ​​the touch device and the display interface of the display device. The pixel position of the trigger point of the first press-move event can be converted according to the proportional relationship to obtain the position information indicated by the right mouse button press-move event.

[0123] S380, when the state machine is in the left-click press-and-move state or the right-click press-and-move state, and the press trigger event is the first press-and-stop event, the first press-and-stop event is converted into a mouse button press-and-stop event, and the state machine is switched from the left-click press-and-move state or the right-click press-and-move state to the first initial state according to the first press-and-stop event.

[0124] When the user ends the press, the touch device generates a first press-stop event. Upon receiving this first press-stop event, the display device converts it into a mouse button press-stop event. At this point, regardless of whether the state machine is in the left-click or right-click movement state, it will return to the first initial state. After the display device generates the mouse button press-stop event, it ends the simulation of left-click or right-click movement.

[0125] S390, determine the position indicated by the mouse button press stop event based on the position information of the first press stop event, and move the mouse pointer based on the position indicated by the mouse button press stop event.

[0126] As described in step S220, during the position information conversion, the display device stores the proportional relationship between the pixel area of ​​the touch device and the display interface of the display device. The pixel position of the trigger point of the first press stop event can be converted according to the proportional relationship to obtain the position information indicated by the mouse button press stop event.

[0127] In addition, when the state machine is in the left-click or right-click state, if the display device receives another press event, the press event is ignored. This is because the display device is currently simulating either a left-click or right-click mouse movement and cannot simulate another mouse button press.

[0128] In summary, the control method for the mouse function of the display device provided in this embodiment can simulate left-click and right-click mouse movement. When the touch device remotely controls the mouse pointer of the display device, as long as the pressing time of the touch point of the pressing event exceeds the first preset value and then the pressing and moving continues, right-click mouse movement can be simulated. Conversely, if the pressing time of the touch point of the pressing event is less than or equal to the first preset value and then the pressing and moving continues, right-click mouse movement can be simulated. Therefore, compared with the prior art, the control method for the mouse function of the display device provided in this embodiment adds the function of simulating right-click mouse movement of the display device, improving the practicality of remote touch control of the display device. In addition, the triggering of simulating right-click mouse movement of the display device provided in this embodiment is relatively simple, which can also improve the user's experience of remotely touching and controlling the display device.

[0129] Please see Figure 4 This application provides a method for controlling the mouse function of a display device based on embodiment one or two, applied to a display device, including:

[0130] S410, when the state machine is in the pressing state and the pressing trigger event is the second pressing stop event, obtain the second time difference between the occurrence time of the second pressing stop event and the occurrence time of the first pressing event.

[0131] When the state machine is in the pressed state but does not receive the pressed movement event in Embodiment 2, but directly receives the second pressed stop event, it proves that there is no need to simulate the movement of the mouse button at this time, but only the click of the mouse button has occurred.

[0132] The purpose of obtaining this second time difference is to determine whether to simulate a left mouse click or a right mouse click at this time.

[0133] S420, when the second time difference is less than or equal to the second preset value, the second press stop event is converted into a mouse left click event, and the state machine is switched from the press state to the left click state according to the second press stop event.

[0134] For example, if the second preset value is 1.5s, then when the second time difference is less than 1.5s, it can be considered that the touch device is simulating a left mouse click, and a mouse click event is generated at this time. At this time, the state machine switches from the pressed state to the left click state, and the state machine generates MouseLeftDown and MouseLeftUp messages, and the display device simulates a left mouse click.

[0135] S430, determine the position indicated by the left mouse button click event based on the position information of the second press stop event, and move the mouse pointer based on the position indicated by the left mouse button click event.

[0136] In principle, the position indicated by the left mouse click event is the same as the position indicated by the first press event, and the mouse pointer does not need to move. However, sometimes the touch point on the touch device will move a small distance, so it is still necessary to move the mouse pointer based on the position indicated by the left mouse click event.

[0137] For details on how to determine the location indicated by the left mouse click event based on the location information of the second press stop event, please refer to the relevant descriptions in steps S220, S350, and S370.

[0138] S440, when the state machine is in the left-click state and the press trigger event is the second press event, obtain the third time difference between the occurrence time of the second press event and the occurrence time of the second press stop event, the first press position included in the first press event, and the second press position included in the second press event.

[0139] The purpose of obtaining the third time difference, the first press position contained in the first press event, and the second press position contained in the second press event is to determine whether the user needs to simulate a double-click of the left mouse button.

[0140] The first press event includes a first press position, which refers to the pixel position of the touch point on the touch device's interface at the time the first press event occurs. Similarly, the second press event includes a second press position, which refers to the pixel position of the touch point on the touch device's interface at the time the second press event occurs.

[0141] S450, when the third time difference is less than or equal to the third preset value, and the distance between the first pressing position and the second pressing position is less than the preset distance, the second pressing event is converted into a left mouse button double-click event, and the state machine is switched from the left mouse button click state to the second initial state according to the second pressing event.

[0142] Both the first and second press positions refer to pixel positions, therefore the preset distance also refers to pixel distance. Since both the first and second press positions have two-dimensional pixel coordinates, the preset distance also includes distance in two dimensions.

[0143] For example, using x and y coordinates in mathematics to represent the horizontal and vertical axes respectively, one unit length of the x-axis represents one pixel length, and one unit length of the y-axis represents one pixel height. In this case, for example, the first press position can be represented as (3,4), the second press position as (6,9), and the preset distance as (10,10). Therefore, it can be determined that the distance between the first press position and the second press position is less than the preset distance because 6-3<5 and 9-4<6.

[0144] When the distance between the first press position and the second press position is less than the preset distance, and the third time difference is less than or equal to the third preset value, the mouse event corresponding to the second press event is determined to be the left mouse button double-click event. The third preset value is, for example, 0.5 seconds.

[0145] After determining that the second press event is the left mouse button double-click event, the state machine switches from the left mouse button click state to the second initial state. Both the second initial state and the first initial state represent the state machine being in its initial state.

[0146] When the state machine is in the second initial state, and the press-triggered event includes the second press-move event and / or the third press-move event, the mouse event keeps the state machine in the second initial state.

[0147] When the display device receives the double-click event, the simulated left mouse button remains pressed. If the display device receives a second press-and-move event or a third press-and-stop event, it can directly convert the second press-and-move event into a second left mouse button press-and-move event and the third press-and-stop event into a left mouse button press-and-stop event.

[0148] Then, the display device determines the position indicated by the second left mouse button press-and-move event based on the position information of the second press-and-move event, and moves the mouse pointer based on the position indicated by the second left mouse button press-and-move event. The display device also determines the position indicated by the third press-and-stop event based on the position information of the third press-and-stop event, and moves the mouse pointer based on the position indicated by the left mouse button press-and-stop event.

[0149] S460, determine the position indicated by the left mouse button double-click event based on the position information of the second press event, and move the mouse pointer based on the position indicated by the left mouse button double-click event.

[0150] When the display device determines the left mouse button double-click event, but has not yet received the second press-move event or the third press-stop event, the display device will determine the position indicated by the left mouse button double-click event based on the position information of the second press event and move the mouse pointer.

[0151] S470, when the second time difference is greater than the second preset value, the second press stop event is converted into a right mouse button event, and the state machine is restored from the press state to the first initial state according to the second press stop event.

[0152] That is, when the state machine is in the pressed state, and the difference between the time of the second press-stop event and the time of the first press event is greater than the second preset value, the second press-stop event is converted into a right-click event. If the user wants to simulate a right-click on the display device based on the touch device, the pressing time only needs to exceed the second preset value.

[0153] After determining that the mouse event is a right-click event, the display device restores the state machine from the pressed state to the first initial state based on the second press-stop event.

[0154] S480, determine the position indicated by the right mouse button event based on the position information of the second press stop event, and move the mouse pointer based on the position indicated by the right mouse button event.

[0155] In principle, the location information of the second press-to-stop event should be the same as that of the first press event, and the mouse pointer should not need to be moved. However, sometimes the user's touch point on the touch device may move slightly, so it is still necessary to move the mouse pointer based on the position indicated by the right-click event.

[0156] In summary, the control of the display device's mouse function provided in this embodiment can simulate left-click, left-double-click, and right-click. When the touch device remotely controls the mouse pointer of the display device, a right-click can be simulated as long as the pressing time of the touch point exceeds the second preset value and is then released. A left-click can be simulated as long as the pressing time of the touch point is less than or equal to the second preset value and is then released. If a left-click is simulated, and the touch interface is pressed again within a third preset time, and the distance between the pressed touch point and the previously pressed touch point is less than or equal to the preset distance, a left-double-click can be simulated. Therefore, the control method for the display device's mouse function provided in this embodiment adds the ability to simulate right-click and left-double-click functions compared to the prior art, improving the practicality of remote touch control of the display device. Furthermore, the triggering of the simulated right-click and left-double-click functions provided in this embodiment is relatively simple, which also improves the user's experience of remotely controlling the display device via touch.

[0157] To better understand the methods described in Examples 1 to 3, please refer to Figure 5 , Figure 5 This is a schematic diagram illustrating the principle of the control method for the display device mouse function in Embodiments 1 to 3 when the first preset value is equal to 1.5s, the third preset value is equal to 0.5 seconds, and the preset distance is 10 pixels.

[0158] Figure 5 In the box, Init represents the initial state of the state machine, Dowing represents the pressed state, RightMoving represents the right-click move state, LeftMoving represents the left-click move state, and LeftFirstClicked represents the left-click single-click state. TouchDown represents a press event on a touch device, TouchMove represents a press move event, and TouchUP represents a press stop event. Figure 5 The diagram illustrating the decision when the state machine switches to the LeftFirstClicked state is omitted. However, it should be noted that the state machine switches to the LeftFirstClicked state only when the second time difference is less than or equal to the second preset value.

[0159] Depend on Figure 5 It can be seen that after the state machine in the Init state (first initial state) receives the TouchDown event (the first press event), it switches to the Downing state (press state).

[0160] Referring to Embodiment 1 and Embodiment 2, when the state machine in the Downing state receives a TouchMove event (the first press-move event), if the first time difference between the occurrence time of the first press-move event and the occurrence time of the first press event is less than or equal to a first preset value (…), Figure 5 When TouchMove+time <= 1.5s (as shown), the state machine switches to the LeftMoving state. If the first time difference between the occurrence time of the first press-movement event and the occurrence time of the first press event is greater than the first preset value (…), the state machine switches to the LeftMoving state. Figure 5 When TouchMove+time > 1.5s (as shown), the state machine switches to the RightMoving state. After receiving a TouchUP event (the first press stop event) while in the LeftMoving or RightMoving state, it returns to the first initial state (Init).

[0161] Please refer to Embodiments 1 and 3. When the state machine in the Downing state receives TouchUP (the second press stop event), and the second time difference between the occurrence time of the second press stop event and the occurrence time of the first press event is less than or equal to the second preset value ( Figure 5 (Not shown in the image), the state machine switches from the Downing state to the LeftFirstClicked state.

[0162] When the state machine in the LeftFirstClicked state receives a TouchDown event (the second press event), if the third time difference is greater than or equal to 0.5s, or if the distance between the first press position and the second press position is greater than or equal to 10 pixels on both the horizontal axis (x) and the vertical axis (y), then... Figure 5 As shown in the example, TouchDown+time>=0.5s||x,y>=10), the state machine switches to the Downing state.

[0163] If the third time difference is less than 0.5s, and the distance between the first and second pressing positions is less than 10 pixels on both the horizontal x-axis and the vertical y-axis ( Figure 5 As shown, when TouchDown + time < 0.5s && x, y < 10, the state machine switches to the Init state (the second initial state). When the state machine is in the Init state (the second initial state), if a TouchUP / TouchMove event (the second press-to-move event and / or the third press-to-stop event) is received, the state machine remains in the Init state (the second initial state).

[0164] Please refer to this again. Figure 5 When the state machine is in the Downing state, it ignores any subsequent TouchDown events. When the state machine is in the RightMoving or LeftMoving state, it ignores any subsequent TouchMove events.

[0165] Please see Figure 6 Embodiment 4 of this application also provides a control device 10 for the mouse function of a display device, comprising:

[0166] The communication module 11 is used to receive a press trigger event and the position information of the press trigger event sent by the touch device. The press trigger event includes any one of the following events: press event, press movement event, and press stop event.

[0167] The processing module 12 is used to determine the mouse event corresponding to the press trigger event based on the press trigger event, the position information of the press trigger event, and the current state of the state machine included in the display device, and to control the position of the mouse pointer according to the mouse event. The state machine is used to represent the state of the mouse.

[0168] The processing module 12 is also used to maintain or switch the state of the state machine based on the mouse event.

[0169] The processing module 12 is further configured to convert the first press event into a first mouse press event when the state machine is in the first initial state and the press trigger event is a first press event; determine the position indicated by the first mouse press event according to the position information of the first press event, and move the mouse pointer based on the position indicated by the first mouse press event; and convert the state machine from the first initial state to the press state according to the first mouse press event.

[0170] The processing module 12 is further configured to: when the state machine is in the pressed state and the pressed trigger event is a first pressed movement event; acquire a first time difference between the occurrence time of the first pressed movement event and the occurrence time of the first pressed event; when the first time difference is less than or equal to a first preset value, convert the first pressed movement event into a first left mouse button pressed movement event; determine the position indicated by the first left mouse button pressed movement event based on the position information of the first pressed movement event, and move the mouse pointer based on the position indicated by the first left mouse button pressed movement event; and switch the state machine from the pressed state to the left button pressed movement state based on the first left mouse button pressed movement event.

[0171] The processing module 12 is further configured to convert the first press-and-move event into a right-click press-and-move event when the first time difference is greater than the first preset value; determine the position indicated by the right-click press-and-move event based on the position information of the first press-and-move event, and move the mouse pointer based on the position indicated by the right-click press-and-move event; and switch the state machine from the press state to the right-click press-and-move state based on the right-click press-and-move event.

[0172] The processing module 12 is further configured to, when the state machine is in the left-click press-and-move state or the right-click press-and-move state, and the press-triggered event is a first press-and-stop event, convert the first press-and-stop event into a mouse button press-and-stop event; determine the position indicated by the mouse button press-and-stop event based on the position information of the first press-and-stop event, and move the mouse pointer based on the position indicated by the mouse button press-and-stop event; and switch the state machine from the left-click press-and-move state or the right-click press-and-move state to the first initial state based on the first press-and-stop event.

[0173] The processing module 12 is also used to ignore the press event when the state machine is in the left-click press-and-move state or the right-click press-and-move state and the press trigger event is a press event.

[0174] The processing module 12 is further configured to: when the state machine is in the pressed state and the pressed trigger event is a second pressed stop event; acquire a second time difference between the occurrence time of the second pressed stop event and the occurrence time of the first pressed event; when the second time difference is less than or equal to a second preset value, convert the second pressed stop event into a left mouse click event; determine the position indicated by the left mouse click event based on the position information of the second pressed stop event, and move the mouse pointer based on the position indicated by the left mouse click event; and switch the state machine from the pressed state to the left click state based on the second pressed stop event.

[0175] The processing module 12 is further configured to, when the state machine is in the left-click state and the press trigger event is a second press event, acquire a third time difference between the occurrence time of the second press event and the occurrence time of the second press stop event, a first press position included in the first press event, and a second press position included in the second press event; when the third time difference is less than or equal to a third preset value and the distance between the first press position and the second press position is less than a preset distance, convert the second press event into a left-click event; determine the position indicated by the left-click event based on the position information of the second press event, and move the mouse pointer based on the position indicated by the left-click event; and switch the state machine from the left-click state to the second initial state based on the second press event.

[0176] The processing module 12 is further configured to maintain the state of the state machine in the second initial state when the state machine is in the second initial state and the press trigger event includes a second press move event and / or a third press stop event; convert the second press move event into a second left mouse button press move event, determine the position indicated by the second left mouse button press move event based on the position information of the second press move event, and move the mouse pointer based on the position indicated by the second left mouse button press move event; convert the third press stop event into a left mouse button press stop event, determine the position indicated by the left mouse button press stop event based on the position information of the third press stop event, and move the mouse pointer based on the position indicated by the left mouse button press stop event.

[0177] The processing module 12 is further configured to convert the second press-stop event into a right-click event when the second time difference is greater than the second preset value; determine the position indicated by the right-click event based on the position information of the second press-stop event, and move the mouse pointer based on the position indicated by the right-click event; and restore the state machine from the press state to the first initial state based on the second press-stop event.

[0178] Please see Figure 7 Embodiment 5 of this application also provides a display device 20, including a memory 21, a processor 22 and a transceiver 23. The memory 21 is used to store instructions, the transceiver 23 is used to communicate with other devices, and the processor 22 is used to execute the instructions stored in the memory 21 so that the display device 20 executes the control method of the display device mouse function provided in Embodiments 1 and 3 above. The specific implementation and technical effects are similar, and will not be described again here.

[0179] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed, cause the computer-executable instructions to be executed by a processor for implementing a control method for the mouse function of the display device as provided in any of the preceding embodiments.

[0180] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the control method for the mouse function of the display device as provided in Embodiments 1 and 3 above. The specific implementation and technical effects are similar and will not be described in detail here.

[0181] It should be noted that the aforementioned computer-readable storage media can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM), etc. It can also be various electronic devices that include one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0182] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0183] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0184] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0185] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0186] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0187] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0188] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A control method of a mouse function of a display device, applied to a display device, characterized by, include: Receive a press trigger event and the position information of the press trigger event sent by the touch device. The press trigger event includes any one of the following events: press event, press movement event, and press stop event. Based on the press trigger event, the position information of the press trigger event, and the current state of the state machine included in the display device, the mouse event corresponding to the press trigger event is determined, and the position of the mouse pointer is controlled according to the mouse event. The state machine is used to represent the state of the mouse. The state of the state machine is maintained or switched according to the mouse event; the state of the state machine includes a first initial state, a pressed state, a left-click pressed-and-moved state, and a right-click pressed-and-moved state. When the state machine is in the first initial state and the press trigger event is the first press event, the first press event is converted into the first mouse press event, and the state machine is converted from the first initial state to the press state according to the first mouse press event. When the state machine is in the pressing state and the pressing trigger event is a first pressing movement event, the first time difference between the occurrence time of the first pressing movement event and the occurrence time of the first pressing event is obtained; When the first time difference is less than or equal to the first preset value, the first press-and-move event is converted into a first left mouse button press-and-move event, and the state machine is switched from the press state to the left mouse button press-and-move state according to the first left mouse button press-and-move event. When the first time difference is greater than the first preset value, the first press-and-move event is converted into a right mouse button press-and-move event; and the state machine is switched from the press state to the right mouse button press-and-move state according to the right mouse button press-and-move event.

2. The method of claim 1, wherein, After converting the first press event into a first mouse press event, the method further includes: The position indicated by the first mouse press event is determined based on the position information of the first press event, and the mouse pointer is moved based on the position indicated by the first mouse press event.

3. The method of claim 2, wherein, After converting the first press-and-move event into a first left mouse button press-and-move event when the first time difference is less than or equal to the first preset value, the method further includes: The position indicated by the first left mouse button press and move event is determined based on the position information of the first press and move event, and the mouse pointer is moved based on the position indicated by the first left mouse button press and move event.

4. The method of claim 3, wherein, After converting the first press-and-move event into a right-click press-and-move event when the first time difference is greater than the first preset value, the method further includes: The position indicated by the right mouse button press and move event is determined based on the position information of the first press and move event, and the mouse pointer is moved based on the position indicated by the right mouse button press and move event.

5. The method of claim 4, wherein, The step of determining the mouse event corresponding to the press trigger event based on the press trigger event, the position information of the press trigger event, and the current state of the state machine, and controlling the position of the mouse pointer based on the mouse event, further includes: When the state machine is in the left-click press-and-move state or the right-click press-and-move state, and the press-triggered event is the first press-stop event, the first press-stop event is converted into a mouse button press-stop event; The position indicated by the mouse button press stop event is determined based on the position information of the first press stop event, and the mouse pointer is moved based on the position indicated by the mouse button press stop event; The step of maintaining or switching the state of the state machine based on the mouse event includes: Based on the first press stop event, the state machine is switched from the left-click press-to-move state or the right-click press-to-move state to the first initial state.

6. The method according to claim 4 or 5, characterized in that, Also includes: When the state machine is in the left-click press-and-move state or the right-click press-and-move state, and the press-triggered event is a press event, the press event is ignored.

7. The method of claim 2, wherein, The step of determining the mouse event corresponding to the press trigger event based on the press trigger event, the position information of the press trigger event, and the current state of the state machine, and controlling the position of the mouse pointer based on the mouse event, further includes: When the state machine is in the pressing state and the pressing trigger event is the second pressing stop event, the second time difference between the occurrence time of the second pressing stop event and the occurrence time of the first pressing event is obtained; When the second time difference is less than or equal to the second preset value, the second press stop event is converted into a left mouse click event; The position indicated by the left mouse button click event is determined based on the position information of the second press stop event, and the mouse pointer is moved based on the position indicated by the left mouse button click event; The step of maintaining or switching the state of the state machine based on the mouse event includes: The state machine is switched from the pressed state to the left-click state based on the second press stop event.

8. The method of claim 7, wherein, After the second press-to-stop event is converted into a left mouse click event, it also includes: When the state machine is in the left-click state and the press trigger event is the second press event, obtain the third time difference between the occurrence time of the second press event and the occurrence time of the second press stop event, the first press position included in the first press event, and the second press position included in the second press event; When the third time difference is less than or equal to the third preset value, and the distance between the first pressing position and the second pressing position is less than the preset distance, the second pressing event is converted into a left mouse button double-click event; The position indicated by the left mouse button double-click event is determined based on the position information of the second press event, and the mouse pointer is moved based on the position indicated by the left mouse button double-click event; The step of maintaining or switching the state of the state machine based on the mouse event includes: The state machine is switched from the left-click state to the second initial state based on the second press event.

9. The method of claim 8, wherein, The step of maintaining or switching the state of the state machine based on the mouse event includes: After the second press event is converted into a left mouse button double-click event, the state machine enters the second initial state; When the state machine is in the second initial state, and the press trigger event includes a second press move event and / or a third press stop event, the mouse event keeps the state machine in the second initial state. The step of determining the mouse event corresponding to the press trigger event based on the press trigger event, the position information of the press trigger event, and the current state of the state machine, and controlling the position of the mouse pointer according to the mouse event includes: The second press-and-move event is converted into a second left mouse button press-and-move event. The position indicated by the second left mouse button press-and-move event is determined based on the position information of the second press-and-move event. The mouse pointer is then moved based on the position indicated by the second left mouse button press-and-move event. The third press-to-stop event is converted into a left mouse button press-to-stop event. The position indicated by the left mouse button press-to-stop event is determined based on the position information of the third press-to-stop event. The mouse pointer is then moved based on the position indicated by the left mouse button press-to-stop event.

10. The method according to any one of claims 7-9, characterized in that, After obtaining the second time difference between the occurrence time of the second press-stop event and the occurrence time of the first press event, the method further includes: When the second time difference is greater than the second preset value, the second press stop event is converted into a right mouse button event; The position indicated by the right-click event is determined based on the position information of the second press-stop event, and the mouse pointer is moved based on the position indicated by the right-click event. The step of maintaining or switching the state of the state machine based on the mouse event includes: The state machine is restored from the pressing state to the first initial state based on the second press stop event.

11. A display device, characterized by comprising: The device includes a memory, a processor, and a transceiver. The memory is used to store instructions, the transceiver is used to communicate with other devices, and the processor is used to execute the instructions stored in the memory to cause the display device to perform the control method for the display device mouse function as described in any one of claims 1-10.

Images