Cursor control method, device and equipment and readable storage medium

Abstract

The invention discloses a cursor control method, device and equipment and a readable storage medium, is applied to the technical field of air mice, and aims to solve the problem of poor use experience of air mouse equipment. The method comprises the following steps: acquiring positioning information of the air mouse equipment according to a cursor quick calibration instruction; determining a projection point position of the air mouse equipment according to the positioning information; when it is determined that the projection point is located outside a display screen of the display device according to the projection point position, controlling a cursor in the display screen to move to an edge point position closest to the projection point; when it is determined that the projection point is located in the display screen according to the position of the projection point, controlling a cursor in the display screen to move to a projection range of the projection point; therefore, the cursor calibration efficiency is improved, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of air mouse technology, and in particular to a cursor control method, device, equipment and computer-readable storage medium. Background Art

[0002] With the development of science and technology, large-screen displays are used more and more widely in life. In order to facilitate the long-distance control of large-screen displays, air mouse technology has been developed. Air mouse devices generally refer to various devices that include air mouse functions, such as mice, remote controls, electronic pens and other devices. The shape of air mouse devices is generally similar to that of mice, and the overall shape is close to a rectangular block or a cylinder. Air mouse devices logically have six ends: front, back, left, right, up and down. When using an air mouse device, the front end of the device faces the display screen of the display device, and the back end faces away from the display screen of the display device, with the upper end facing up and the lower end facing down. At present, air mouse devices generally have two basic states, non-air mouse state and air mouse state. In the air mouse state, the air mouse device will control the movement of the cursor on the display screen according to the detected movement information, while in the non-air mouse state, the air mouse device cannot control the movement of the cursor on the display screen. Such as Figure 1 As shown, when the air mouse device enters the air mouse state from the non-air mouse state, if the distance between the intersection of the pointing line of the air mouse device (starting from the center point of the rear end of the air mouse device and drawing out a ray, which passes through the center point of the front end and points to the direction of the display screen) and the plane where the display screen is located and the cursor on the display screen is far, then after entering the air mouse state, the user experience will be poor. In order to improve the user experience after the air mouse device enters the air mouse state, the user is required to actively adjust the position and pointing of the device before the air mouse device enters the air mouse state, so that the projection point of the device is close to the position of the cursor on the display screen, and then enter the air mouse state.

[0003] like Figure 2 As shown, when the air mouse device has entered the air mouse state and the user has adjusted the device's projection point and the cursor position to coincide, the air mouse device moves in a certain direction to control the cursor on the display screen to move to the edge of the display screen. If the air mouse device continues to move in that direction, the cursor will stop moving. When the air mouse device continues to move a certain angle and starts to move back in the opposite direction, the cursor on the display screen will simultaneously move from the edge to the central area of ​​the display screen. At this time, the projection point of the air mouse device and the cursor position on the display screen no longer coincide, and the greater the previous rotation angle, the farther the projection point is from the cursor position. Generally, in this case, the user needs to exit the air mouse mode, continue to actively adjust the position and direction of the device, and then enter the air mouse mode, which will affect the user experience.

[0004] In view of this, how to improve the user experience of the air mouse device has become a problem that technical personnel in this field need to solve. Summary of the invention

[0005] The purpose of the embodiments of the present invention is to provide a cursor control method, device, equipment and computer-readable storage medium, which can improve the cursor calibration efficiency during use and help improve the user experience.

[0006] To solve the above technical problems, the embodiments of the present invention provide the following technical solutions:

[0007] One aspect of the present invention provides a cursor control method, comprising:

[0008] According to the cursor quick calibration command, obtain the positioning information of the air mouse device;

[0009] Determine the projection point position of the air mouse device according to the positioning information;

[0010] When it is determined according to the position of the projection point that the projection point is outside the display screen of the display device, controlling the cursor in the display screen to move to the edge point position closest to the projection point;

[0011] When it is determined according to the position of the projection point that the projection point is located within the display screen, the cursor within the display screen is controlled to move to within the projection range of the projection point.

[0012] In one embodiment, obtaining the positioning information of the air mouse device includes:

[0013] Acquire the distance between the air mouse device and a preset position on the display device;

[0014] Based on the coordinate information of the preset position and the distance, the positioning information of the air mouse device is determined.

[0015] In one embodiment, obtaining the distance between the air mouse device and a preset position on the display device includes:

[0016] Acquire a first distance between the air mouse device and the first preset position by a first Bluetooth module disposed at a first preset position on the display device;

[0017] Acquire a second distance between the air mouse device and the second preset position by a second Bluetooth module disposed at a second preset position on the display device;

[0018] The third distance between the air mouse device and the third preset position is obtained through a third Bluetooth module arranged at a third preset position on the display device.

[0019] In one embodiment, determining the positioning information of the air mouse device based on the coordinate information of the preset position and the distance includes:

[0020] Establishing a first spherical surface with a first preset position as the center and a first distance corresponding to the first preset position as the radius;

[0021] Establishing a second spherical surface with the second preset position as the center and the second distance corresponding to the second preset position as the radius;

[0022] Establishing a third spherical surface with a third preset position as the sphere center and a third distance corresponding to the third preset position as the radius;

[0023] The positioning information of the air mouse device is obtained according to the intersection points of the first spherical surface, the second spherical surface and the third spherical surface.

[0024] In one implementation, obtaining the positioning information of the air mouse device according to the intersection of the first spherical surface, the second spherical surface, and the third spherical surface includes:

[0025] Obtain a first intersection point and a second intersection point of the first spherical surface, the second spherical surface, and the third spherical surface;

[0026] Determine the intersection point between the first intersection point and the second intersection point, which is located on the same side of the display as the air mouse device, as the positioning point of the air mouse device;

[0027] Obtain the positioning information of the positioning point.

[0028] In one embodiment, determining the projection point position of the air mouse device according to the positioning information includes:

[0029] Obtain the historical time of the last positioning and the historical positioning information of the air mouse device;

[0030] Obtaining acceleration data and angular velocity data of the air mouse device from the historical moment to the current moment;

[0031] Calculate the movement increment and rotation angle increment of the air mouse device according to the historical positioning information, the historical time, the acceleration data and the angular velocity data;

[0032] The projection point position of the air mouse device at the current moment is determined according to the historical positioning information, the movement increment and the rotation angle increment.

[0033] In one embodiment, the cursor quick calibration instruction is generated when a quick calibration button provided on the air mouse device is triggered.

[0034] Another aspect of the present invention provides a cursor control device, comprising:

[0035] The first acquisition module is used to acquire the positioning information of the air mouse device according to the cursor quick calibration instruction;

[0036] A first determination module, used to determine the projection point position of the air mouse device according to the positioning information;

[0037] A first control module, configured to control a cursor in the display screen to move to an edge point position closest to the projection point when it is determined according to the position of the projection point that the projection point is outside the display screen of the display device;

[0038] The second control module is used for controlling the cursor in the display screen to move to within the projection range of the projection point when it is determined that the projection point is located in the display screen according to the position of the projection point.

[0039] Another aspect of the present invention provides a cursor control device, comprising:

[0040] Memory for storing computer programs;

[0041] A processor is used to implement the steps of the cursor control method as described above when executing the computer program.

[0042] Another aspect of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the cursor control method described above are implemented.

[0043] It can be seen from the above technical solutions that the beneficial effects of the embodiments of the present invention are:

[0044] A cursor control method is provided in an embodiment of the present invention, including obtaining positioning information of an air mouse device according to a cursor quick calibration instruction; determining a projection point position of the air mouse device according to the positioning information; when it is determined according to the projection point position that the projection point is outside a display screen of a display device, controlling a cursor in the display screen to move to an edge point position closest to the projection point; when it is determined according to the projection point position that the projection point is within the display screen, controlling the cursor in the display screen to move to within a projection range of the projection point.

[0045] It can be seen that in the embodiment of the present invention, when a cursor quick calibration instruction is received, the positioning information of the air mouse device is obtained, and then the projection point position of the air mouse device is determined according to the positioning information. According to the relationship between the projection point position and the display screen, if the projection point is outside the display screen, the cursor in the display screen is controlled to move to the edge point position closest to the projection point; if the projection point is inside the display screen, the cursor in the display screen is controlled to move within the projection range of the projection point, thereby improving the cursor calibration efficiency and helping to enhance the user experience.

[0046] In addition, the present invention also provides corresponding implementation devices, equipment and computer-readable storage media for the cursor control method, which further makes the method more practical, and the device, electronic equipment and computer-readable storage medium have corresponding advantages. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the prior art and the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0048] Figure 1 It is a projection diagram of an existing air mouse device;

[0049] Figure 2 It is a schematic diagram of the projection state of an existing air mouse device in the air mouse state;

[0050] Figure 3 A flowchart of a cursor control method provided by an embodiment of the present invention;

[0051] Figure 4 A schematic diagram of a cursor movement state provided by an embodiment of the present invention;

[0052] Figure 5 A schematic diagram of a positioning method of an air mouse device provided in an embodiment of the present invention;

[0053] Figure 6 A schematic diagram of a projection point position provided by an embodiment of the present invention;

[0054] Figure 7 A schematic diagram of a projection point determination method provided by an embodiment of the present invention;

[0055] Figure 8 A schematic diagram of a distance measurement method provided by an embodiment of the present invention;

[0056] Fig. 9 A schematic structural diagram of a cursor control device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0057] The embodiments of the present invention provide a cursor control method, an apparatus, an air mouse device and a computer-readable storage medium, which can improve the cursor calibration efficiency during use and help improve the user experience.

[0058] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0059] When the air mouse device is in the air mouse state, moving the air mouse device can control the movement of the cursor on the display screen of the display device. The air mouse device detects the information of the user holding the device and moving it up, down, left, and right through the motion sensor, and then sends the motion information or the cursor displacement information corresponding to the motion information to the display device through the wireless module. The display device will calculate the corresponding cursor displacement information based on the motion information or directly use the received cursor displacement information to control the movement of the cursor. At this time, there is no restriction on the intersection of the pointing line of the air mouse device and the plane where the display screen is located and the position of the cursor on the display screen. In other words, no matter what the positional relationship between the projection point of the air mouse device and the cursor on the display screen is, as long as the air mouse device moves a fixed angle or distance up, down, left, and right in the air mouse state, the cursor on the display screen will make a corresponding displacement, unless the cursor has moved to the edge of the display screen, then the cursor cannot move to the outside of the display screen.

[0060] In other words, when the air mouse device has entered the air mouse state and the user has adjusted the projection point of the device and the position of the cursor to coincide, the air mouse device moves in a certain direction to control the cursor of the display screen to move to the edge of the display screen. If the air mouse device continues to move in that direction, the cursor will stop moving. When the air mouse device continues to move a certain angle and then starts to move back in the opposite direction, the cursor of the display screen will simultaneously move from the edge to the central area of ​​the display screen. At this time, the projection point of the air mouse device and the position of the cursor on the display screen no longer coincide. In order to make the projection point coincide with the cursor, the air mouse device needs to be operated to exit the air mouse mode. Manually adjusting the position and direction of the air mouse device to make the projection point coincide with the cursor and then entering the air mouse mode requires manual adjustment by the user. The adjustment efficiency is low, which affects the user experience. In view of this, an embodiment of the present invention provides a cursor control method with high adjustment efficiency. Please refer to Figure 3 , Figure 3 A flowchart of a cursor control method provided by an embodiment of the present invention. The cursor control method includes:

[0061] S110: Acquire positioning information of the air mouse device according to the cursor quick calibration instruction;

[0062] It should be noted that in order to improve the user experience and improve the efficiency of cursor control, a quick calibration button can be set on the air mouse device. When the air mouse device is in the air mouse state, if the user finds that the distance between the projection point and the cursor is far, the user can press the quick calibration button on the air mouse device. When the air mouse device detects that the quick calibration button is pressed, it will generate a cursor quick calibration instruction, and further obtain the positioning information of the air mouse device at the current moment according to the quick calibration instruction. The positioning information is also the position information of the air mouse device.

[0063] S120: Determine the projection point position of the air mouse device according to the positioning information;

[0064] It is understandable that after the positioning information of the air mouse device is determined, the projection point position information of the projection point of the air mouse device can be further determined according to the positioning information of the air mouse device.

[0065] S130: When it is determined according to the position of the projection point that the projection point is outside the display device, controlling the cursor in the display device to move to an edge point position closest to the projection point;

[0066] Specifically, after obtaining the projection point position of the air mouse device, it is possible to further determine whether the projection point is within the range of the display device or outside the range of the display device according to the projection point position and the position of the display device. If the projection point is outside the range of the display device, the cursor of the display device may not be located at the edge of the display device. In order to improve the calibration efficiency, the cursor in the display device may be controlled to move to the edge point position closest to the projection point, such as Figure 4 shown.

[0067] S140: When it is determined according to the position of the projection point that the projection point is located within the display device, control the cursor within the display device to move to within the projection range of the projection point.

[0068] If the projection point is within the range where the display device is located, the cursor of the display device can be directly moved to the projection range of the projection point, wherein the projection range can be a circular range with the projection point as the center and a preset length as the radius. For details, please refer to Figure 4 Specifically, the cursor can be moved to the projection point position so that the projection point and the cursor can be quickly overlapped. There is no need for the user to manually control the air mouse device to exit the air mouse state and then move the air mouse device again to control the projection point and the cursor to overlap, and then switch the air mouse device to the air mouse state. This can improve the efficiency of cursor calibration and enhance the user experience.

[0069] It should be noted that, when the projection point is outside the display device, after controlling the cursor in the display device to move to the edge point closest to the projection point, the projection point is still outside the display device, and the cursor in the display device has not yet been able to coincide with the projection point. The user can move the air mouse device at will again, and the user can still calibrate the cursor again by pressing the quick calibration button. As long as the projection point is outside the display device, the cursor position can be adjusted so that the cursor is closest to the projection point, so that when the projection point is inside the display device, the cursor and the projection point can be quickly coincided, thereby improving adjustment efficiency and user experience.

[0070] In actual applications, the above-mentioned quick calibration operation can be automatically performed as soon as the air mouse device enters the air mouse state, so that the position relationship between the projection point and the cursor can be adjusted without the user's active operation in the first moment after the air mouse device enters the air mouse state, thereby improving the use experience of the air mouse device. Of course, during the use of the air mouse device in the air mouse state, if there is a problem that the projection point and the cursor do not coincide, the user can also trigger a quick calibration operation, and quickly adjust the position relationship between the projection point and the cursor through the method provided in the embodiment of the present invention, without the need to exit the air mouse state and then perform manual calibration, thereby improving calibration efficiency and user experience.

[0071] In one implementation, the process of obtaining the positioning information of the air mouse device in S110 may include:

[0072] Get the distance between the air mouse device and the preset position on the display device;

[0073] Based on the coordinate information and distance of the preset position, determine the positioning information of the air mouse device.

[0074] It should be noted that, in the embodiment of the present invention, the distance between the air mouse device and the preset position on the display device at the current moment can be obtained, and the positioning information of the air mouse device at the current moment can be determined according to the coordinate information of the preset position and the corresponding distance.

[0075] In actual applications, three preset positions can be determined on the display device, namely the first preset position, the second preset position and the third preset position, and corresponding positioning modules are respectively set at different preset positions. For example, a first Bluetooth module is set at the first preset position, a second Bluetooth module is set at the second preset position, and a third Bluetooth module is set at the third preset position. Corresponding positioning modules are also set on the corresponding air mouse devices. The positioning module on the air mouse device is used to communicate with the corresponding positioning module on the display device to obtain the corresponding distance.

[0076] That is, when measuring distance, the first distance between the air mouse device and the first preset position can be obtained through the first Bluetooth module; the second distance between the air mouse device and the second preset position can be obtained through the second Bluetooth module; and the third distance between the air mouse device and the third preset position can be obtained through the third Bluetooth module.

[0077] Assume that the distances from the air mouse device to the three Bluetooth modules on the display device are d1, d2, and d3 respectively. Each distance can be calculated in turn according to the relationship d = 10^((abs(RSSI)-A) / (10×n)), where RSSI (Received Signal Strength Indication) is the received signal strength, A is the signal strength when the transmitter and receiver are 1 meter apart, n is the environmental attenuation factor, and abs(RSSI) means the absolute value of RSSI.

[0078] Furthermore, the process of determining the positioning information of the air mouse device based on the coordinate information and distance of the preset position may include:

[0079] Establishing a first spherical surface with the first preset position as the sphere center and the first distance corresponding to the first preset position as the radius;

[0080] Establishing a second spherical surface with the second preset position as the sphere center and the second distance corresponding to the second preset position as the radius;

[0081] Establishing a third spherical surface with the third preset position as the sphere center and the third distance corresponding to the third preset position as the radius;

[0082] According to the intersection points of the first spherical surface, the second spherical surface and the third spherical surface, the positioning information of the air mouse device is obtained.

[0083] It should be noted that in the embodiment of the present invention, spherical surfaces are drawn with the first preset position, the second preset position and the third preset position as the sphere center and the corresponding distances as the radius, thereby obtaining three spherical surfaces, and further determining the intersection of the three spherical surfaces to obtain the positioning information of the air mouse device.

[0084] In practical applications, such as Figure 5 As shown, it is assumed that there is a spatial rectangular coordinate system Oxyz in space, whose x-axis and y-axis form a plane rectangular coordinate system Oxy. Figure 5 The rectangular box in the figure represents the display screen, which is located in the plane rectangular coordinate system Oxy. Three Bluetooth modules are placed on the display device. Of course, in addition to the Bluetooth module, the module that realizes positioning can also be Uwb (UltraWide Band, ultra-wideband) module, etc. The spatial position of each Bluetooth module is located in the plane rectangular coordinate system Oxy. The coordinates of the first Bluetooth module, the second Bluetooth module and the third Bluetooth module are known data (xm, ym, 0), (xn, yn, 0), (xr, yr, 0), respectively. The corresponding positioning module is also included in the air mouse device for communicating with the corresponding positioning module on the display device. For example, the distances measured by the first Bluetooth module, the second Bluetooth module and the third Bluetooth module are d1, d2, and d3, respectively. The positions of the first Bluetooth module, the second Bluetooth module and the third Bluetooth module can be used as the center of the sphere, and the corresponding d1, d2, and d3 can be used as their respective radii to obtain three spherical surfaces. The intersection of the three spherical surfaces is the point that satisfies the distances d1, d2, and d3 to the three positioning modules. Specifically, the following equations can be obtained:

[0085] (x-xm) 2 +(y-ym) 2 +z 2 =d1 2 ;

[0086] (x-xn) 2 +(y-yn) 2 +z 2 =d2 2 ;

[0087] (x-xr) 2 +(y-yr) 2 +z 2 =d3 2 ;

[0088] By solving the above equations, we know that the three spheres have two intersection points, namely the first intersection point and the second intersection point, where one intersection point is located in front of the display screen (that is, on the same side of the display screen as the air mouse device), and one intersection point is located behind the display screen (that is, on a different side of the display screen as the air mouse device). Since the user is in front of the display screen when using the air mouse device normally, the intersection point located in front of the display screen can be determined as the current position of the air mouse device in space, that is, the intersection point of the first intersection point and the second intersection point on the same side of the display screen as the air mouse device is determined as the positioning point of the air mouse device, and the corresponding positioning information is obtained.

[0089] Since the position of the mouse device is likely to change each time it is turned off and then turned on again, and the mouse device cannot detect the position information during the shutdown period, the angle between the mouse device's pointing line and the plane where the display screen is located is likely to have changed. Therefore, each time the mouse device is restarted, the projection point position cannot be determined, and the projection point and cursor position may deviate greatly. This situation is similar to Figure 1As shown in the figure, when directly entering the empty mouse state at this time, the projection point position calculated by the empty mouse device is likely to be wrong, so the quick calibration automatically performed by the empty mouse device when entering the empty mouse state and the quick calibration triggered by the subsequent user button cannot really make the cursor move to coincide with the projection point. For this reason, after the empty mouse device is turned off and then turned on again, an initial active calibration operation can be performed on the empty mouse device, that is, after the empty mouse device is turned on and before entering the empty mouse state, the user actively moves the position and angle of the empty mouse device so that the projection point of the empty mouse device coincides with the cursor position on the display screen. After the coincidence, press the active calibration key, and an active calibration instruction will be generated. After receiving the active calibration instruction, the empty mouse device can determine that the projection point and the cursor position coincide in the current state. When the empty mouse device calculates the projection point position again, it will calculate based on this data to ensure the correctness of the calculated projection point position, and then enter the empty mouse state to complete the active calibration operation, and automatically perform the above-mentioned quick calibration operation as soon as the empty mouse device enters the empty mouse state.

[0090] In addition, it should be noted that the active calibration operation in the embodiment of the present invention is not limited to use after shutting down and restarting the computer, but can also be used when the user finds that the deviation between the cursor and the projection point is large after a quick calibration when using an air mouse.

[0091] It should be noted that the active calibration operation implemented in the present invention is different from the active manual calibration of an ordinary empty mouse. The active manual calibration of an ordinary empty mouse is to exit the empty mouse state, move the device so that the projection point and the cursor coincide, and then enter the empty mouse state to complete the active manual calibration; while the active calibration in the embodiment of the present invention is to exit the empty mouse state, move the device so that the projection point and the cursor coincide, and then trigger the active calibration instruction by pressing a button. After detecting the active calibration instruction, the device determines that the projection point and the cursor position coincide in the current state. At this time, the current data is saved as the data used for subsequent quick calibration, and then enter the empty mouse state to complete the active calibration. The empty mouse device in the embodiment of the present invention can be set with an empty mouse state switch key, a quick calibration key, and an active calibration key. The three keys can be reused in the same key, or three keys can be used to implement it. There can be multiple different implementation methods, for example:

[0092] Implementation method 1: A single click of button 1 is used to switch between the empty mouse state and the non-empty mouse state. A single click of button 2 in the empty mouse state can be used as a quick calibration button. A single click of button 2 in the non-empty mouse state can be used as an active calibration button.

[0093] Implementation method 2: A single click of button 1 is used to switch between the empty mouse state and the non-empty mouse state, a single click of button 2 can be used as a quick calibration button, and a single click of button 3 can be used as an active calibration button.

[0094] In one embodiment, the process of determining the projection point position of the air mouse device according to the positioning information may include:

[0095] Obtain the historical time of the last positioning and the historical positioning information of the air mouse device;

[0096] Get the acceleration data and angular velocity data of the empty mouse device from the historical moment to the current moment;

[0097] Calculate the movement increment and rotation angle increment of the air mouse device based on historical positioning information, historical time, acceleration data and angular velocity data;

[0098] According to the historical positioning information, movement increment and rotation angle increment, the projection point position of the air mouse device at the current moment is determined.

[0099] It should be noted that when the air mouse device is in the air mouse state, if the projection point and the cursor do not coincide during the user's use, the user can trigger the quick calibration button and obtain the current positioning information of the air mouse device, as well as the historical moment and corresponding historical positioning information when the air mouse device was last positioned, and then obtain the acceleration data and angular velocity data of the air mouse device from the historical moment to the current moment. The acceleration data includes the acceleration values ​​of the air mouse device in the three directions of the xyz axis at different moments, and the angular velocity data includes the angular velocity values ​​of the air mouse device rotating around the xyz axis at different moments. For example, the acceleration values ​​of the air mouse device in the three directions of the xyz axis can be represented by ax(t), ay(t), and az(t), respectively, and the angular velocity values ​​of the air mouse device rotating around the xyz axis can be represented by ωx(t), ωy(t), and ωz(t), respectively, where t is time. According to the historical positioning information, historical time, acceleration data and angular velocity data, the movement increment and rotation angle increment of the air mouse device are calculated. For example, in the time period from t1 to t2, the movement increments △x, △y, and △z of the air mouse device on the xyz axis can be calculated using the following formulas:

[0100] ;

[0101] ;

[0102] ;

[0103] Here, u represents time.

[0104] The rotation angle increments △α, △β, and △γ of the air mouse device around the xyz axis can be calculated using the following formulas:

[0105] ;

[0106] ;

[0107] .

[0108] Specifically, the projection point position of the air mouse device at the current moment can be determined according to the historical positioning information, the movement increment and the rotation angle increment.

[0109] It should be noted that since the cursor position can be obtained by the display device, the angle of the pointing line of the air mouse device can also be obtained after calibration. The moving distance and rotation angle of the air mouse device in space can be calculated through the motion data detected by the motion sensor.

[0110] For example, Figure 6 As shown, at time t1, the mouse device is located at point m, the coordinates of point m are (x3, y3, z3), and the projection point has been adjusted to coincide with the cursor at point n on the display screen, the coordinates of point n are (x1, y1, 0), at time t2, the mouse device is located at point a, the coordinates of point a are (x4, y4, z4), the coordinates of point a can be obtained by the positioning information obtained in the above manner, or calculated by the coordinates of the mouse device at time t1 and the motion sensor movement data (x3+△x, y3+△y, z3+△y), at time t2, the projection point is located at point b with coordinates (x2, y2, 0), wherein the position of the projection point at time t2 can be obtained by the following method:

[0111] During the time period from t1 to t2, the rotation angle increments of the air mouse device around the x, y, and z axes are △α, △β, and △γ respectively. △α, △β, and △γ can be calculated through the movement data of the motion sensor. Figure 7 As shown, the angle between the projection of |mn| on the yOz plane and the positive direction of the y axis is α, the angle between the projection on the zOx plane and the positive direction of the z axis is β, and the angle between the projection on the xOy plane and the positive direction of the x axis is γ, which can be calculated according to the formulas: α= arctan((-z3) / (y1-y3)), β= arctan((x1-x3) / (-z3)), γ=arctan((y1-y3) / (x1-x3)). The angle between the projection of |ab| on the yOz plane and the positive direction of the y axis is α+△α, the angle between the projection on the zOx plane and the positive direction of the z axis is β+△β, and the angle between the projection on the xOy plane and the positive direction of the x axis is γ+△γ. According to the equation group:

[0112] tan(α+△α) = (-z4) / (y-y4)

[0113] tan(β+△β) = (x2-x4) / (-z4)

[0114] tan(γ+Δγ) = (y2-y4) / (x-x4)

[0115] It can be obtained that x2 = x4 - tan(β+△β)×z4, y2 = y4 - z4 / tan(α+△α), from which the coordinates of the projection point (x2, y2, 0) can be obtained. When using the key quick calibration, if the projection point is on the display screen, adjust the cursor to the position of the display screen corresponding to the coordinates to make the cursor coincide with the projection point position.

[0116] It should be noted that after the air mouse device is turned on and before entering the air mouse state, the air mouse device undergoes the above-mentioned active calibration operation (that is, the user actively moves the position and angle of the air mouse device so that the projection point of the air mouse device coincides with the cursor position on the display screen, and presses the active calibration key after the coincidence to generate an active calibration instruction. The air mouse device determines the overlap of the projection point and the cursor position in the current state based on the active calibration instruction, calculates the projection point position, and records the data before entering the air mouse state). After the active calibration, the position of the air mouse device at each moment and the angle information of the pointing line can be calculated based on the data recorded during the active calibration operation, and the projection point position can be calculated. When the user uses the quick calibration operation, the cursor can be quickly moved to the vicinity of the projection point without the user actively adjusting the position of the air mouse device to achieve calibration.

[0117] In addition, the position of the positioning module on the display device can be set at the edge of the display screen, but is not limited to being located at the edge of the display screen. The positioning module is not necessarily in the same plane as the display screen. There can be more than one positioning module. The positioning information of the air mouse device can be calculated based on the actual number and position of the positioning modules. The positioning module in the embodiment of the present invention can be implemented using a Bluetooth module, or a Uwb positioning module, such as using Figure 8 The Uwb positioning TOF (time offlight, time of flight) ranging method shown below obtains the distance between the air mouse device and the positioning module:

[0118] For example, when devices A and B send signals to each other, A sends a signal to A first. After A receives the signal, it waits for a while and then sends a signal to A. The distance calculation formula is d = c*((T4- T1)-( T3- T2)) / 2, where c is the speed of light, T1 is the time when a sends the signal, T2 is the time when b receives the signal, T3 is the time when b sends the signal, and T4 is the time when a receives the signal; TF is the time that data (such as POLL packet) flies in the air, Tdelay is the processing time after device b receives the POLL packet, and the distance between devices a and b is Range=((t4-t1-Tdelay) / 2)*the speed of light.

[0119] It can be seen that in the embodiment of the present invention, when a cursor quick calibration instruction is received, the positioning information of the air mouse device is obtained, and then the projection point position of the air mouse device is determined according to the positioning information. According to the relationship between the projection point position and the display device, if the projection point is outside the display device, the cursor in the display device is controlled to move to the edge point position closest to the projection point; if the projection point is inside the display device, the cursor in the display device is controlled to move to the projection range of the projection point, thereby improving the cursor calibration efficiency and helping to enhance the user experience.

[0120] It is also necessary to explain that the embodiment of the present invention uses a quick calibration button to perform a quick calibration operation, which solves the problem that the traditional air mouse technology requires the user to manually move the air mouse device frequently for calibration. The user's operation is further simplified by the automatic quick calibration operation in the air mouse state. Furthermore, the quick calibration operation of the present invention will only calibrate in an instant, and the cursor will be moved in a short time. There will be no experience problem that the cursor automatically moves within a few seconds due to continuous automatic calibration for several seconds when the device is not moved. In addition, in the present application, when the user needs it, clicking the quick calibration button can conveniently calibrate, and the amount of data calculation and communication data as well as the occupied hardware resources are low, which can not only improve the user experience, but also is beneficial to the performance of the title device.

[0121] The present invention also provides a corresponding device for the cursor control method, which further makes the method more practical. Among them, the device can be described from the perspective of functional modules and hardware. The cursor control device provided by the present invention is introduced below. The device is used to implement the cursor control method provided by the present invention. In this embodiment, the cursor control device may include or be divided into one or more program modules, and the one or more program modules are stored in a storage medium and executed by one or more processors to complete the cursor control method disclosed in the above embodiment. The program module referred to in the present invention refers to a series of computer program instruction segments that can complete specific functions, which is more suitable for describing the execution process of the cursor control device in the storage medium than the program itself. The following description will specifically introduce the functions of each program module of this embodiment. The cursor control device described below and the cursor control method described above can be referenced to each other.

[0122] From the perspective of functional modules, see Fig. 9 , Fig. 9 A structural diagram of a cursor control device provided by the present invention in a specific embodiment, the device may include:

[0123] The first acquisition module 11 is used to acquire the positioning information of the air mouse device according to the cursor quick calibration instruction;

[0124] The first determination module 12 is used to determine the projection point position of the air mouse device according to the positioning information;

[0125] A first control module 13, configured to control a cursor in the display device to move to an edge point position closest to the projection point when it is determined according to the position of the projection point that the projection point is outside the display device;

[0126] The second control module 14 is used to control the cursor in the display device to move to the projection range of the projection point when it is determined that the projection point is located in the display device according to the position of the projection point.

[0127] In one implementation, the first acquisition module 11 includes:

[0128] A first acquisition unit is used to acquire the distance between the air mouse device and a preset position on the display device;

[0129] The first determining unit is used to determine the positioning information of the air mouse device based on the coordinate information and distance of the preset position.

[0130] In one implementation, the first acquisition unit includes:

[0131] A first acquisition subunit, configured to acquire a first distance between the air mouse device and the first preset position through a first Bluetooth module disposed at a first preset position on the display device;

[0132] A second acquisition subunit is used to acquire a second distance between the air mouse device and the second preset position through a second Bluetooth module arranged at a second preset position on the display device;

[0133] The third acquisition subunit is used to acquire a third distance between the air mouse device and the third preset position through a third Bluetooth module arranged at a third preset position on the display device.

[0134] In one implementation, the first determining unit includes:

[0135] A first establishing subunit is used to establish a first spherical surface with a first preset position as the sphere center and a first distance corresponding to the first preset position as the radius;

[0136] A second establishing subunit is used to establish a second spherical surface with a second preset position as the sphere center and a second distance corresponding to the second preset position as the radius;

[0137] A third establishing subunit is used to establish a third spherical surface with a third preset position as the sphere center and a third distance corresponding to the third preset position as the radius;

[0138] The first determining subunit is used to obtain the positioning information of the air mouse device according to the intersection points of the first spherical surface, the second spherical surface and the third spherical surface.

[0139] In one implementation, the first determining subunit includes:

[0140] A second acquisition subunit is used to acquire a first intersection point and a second intersection point of the first spherical surface, the second spherical surface and the third spherical surface;

[0141] A second determining subunit is used to determine the intersection of the first intersection and the second intersection, which is located on the same side of the display as the air mouse device, as a positioning point of the air mouse device;

[0142] The third acquisition subunit is used to acquire the positioning information of the positioning point.

[0143] In one implementation, the first determining module 12 includes:

[0144] The fourth acquisition subunit is used to obtain the historical time of the last positioning and the historical positioning information of the air mouse device;

[0145] The fifth acquisition subunit is used to acquire the acceleration data and angular velocity data of the air mouse device from the historical moment to the current moment;

[0146] The first calculation subunit is used to calculate the movement increment and rotation angle increment of the air mouse device according to the historical positioning information, historical time, acceleration data and angular velocity data;

[0147] The third determination subunit is used to determine the projection point position of the air mouse device at the current moment according to the historical positioning information, the movement increment and the rotation angle increment.

[0148] In one embodiment, the cursor quick calibration instruction is generated when a quick calibration button provided on the air mouse device is triggered.

[0149] It should be noted that the cursor control device provided in the embodiment of the present invention has the same beneficial effects as the cursor control method provided in the above embodiment, and the introduction of the cursor control method involved in the embodiment of the present invention can refer to the above embodiment, and the embodiment of the present invention will not be repeated here.

[0150] The cursor control device mentioned above is described from the perspective of functional modules. Further, the present invention also provides a cursor control device, which is described from the perspective of hardware. The cursor control device includes:

[0151] Memory for storing computer programs;

[0152] The processor is used to implement the steps of the cursor control method in the above embodiment when executing a computer program.

[0153] The cursor control device in the embodiment of the present invention may include an air mouse device, or may include an air mouse device and a display device (ie, a display device).

[0154] Among them, the processor may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 21 can be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content that the display device needs to display. In some embodiments, the processor may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0155] The memory may include one or more computer-readable storage media, which may be non-transitory. The memory may also include high-speed random access memory, and non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the memory may be an internal storage unit of the air mouse device, such as a hard disk of a server. In other embodiments, the memory may also be an external storage device of an electronic device, such as a plug-in hard disk equipped on a server, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. Further, the memory may also include both an internal storage unit of the electronic device and an external storage device. The memory may not only be used to store application software and various types of data installed in the electronic device, such as: the code of the program in the process of executing the cursor control method, etc., but also be used to temporarily store data that has been output or is to be output. In this embodiment, the memory is at least used to store the following computer program, wherein, after the computer program is loaded and executed by the processor, the relevant steps of the cursor control method disclosed in any of the aforementioned embodiments can be implemented. In addition, the resources stored in the memory may also include an operating system and data, etc., and the storage method may be temporary storage or permanent storage. Among them, the operating system may include Windows, Unix, Linux, etc. The data may include but is not limited to (data corresponding to the cursor control result) and the like.

[0156] It is understandable that if the cursor control method in the above embodiment is implemented in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium to execute all or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), electrically erasable programmable ROM, register, hard disk, removable disk, CD-ROM, magnetic disk or optical disk and other media that can store program code.

[0157] Based on this, as shown in the figure, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the cursor control method as described above are implemented.

[0158] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0159] It should also be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0160] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A cursor control method, characterized in that: include: According to the cursor quick calibration command, obtain the positioning information of the air mouse device; Determine the projection point position of the air mouse device according to the positioning information; When it is determined according to the position of the projection point that the projection point is outside the display screen of the display device, controlling the cursor in the display screen to move to the edge point position closest to the projection point; When it is determined according to the position of the projection point that the projection point is located within the display screen, the cursor within the display screen is controlled to move to within the projection range of the projection point.

2. The cursor control method according to claim 1, characterized in that: The obtaining of the positioning information of the air mouse device includes: Acquire the distance between the air mouse device and a preset position on the display device; Based on the coordinate information of the preset position and the distance, the positioning information of the air mouse device is determined.

3. The cursor control method according to claim 2, characterized in that: The obtaining of the distance between the air mouse device and a preset position on the display device includes: Acquire a first distance between the air mouse device and the first preset position by a first Bluetooth module disposed at a first preset position on the display device; Acquire a second distance between the air mouse device and the second preset position by a second Bluetooth module disposed at a second preset position on the display device; The third distance between the air mouse device and the third preset position is obtained through a third Bluetooth module arranged at a third preset position on the display device.

4. The cursor control method according to claim 3, characterized in that: The determining the positioning information of the air mouse device based on the coordinate information of the preset position and the distance includes: Establishing a first spherical surface with a first preset position as the center and a first distance corresponding to the first preset position as the radius; Establishing a second spherical surface with the second preset position as the sphere center and the second distance corresponding to the second preset position as the radius; Establishing a third spherical surface with a third preset position as the sphere center and a third distance corresponding to the third preset position as the radius; The positioning information of the air mouse device is obtained according to the intersection points of the first spherical surface, the second spherical surface and the third spherical surface.

5. The cursor control method according to claim 4, characterized in that: The obtaining the positioning information of the air mouse device according to the intersection of the first spherical surface, the second spherical surface and the third spherical surface includes: Obtain a first intersection point and a second intersection point of the first spherical surface, the second spherical surface, and the third spherical surface; Determine the intersection point between the first intersection point and the second intersection point, which is located on the same side of the display as the air mouse device, as the positioning point of the air mouse device; Obtain the positioning information of the positioning point.

6. The cursor control method according to any one of claims 1 to 5, characterized in that: Determining the projection point position of the air mouse device according to the positioning information includes: Obtain the historical time of the last positioning and the historical positioning information of the air mouse device; Obtaining acceleration data and angular velocity data of the air mouse device from the historical moment to the current moment; Calculate the movement increment and rotation angle increment of the air mouse device according to the historical positioning information, the historical time, the acceleration data and the angular velocity data; The projection point position of the air mouse device at the current moment is determined according to the historical positioning information, the movement increment and the rotation angle increment.

7. The cursor control method according to claim 6, characterized in that: The cursor quick calibration instruction is generated when a quick calibration button arranged on the air mouse device is triggered.

8. A cursor control device, characterized in that: include: The first acquisition module is used to acquire the positioning information of the air mouse device according to the cursor quick calibration instruction; A first determination module, used to determine the projection point position of the air mouse device according to the positioning information; A first control module, configured to control a cursor in the display screen to move to an edge point position closest to the projection point when it is determined according to the position of the projection point that the projection point is outside the display screen of the display device; The second control module is used for controlling the cursor in the display screen to move to within the projection range of the projection point when it is determined that the projection point is located in the display screen according to the position of the projection point.

9. A cursor control device, characterized in that: include: Memory for storing computer programs; A processor, configured to implement the steps of the cursor control method according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the cursor control method according to any one of claims 1 to 7 are implemented.

Images