A real-time response method for an air mouse

Abstract

The present invention relates to mouse control, and particularly to a real-time response method for an air mouse. The initial mouse state is collected, and the real-time mouse state is switched by detecting the mouse movement state and contact situation; the current air attitude of the mouse is detected, and the current air attitude of the mouse is fitted and classified; the real-time cursor movement distance is calculated according to the current air attitude category of the mouse. The technical solution provided by the present invention can effectively overcome the defects existing in the prior art, such as the need to frequently manually switch the mouse state during use and the inability to perform precise real-time response according to the air movement trajectory of the mouse.

Description

Technical Field

[0001] The present invention relates to mouse control, and particularly to a real-time response method for an air mouse. Background Art

[0002] A mouse is an external input device of a computer and also an indicator for positioning the horizontal and vertical coordinates of a computer display system. It is named after its resemblance to a mouse. Its standard name should be "mouse device". The use of a mouse is to make the operation of a computer more convenient and fast, replacing the cumbersome instructions input by the keyboard. With the development in recent years, the basic functions of a mouse have been difficult to meet people's daily use needs. People have tried to use the mouse as a carrier and expand its functions and roles on this basis to achieve more functions. For example, the currently popular air mouse on the market can perform basic operations such as clicking and moving the mouse in a handheld state compared to a traditional mouse. And a laser pointer is configured in it, and the left and right buttons support properties of a presenter such as page turning up and down, expanding the mouse from traditional home and office scenarios to meeting scenarios, realizing "one mouse for multiple uses".

[0003] However, currently available air mice on the market all need to set up independent switching buttons to switch between the functions of the presenter and the basic functions of the mouse. It needs to be switched once when picking up and using the presenter function, and switched again when putting down and using the basic mouse function. This results in the need to frequently switch the mouse state during use to cope with different usage scenarios. Summary of the Invention

[0004] (I) Technical Problems to be Solved

[0005] In view of the above-mentioned drawbacks of the prior art, the present invention provides a real-time response method for an air mouse, which can effectively overcome the defects of the prior art that it is necessary to frequently manually switch the mouse state during use and cannot perform precise real-time response according to the air movement trajectory of the mouse.

[0006] (II) Technical Solutions

[0007] To achieve the above object, the present invention is realized through the following technical solutions:

[0008] A real-time response method for an air mouse includes the following steps:

[0009] S1. Collect the initial mouse state and switch the real-time mouse state by detecting the mouse movement state and contact situation;

[0010] S2. Detect the current air attitude of the mouse and fit and classify the current air attitude of the mouse;

[0011] S3. Calculate the real-time cursor movement distance according to the current mouse in-air attitude category.

[0012] Preferably, in S1, the initial mouse state is collected, and the real-time mouse state is switched by detecting the mouse movement state and contact situation, including:

[0013] If the initial mouse state is the "air mouse" mode, then when it is detected that the mouse moves on the contact surface, the real-time mouse state is switched to the "optical sensor" mode; otherwise, the real-time mouse state remains the "air mouse" mode.

[0014] If the initial mouse state is the "optical sensor" mode, then when no contact surface is detected, the real-time mouse state is switched to the "air mouse" mode; otherwise, the real-time mouse state remains the "optical sensor" mode.

[0015] Preferably, when it is detected that the mouse moves on the contact surface and the real-time mouse state is switched to the "optical sensor" mode, it includes:

[0016] The optical navigation sensor detects the mouse movement trajectory with a detection period of 7.5 ms. When more than 35 movements are detected within 500 ms, it is determined that the mouse moves on the contact surface, the real-time mouse state is switched to the "optical sensor" mode, and at the same time, the acceleration sensor and the gyroscope sensor are turned off.

[0017] Preferably, when no contact surface is detected and the real-time mouse state is switched to the "air mouse" mode, it includes:

[0018] If the average value of the image quality detected by the optical navigation sensor is greater than 200 and the average brightness value is less than 30, it is determined that the mouse does not contact any surface, the real-time mouse state is switched to the "air mouse" mode, and at the same time, the acceleration sensor and the gyroscope sensor are enabled.

[0019] Preferably, in S2, the current mouse in-air attitude is detected and the current mouse in-air attitude is fitted and classified, including:

[0020] The current mouse in-air attitude is detected by the acceleration sensor, and the mouse in-air attitude with the mouse head facing forward is fitted and classified as the first attitude, the mouse in-air attitude with the mouse head facing upward is fitted and classified as the second attitude, and the mouse in-air attitude with the mouse head facing downward is fitted and classified as the third attitude.

[0021] Preferably, in the first attitude, the mouse head points to the positive direction of the Y axis; in the second attitude, the positive direction of the Y axis is perpendicular to the bottom surface of the mouse; in the third attitude, the positive direction of the Y axis is perpendicular to the top surface of the mouse.

[0022] Preferably, calculating the real-time cursor movement distance according to the current in-air mouse attitude category in S3 includes:

[0023] Calculating the real-time cursor movement distance through a gyroscope sensor, specifically including:

[0024] When the current in-air mouse attitude is the first attitude, calculate the real-time cursor movement distance through the following formula:

[0025] Δx = -Aω Z

[0026] Δy = Bω X ;

[0027] When the current in-air mouse attitude is the second attitude, calculate the real-time cursor movement distance through the following formula:

[0028] Δx = Aω Y

[0029] Δy = Bω X ;

[0030] When the current in-air mouse attitude is the third attitude, calculate the real-time cursor movement distance through the following formula:

[0031] Δx = -Aω Y

[0032] Δy = Bω X ;

[0033] Wherein, Δx is the distance that the cursor moves along the X-axis direction, Δy is the distance that the cursor moves along the Y-axis direction, Δz is the distance that the cursor moves along the Z-axis direction, both A and B are constants, ω X is the angular velocity of the X-axis of the sensor, ω Y is the angular velocity of the Y-axis of the sensor, ω Z is the angular velocity of the Z-axis of the sensor.

[0034] (III) Beneficial Effects

[0035] Compared with the prior art, the real-time response method for an air mouse provided by the present invention has the following beneficial effects:

[0036] 1) Compared with traditional air mice, it is equipped with a PAW optical navigation sensor with an image quality algorithm, which can automatically calculate the current state of the mouse, realize the automatic switching of the working state between the optical sensor and the six-axis sensor, and there is no need to manually switch the mouse state, truly enabling "pick up and use".

[0037] 2) By using an acceleration sensor and a gyroscope sensor, the three-dimensional state of the current mouse in the air is detected in real time, and the movement trajectory of the mouse is calculated based on the current in-air posture of the mouse. That is to say, no matter what posture the mouse is held and moved in the air, accurate calculation and real-time response can be performed. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0039] Figure 1 is a schematic flowchart of the present invention;

[0040] Figure 2 is a schematic flowchart of switching the real-time mouse state by detecting the mouse movement state and contact situation in the present invention;

[0041] Figure 3 is a schematic diagram of the in-air posture of the mouse in the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0042] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art without creative efforts based on the embodiments of the present invention belong to the scope of protection of the present invention.

[0043] A real-time response method for an air mouse, as Figure 1 and Figure 2 shown, ① Collect the initial mouse state, and switch the real-time mouse state by detecting the mouse movement state and contact situation, specifically including:

[0044] If the initial mouse state is the "air mouse" mode (corresponding to the presenter function), then when it is detected that the mouse moves on the contact surface, the real-time mouse state is switched to the "optical sensor" mode (corresponding to the basic function of the mouse), otherwise the real-time mouse state maintains the "air mouse" mode;

[0045] If the initial mouse state is the "optical sensor" mode, then when no contact surface is detected, the real-time mouse state is switched to the "air mouse" mode, otherwise the real-time mouse state maintains the "optical sensor" mode.

[0046] 1) When it is detected that the mouse moves on the contact surface, switch the real-time mouse state to the "optical sensor" mode, including:

[0047] The optical navigation sensor detects the movement trajectory of the mouse with a detection period of 7.5 ms. When more than 35 movements are detected within 500 ms (the movement is detected by detecting the change of the particulate points on the contact surface), it is determined that the mouse moves on the contact surface, switch the real-time mouse state to the "optical sensor" mode, and at the same time turn off the acceleration sensor and the gyroscope sensor.

[0048] 2) When no contact surface is detected, switch the real-time mouse state to the "air mouse" mode, including:

[0049] If the average value of the image quality detected by the optical navigation sensor is greater than 200 and the average brightness value is less than 30, it is determined that the mouse is not in contact with any surface, switch the real-time mouse state to the "air mouse" mode, and at the same time enable the acceleration sensor and the gyroscope sensor (at this time, the optical navigation sensor is not turned off, and the optical navigation sensor still detects the movement trajectory of the mouse).

[0050] In the technical solution of this application, the optical navigation sensor uses the PAW3220DB-TJDS sensor, which supports SPI communication. By optically obtaining continuous contact surface images (frames) and the change value of the particulate points on the contact surface, the speed, direction, and movement amplitude are determined to detect the change of the mouse position in the plane. The displacements X and Y are in the register and are accessed through the SPI serial interface.

[0051] At the same time, this sensor can obtain the image quality and brightness in the plane. The average values of the image quality and brightness corresponding to different materials are shown in the following table:

[0052] Material Average image quality Average brightness Black mouse pad 68 26 Blue mouse pad 68 28 Original color wooden board 57 48 White A4 paper 82 77 Red A4 paper 82 63 Yellow A4 paper 82 67 Blue A4 paper 82 73 White tile 119 120 Marble 54 75 Silver steel plate 103 89 Black leather pad 78 76 Transparent glass (4 cm thick) 130 100 Red wool pad 65 23 None 235 11

[0053] The average value of the image quality reflects the roughness of the surface. The rougher the surface, the lower the average value of the image quality; the average brightness value reflects the light reflection characteristics of the surface. Since the LED used in the sensor is a blue light-emitting diode, this light reflection characteristic specifically refers to the ability to reflect blue light. The better the light reflection characteristic, the higher the average brightness value.

[0054] It can be seen from the data in the above table that the smoother the surface, the better the light reflection characteristic. Only when the sensor is not in contact with any surface, the detected average value of the image quality is large and the average brightness value is small. Therefore, it is possible to judge whether the sensor is in contact with the surface through the average value of the image quality and the average brightness value.

[0055] Such as Figure 1 and Figure 3As shown in the figure, ② detect the current in-air posture of the mouse and fit and classify the current in-air posture of the mouse. Specifically, it includes:

[0056] Detect the current in-air posture of the mouse through the acceleration sensor, and fit and classify the in-air posture of the mouse with its head facing forward as the first posture, the in-air posture of the mouse with its head facing upward as the second posture, and the in-air posture of the mouse with its head facing downward as the third posture.

[0057] In the first posture, the mouse head points to the positive direction of the Y-axis. In the second posture, the positive direction of the Y-axis is perpendicular to the bottom surface of the mouse. In the third posture, the positive direction of the Y-axis is perpendicular to the top surface of the mouse.

[0058] In the technical solution of this application, considering the actual usage of the mouse, there are a total of six standard in-air postures of the mouse as shown in the figure. Among them, (a) is the conventional in-air posture of the mouse, with the top surface of the mouse facing upward and the mouse head facing forward and pointing to the positive direction of the Y-axis. (b), (c), and (d) are the same as (a), and the mouse heads all face forward and point to the positive direction of the Y-axis. (a), (b), (c), and (d) are the first postures. Figure 3 In (e), the mouse head faces upward, and the bottom surface of the mouse is used to determine the positive direction of the Y-axis. (e) is the second posture; in (f), the mouse head faces downward, and the top surface of the mouse is used to determine the positive direction of the Y-axis. (f) is the third posture.

[0059] As shown in the figure and the figure, ③ calculate the real-time cursor movement distance according to the current in-air posture category of the mouse. Specifically, it includes:

[0060] As Figure 1 and Figure 3 shown, calculate the real-time cursor movement distance through the gyroscope sensor:

[0061] 1) When the current in-air posture of the mouse is the first posture (as shown in (a), (b), (c), and (d)), calculate the real-time cursor movement distance through the following formula:

[0062] 1) When the current in-air posture of the mouse is the first posture (as shown in (a), (b), (c), and (d)), calculate the real-time cursor movement distance through the following formula: Figure 3 shown in (a), (b), (c), and (d)), calculate the real-time cursor movement distance through the following formula:

[0063] Δx = -Aω Z

[0064] Δy = Bω X ;

[0065] 2) When the current in-air posture of the mouse is the second posture (as shown in (e)), calculate the real-time cursor movement distance through the following formula: Figure 3 shown in (e)), calculate the real-time cursor movement distance through the following formula:

[0066] Δx = Aω Y

[0067] Δy = Bω X ;

[0068] 3) When the current in-air attitude of the mouse is the third attitude (as shown in (f) below), calculate the real-time cursor movement distance using the following formula: Figure 3 as shown in (f) below), calculate the real-time cursor movement distance using the following formula:

[0069] Δx = -Aω Y

[0070] Δy = Bω X ;

[0071] where Δx is the distance the cursor moves along the X-axis, Δy is the distance the cursor moves along the Y-axis, Δz is the distance the cursor moves along the Z-axis, A and B are both constants, and ω X is the angular velocity of the X-axis of the sensor, ω Y is the angular velocity of the Y-axis of the sensor, ω Z is the angular velocity of the Z-axis of the sensor.

[0072] The above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements will not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A real-time response method for an air mouse, characterized in that: It includes the following steps: S1. Collect the initial mouse state and switch the real-time mouse state by detecting the mouse movement state and contact situation; S2. Detect the current mouse in-air attitude and fit and classify the current mouse in-air attitude; S3. Calculate the real-time cursor movement distance according to the current mouse in-air attitude category; In S2, detecting the current mouse in-air attitude and fitting and classifying the current mouse in-air attitude includes: Detect the current mouse in-air attitude through the acceleration sensor, and fit and classify the mouse in-air attitude with the mouse head facing forward as the first attitude, the mouse in-air attitude with the mouse head facing upward as the second attitude, and the mouse in-air attitude with the mouse head facing downward as the third attitude; In S3, calculating the real-time cursor movement distance according to the current mouse in-air attitude category includes: Calculate the real-time cursor movement distance through the gyroscope sensor, specifically including: When the current mouse in-air attitude is the first attitude, calculate the real-time cursor movement distance through the following formula: Δx = -Aω Z Δy = Bω X ; When the current mouse in-air attitude is the second attitude, calculate the real-time cursor movement distance through the following formula: Δx = Aω Y Δy = Bω X ; When the current mouse in-air attitude is the third attitude, calculate the real-time cursor movement distance through the following formula: Δx = -Aω Y Δy = Bω X ; where Δx is the distance the cursor moves along the X-axis, Δy is the distance the cursor moves along the Y-axis, both A and B are constants, ω X is the angular velocity of the X-axis of the gyroscope sensor, ω Y is the angular velocity of the Y-axis of the gyroscope sensor, ω Z is the angular velocity of the Z-axis of the gyroscope sensor.

2. The real-time response method of the air mouse according to claim 1, wherein: In S1, collecting the initial mouse state and switching the real-time mouse state by detecting the mouse movement state and contact situation includes: If the initial mouse state is the "air mouse" mode, then when it is detected that the mouse moves on the contact surface, switch the real-time mouse state to the "optical sensor" mode, otherwise the real-time mouse state maintains the "air mouse" mode; If the initial mouse state is the "optical sensor" mode, then when no contact surface is detected, switch the real-time mouse state to the "air mouse" mode, otherwise the real-time mouse state maintains the "optical sensor" mode.

3. The real-time response method of the air mouse according to claim 2, wherein: The step of when it is detected that the mouse moves on the contact surface and switching the real-time mouse state to the "optical sensor" mode includes: The optical navigation sensor detects the mouse movement trajectory with a detection period of 7.5 ms. When more than 35 movements are detected within 500 ms, it is determined that the mouse moves on the contact surface, switch the real-time mouse state to the "optical sensor" mode, and at the same time turn off the acceleration sensor and the gyroscope sensor.

4. The real-time response method of the air mouse according to claim 2, wherein: The step of when no contact surface is detected and switching the real-time mouse state to the "air mouse" mode includes: If the average value of the image quality detected by the optical navigation sensor is greater than 200 and the average value of the brightness is less than 30, it is determined that the mouse does not contact any surface, switch the real-time mouse state to the "air mouse" mode, and at the same time enable the acceleration sensor and the gyroscope sensor.

5. The real-time response method of the air mouse according to claim 1, characterized in that: In the first attitude, the mouse head points to the positive direction of the Y axis. In the second attitude, the positive direction of the Y axis is perpendicular to the bottom surface of the mouse. In the third attitude, the positive direction of the Y axis is perpendicular to the top surface of the mouse.

Images