Optical navigation method, optical navigation device and optical navigation system
By recording and reading the last successful movement prediction of the optical navigation device on the untraceable surface, the problem of interruption of the movement prediction of the optical sensor on the untraceable surface is solved, and smooth tracking and precise movement calculation of the optical navigation device are realized.
Patent Information
- Application Number
- CN202311493630.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-11
- Filing Date
- 2023-11-09
- Publication Date
- 2024-11-12
AI Technical Summary
The optical sensor cannot effectively calculate the direction and amplitude of movement on the untraceable surface, resulting in interruption of movement prediction and affecting the tracking accuracy of the optical navigation device.
Record the last successful movement prediction of the optical navigation device on the untraceable surface and read the prediction when the surface becomes traceable, ensuring the continuity of the movement prediction.
In this way, the optical navigation device can maintain smooth tracking when moving on an untraceable surface, avoid prediction interruptions, and ensure accurate calculation of movement direction and amplitude.
Smart Images

Figure CN118939129A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an optical navigation method and an optical navigation device, and more particularly to an optical navigation method and an optical navigation device capable of compensating for motion prediction when the optical navigation device passes through an untraceable surface. Background Art
[0002] Conventional optical sensors calculate position changes, or motion, by optically capturing continuous surface images of a surface (e.g., a desktop). By comparing these continuous images, optical sensors can determine the direction and magnitude of the movement.
[0003] For trackable surfaces, such as surfaces with rich features, the images captured by the optical sensor usually have high enough brightness and high enough contrast. In contrast, for non-trackable surfaces, such as surfaces that absorb light and / or are smooth, the images captured by the optical sensor may not have high enough brightness and high enough contrast to perform the required precise mathematical calculations to determine the direction and magnitude of movement.
[0004] In addition, in order to achieve efficient and high-speed tracking, a motion prediction method is usually used, which uses the movement direction and magnitude of the previous image to predict the direction and magnitude of the current movement. This prediction helps with mathematical calculations and enables faster image processing.
[0005] As described above, if the optical sensor is on a non-trackable surface, the captured image does not have high enough brightness and high enough contrast for the optical sensor to calculate the magnitude and direction of the movement. In this case, the optical sensor will report a motion prediction even if the magnitude of the movement is zero, even though the optical sensor is still moving on the non-trackable surface.
[0006] Thus, if the optical sensor moves from a trackable surface to an untrackable surface, the optical sensor reports its perceived direction of movement and its perceived magnitude when moving on a trackable surface, but reports a movement of zero magnitude when moving on an untrackable surface.
[0007] When the optical sensor then reaches the trackable surface again (while still moving), the image captured by the optical sensor has high enough brightness and high enough contrast to calculate the movement. However, since the movement amplitude obtained by the optical sensor when moving on the non-trackable surface is zero, even if the image already has high enough brightness and high enough contrast, the optical sensor is affected by the movement amplitude obtained when moving on the non-trackable surface and cannot predict the actual movement direction and amplitude. Summary of the invention
[0008] An object of the present invention is to disclose an optical navigation method that can compensate for motion prediction when an optical navigation device passes over an untrackable surface.
[0009] Another object of the present invention is to disclose an optical navigation device that can compensate for motion prediction when passing over an untrackable surface.
[0010] An embodiment of the present invention discloses an optical navigation method for use in an optical navigation device, comprising: (a) recording a first movement prediction of the optical navigation device; (b) determining whether a surface over which the optical navigation device is moving is trackable; and (c) if the surface changes from being untrackable to being trackable, reading the first movement prediction recorded in step (a).
[0011] Another embodiment of the present invention discloses an optical navigation device, comprising: a processing circuit; and an optical sensor for performing the following steps: (a) recording a first movement prediction of the optical navigation device; (b) determining whether a surface over which the optical navigation device is moving is trackable; and (c) if the surface changes from being untrackable to being trackable, reading the first movement prediction recorded in step (a).
[0012] Yet another embodiment of the present invention discloses an optical navigation system, comprising: an electronic device; and an optical navigation device, connected to the electronic device, comprising: a processing circuit; and an optical sensor: wherein the optical sensor determines whether a surface over which the optical navigation device is moving is trackable; wherein the electronic device records a first movement prediction of the optical navigation device, and if the surface changes from being untrackable to being trackable, reads the recorded first movement prediction.
[0013] According to the above-mentioned embodiment, the movement prediction interrupted by the non-trackable surface can be compensated. Therefore, even if the optical mouse moves on the non-trackable surface, the tracking of the optical mouse can be smooth and uninterrupted. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1 FIG. 4 is a block diagram of an optical navigation device according to an embodiment of the present invention.
[0015] Figure 2 FIG. 4 is a schematic diagram illustrating an optical navigation method according to an embodiment of the present invention.
[0016] Figure 3 To illustrate Figure 2 Flowchart of the optical navigation method shown.
[0017] Figure 4 FIG. 4 is a schematic diagram illustrating an optical navigation method according to another embodiment of the present invention.
[0018] Figure 5 To illustrate Figure 4 Flowchart of the optical navigation method shown.
[0019] Figure 6 FIG. 4 is a schematic diagram illustrating an optical navigation method according to another embodiment of the present invention.
[0020] Figure 7 To illustrate Figure 6 Flowchart of the optical navigation method shown.
[0021] Figure 8 FIG. 4 is a flow chart showing an abstract of an optical navigation method according to an embodiment of the present invention.
[0022] The reference numerals are described as follows:
[0023] 100 Optical Mouse
[0024] 101 Processing Circuit
[0025] 103 Optical Sensor
[0026] Steps 301,303,305,307,309,501,503,505,507,509
[0027] Steps 701,703,705,707,709,711,713,801,803,805,807
[0028] 401 Electronic Devices
[0029] TS_1 Traceable Surface
[0030] TS_2 Traceable Surface
[0031] NTS Non-Traceable Surface DETAILED DESCRIPTION
[0032] The present invention will be described below with multiple embodiments. Please note that the components in each embodiment can be implemented by hardware (e.g., a device or circuit) or firmware (e.g., at least one program written in a microprocessor). In addition, "first", "second" and similar descriptions in the following description are only used to define different components, parameters, data, signals or steps, and are not used to limit their order. For example, the first device and the second device can be different devices with the same structure.
[0033] Figure 1 FIG. 1 is a block diagram of an optical navigation device according to an embodiment of the present invention. Please also note that in the following embodiments, the optical mouse 100 will be used as an example to illustrate the concept of the present invention. However, the optical mouse can be replaced by any other optical navigation device. Figure 1As shown, the optical mouse 100 includes a processing circuit 101 and an optical sensor 103. The optical sensor 103 is used to sense optical data. The optical data may be an image or any other optical data including optical features.
[0034] The processing circuit 101 is used to calculate the movement of the optical mouse 100 based on the optical data, and to output the movement. For example, the optical mouse 100 is connected to a computer and outputs its movement to the computer. In addition, the processing circuit 101 can be used to calculate the above-mentioned movement prediction. Please note that the movement calculation and movement prediction can be performed by the optical sensor 103, and are not limited to the processing circuit 101. In the following embodiments, the optical sensor 103 is used to perform some actions of the optical navigation method disclosed in the present invention. However, these actions can also be performed by the processing circuit 101.
[0035] Figure 2 FIG. 4 is a schematic diagram illustrating an optical navigation method according to an embodiment of the present invention. Figure 3 To illustrate Figure 2 Flowchart of the optical navigation method shown in FIG. Figure 2 At the same time reference Figure 3 , in order to more clearly understand the concepts disclosed in the present invention. Figure 2 In FIG. 1 , the optical mouse 100 moves from the trackable surface TS_1 to the non-trackable surface NTS, and then moves to the trackable surface TS_2.
[0036] In one embodiment, the optical mouse 100 is Figure 2 In the embodiment, tracking is continuously performed. Tracking is the action of "calculating position change" mentioned above. If the optical mouse 100 moves on the trackable surface TS_1 or the trackable surface TS_2, tracking can be successfully performed. However, if the optical mouse 100 moves on the non-trackable surface NTS, tracking stops (cannot be successfully calculated) (step 301). Figure 2 In the embodiment of the present invention, the cessation of tracking can be detected by the optical sensor 103. In this case, the optical sensor 103 records the first movement prediction (step 303), which is the last successful movement prediction before the optical mouse 100 enters the non-trackable surface NTS. The first movement prediction may include a movement direction and a movement amplitude.
[0037] In one embodiment, the optical sensor 103 continuously determines whether the surface on which the optical mouse 100 performs tracking is a trackable surface (step 305), or starts to determine whether the surface is a trackable surface when or after the first movement prediction is recorded. Therefore, step 303 can be regarded as: "recording the first movement prediction, the first movement prediction is the last successful movement prediction before the optical mouse 100 determines that the surface is not trackable".
[0038] As described above, the optical sensor 103 determines whether the surface is a trackable surface. Figure 3 In step 307, if the surface is still a non-trackable surface (ie, the optical mouse 100 is still moving on the non-trackable surface NTS), the process returns to step 305. Figure 3 In step 307, if the surface becomes a trackable surface (i.e., the optical mouse 100 moves to the trackable surface TS_2), the optical sensor 103 reads the first movement prediction (step 309). Then, the optical sensor 103 performs tracking of the optical sensor 103 according to the obtained optical data and the first movement prediction. In this way, the calculation of the movement prediction will not be interrupted by the non-trackable surface NTS.
[0039] In one embodiment, the optical mouse 100 is connected to an electronic device that is responsible for compensating the movement prediction when the optical mouse 100 moves on the non-trackable surface NTS. The electronic device can be a computer or any other device capable of executing Figure 4 and Figure 5 In addition, the optical mouse 100 and the electronic device can be connected wirelessly or wired.
[0040] Figure 4 FIG. 4 is a schematic diagram illustrating an optical navigation method according to another embodiment of the present invention. Figure 5 To illustrate Figure 4 Flowchart of the optical navigation method shown in FIG. Figure 4 At the same time reference Figure 5 , in order to more clearly understand the concepts disclosed in the present invention. Figure 4 In FIG. 4 , the optical mouse 100 connected to the electronic device 401 moves from the trackable surface TS_1 to the non-trackable surface NTS, and then moves to the trackable surface TS_2. The optical mouse 100 and the electronic device 401 can be regarded as an optical navigation system.
[0041] In one embodiment, the optical mouse 100 is Figure 4 In the embodiment, tracking is performed continuously. Tracking is the action of "calculating position change" mentioned above. If the optical mouse 100 moves on the trackable surface TS_1 or the trackable surface TS_2, tracking can be successfully performed. However, if the optical mouse 100 is moving on the non-trackable surface NTS, tracking stops (cannot be successfully calculated) (step 501). Figure 4 In the embodiment, the cessation of tracking can be detected by the electronic device 401.
[0042] In this case, the electronic device 401 records the first movement prediction, which is the last successful movement prediction before the optical mouse 100 enters the non-trackable surface NTS (step 503). The first movement prediction may include a movement direction and a movement amplitude. In one embodiment, the microprocessor of the electronic device 401 records the first movement prediction before the optical mouse 100 enters the non-trackable surface NTS.
[0043] In one embodiment, the optical sensor 103 continuously determines whether the surface on which the optical mouse 100 performs tracking is a trackable surface (step 505), or starts to determine whether the surface is a trackable surface when or after the first movement prediction is recorded. Accordingly, step 503 can be regarded as: "recording the first movement prediction, the first movement prediction is the last successful movement prediction before the optical mouse 100 determines that the surface is not trackable".
[0044] As previously mentioned, the optical sensor 103 determines whether the surface is a trackable surface. Figure 5 In step 507, if the surface is still an untraceable surface (ie, the optical mouse 100 is still moving on the untraceable surface NTS), then return to step 505. Figure 5 In step 507, if the surface becomes a trackable surface (i.e., the optical mouse 100 moves to the trackable surface TS_2), the electronic device 401 reads the first movement prediction and sends the first movement prediction to the optical sensor 103 (step 509). Then, the optical sensor 103 performs tracking based on the obtained optical data and the first movement prediction. In this way, the calculation of the movement prediction will not be interrupted by the non-trackable surface NTS.
[0045] In the above embodiment, the optical mouse 100 moves from the trackable surface TS_1 to the non-trackable surface NTS, and then moves to the trackable surface TS_2. However, in some embodiments, the user may change the moving direction of the optical mouse 100, so that the optical mouse 100 moves from the trackable surface TS_1 to the non-trackable surface NTS, and then returns to the trackable surface TS_1 again. For example, the optical mouse 100 performs the following steps: Figure 6 In this case, since the optical mouse 100 has changed its moving direction but still uses the first movement prediction recorded before the moving direction is changed, the above embodiment may still obtain an erroneous movement prediction.
[0046] Figure 6 FIG. 4 is a schematic diagram illustrating an optical navigation method according to another embodiment of the present invention. Figure 7 To illustrate Figure 6 Flow chart of the optical navigation method shown. Figure 7 Please refer to Figure 6To better understand the concepts disclosed in the present invention.
[0047] In one embodiment, the optical mouse 100 is Figure 6 In the embodiment of the present invention, tracking is performed continuously. As described above, if the optical mouse 100 moves on the trackable surface TS_1 or the trackable surface TS_2, tracking can be successfully performed. However, if the optical mouse 100 moves on the non-trackable surface NTS, tracking stops (step 701). Figure 6 In the embodiment of the present invention, the cessation of tracking can be detected by the optical sensor 103. In this case, the optical sensor 103 records the first movement prediction, which is the last successful movement prediction before the optical mouse 100 enters the non-trackable surface NTS (step 703). The first movement prediction may include a movement direction and a movement amplitude. However, steps 701 and 703 may be performed by an electronic device, not limited to an optical mouse.
[0048] In one embodiment, the optical sensor 103 continuously determines whether the surface on which the optical mouse 100 performs tracking is a trackable surface (step 705), or starts to determine whether the surface is a trackable surface when or after the first movement prediction is recorded. Therefore, step 703 can be regarded as: "recording the first movement prediction, the first movement prediction is the last successful movement prediction before the optical mouse 100 determines that the surface is not trackable".
[0049] In step 707, the electronic device 401 detects the change in the moving direction of the optical mouse 100. For example, the electronic device 401 obtains the moving direction obtained by the optical sensor 103 when the optical mouse 100 leaves the trackable surface TS_1. When the optical mouse 100 enters the trackable surface TS_1 again, the optical sensor 103 obtains the moving direction again and calculates the moving direction change based on the two moving directions. However, in another embodiment, the moving direction can be detected by the optical sensor 103.
[0050] In addition, in step 707, if the amount of change in the moving direction is greater than the direction change threshold, the electronic device 401 notifies the optical mouse 100 that the moving direction has changed. If the amount of change in the moving direction is greater than the direction change threshold, it means that the optical mouse 100 may return to the trackable surface TS_1 again after leaving the non-trackable surface NTS. Therefore, in this case, the optical sensor 103 records the second movement prediction as the first movement prediction (i.e., the value of the recorded first movement prediction is replaced with the value of the second movement prediction). In other words, if the surface is trackable (the optical sensor 103 moves on the trackable surface TS_1) and the optical mouse 100 changes the moving direction (the moving direction change is greater than the direction), the optical sensor 103 records the second movement prediction.
[0051] In step 711, the optical sensor 103 determines whether the surface is a trackable surface. If the surface is still a non-trackable surface (i.e., the optical mouse 100 is still moving on the non-trackable surface NTS), the process returns to step 705. In addition, in step 711, if the surface becomes a trackable surface (i.e., the optical mouse 100 returns to the trackable surface TS_1), the optical sensor 103 reads the second movement prediction. Then, the optical sensor 103 calculates a new movement prediction based on the obtained optical data and the second movement prediction (step 713). In this way, even if the optical mouse changes its movement direction, the calculation of the movement prediction will not be interrupted by the non-trackable surface NTS.
[0052] Please note that Figure 6 and Figure 7 In an embodiment, the first movement prediction is recorded first, and then the second movement prediction is recorded to replace the first movement prediction. However, in an embodiment, the second movement prediction is recorded but the first movement prediction is not recorded. In such an embodiment, the second movement prediction recorded when the optical mouse 100 leaves the non-trackable surface NTS and enters the trackable surface TS_1 can be called the first movement prediction, because the first movement prediction that would have been recorded when the optical mouse 100 leaves the trackable surface TS_1 and enters the non-trackable surface NTS is not recorded in this example.
[0053] According to the above embodiments, the optical navigation method disclosed in the present invention can be briefly described as follows: Figure 8 The steps shown include the following steps:
[0054] Step 801
[0055] Tracking is performed by an optical navigation device.
[0056] As mentioned above, the optical navigation device may be an optical mouse.
[0057] Step 803
[0058] A first movement prediction of the optical navigation device is recorded.
[0059] As described above, the first motion prediction may be recorded when tracking is stopped (e.g. Figure 2 and Figure 4 ), or when the optical navigation device changes the direction of movement (e.g. Figure 7 of the embodiment of the invention).
[0060] Step 805
[0061] Determine whether the surface tracked by the optical navigation device is trackable, such as Figure 3 Step 305 or Figure 7 Step 705 in .
[0062] In one embodiment, step 805 is replaced by “determining whether the surface on which the optical navigation device is moving is trackable.” In this case, step 801 may be omitted.
[0063] Step 807
[0064] If the surface was non-traceable and then becomes traceable, the first motion prediction recorded in step 803 is read.
[0065] For example, the optical navigation device moves from the non-trackable surface NTS to the trackable surface TS_2. Figure 2 and Figure 4 As shown, or move from the non-traceable surface NTS to the traceable surface TS_1 again, as Figure 7 shown.
[0066] Other detailed steps have been described in the above embodiments and will not be repeated here.
[0067] According to the above-mentioned embodiment, the movement prediction interrupted by the non-trackable surface can be compensated. Therefore, even if the optical mouse moves on the non-trackable surface, the tracking of the optical mouse can be smooth and uninterrupted.
[0068] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. An optical navigation method, used in an optical navigation device, characterized in that: include: (a) recording a first movement prediction of the optical navigation device; (b) determining whether a surface over which the optical navigation device is moving is trackable; as well as (c) If the surface changes from being untraceable to being traceable, reading the first motion prediction recorded in step (a).
2. The optical navigation method according to claim 1, characterized in that: The first motion prediction is the last successful motion prediction before the surface is determined to be untrackable in step (b).
3. The optical navigation method according to claim 2, characterized in that: Further including: (d) detecting a change in the moving direction of the optical navigation device; (e) If the surface is trackable and the optical navigation device changes the movement direction, recording a second movement prediction of the optical navigation device as the first movement prediction.
4. The optical navigation method according to claim 3, characterized in that: The step (d) detects the change in the moving direction by an electronic device connected to the optical navigation device; If the movement direction change is greater than a direction change threshold, the electronic device notifies the optical navigation device that the movement direction change has occurred.
5. The optical navigation method according to claim 1, characterized in that: The step (a) and the step (b) are performed by an optical sensor of the optical navigation device.
6. The optical navigation method according to claim 1, wherein: The step (a) is performed by an electronic device connected to the optical navigation device, and the step (b) is performed by an optical sensor of the optical navigation device.
7. The optical navigation method according to claim 1, characterized in that: Further including: (d) detecting a change in the moving direction of the optical navigation device; If the surface is trackable and the optical navigation device changes the moving direction, step (a) is performed.
8. The optical navigation method according to claim 7, characterized in that: The step (d) detects the change in the moving direction by an electronic device connected to the optical navigation device; If the movement direction change is greater than a direction change threshold, the electronic device notifies the optical navigation device that the movement direction change has occurred.
9. The optical navigation method according to claim 1, characterized in that: Further including: Prior to step (a), tracking is performed on the surface by the optical navigation device.
10. The optical navigation method according to claim 1, wherein: The optical navigation device is an optical mouse.
11. An optical navigation device, characterized in that: include: Processing circuit; as well as Optical sensor to perform the following steps: (a) recording a first movement prediction of the optical navigation device; (b) determining whether a surface over which the optical navigation device is moving is trackable; as well as (c) If the surface changes from being untraceable to being traceable, reading the first motion prediction recorded in step (a).
12. The optical navigation device according to claim 11, wherein: The first motion prediction is the last successful motion prediction before the surface is determined to be untraceable in step (b).
13. The optical navigation device according to claim 12, wherein: The optical sensor is also used to perform: (d) detecting a change in the moving direction of the optical navigation device; (e) If the surface is trackable and the optical navigation device changes the movement direction, recording a second movement prediction of the optical navigation device as the first movement prediction.
14. The optical navigation device according to claim 11, wherein: Further including: (d) detecting a change in the moving direction of the optical navigation device; If the surface is trackable and the optical navigation device changes the moving direction, step (a) is performed.
15. The optical navigation device according to claim 11, wherein: The optical sensor performs tracking on the surface by the optical navigation device before step (a).
16. The optical navigation device according to claim 11, wherein: The optical navigation device is an optical mouse.
17. An optical navigation system, characterized in that: include: Electronic devices; as well as An optical navigation device, connected to the electronic device, comprising: Processing circuit; as well as Optical Sensors: wherein the optical sensor determines whether a surface over which the optical navigation device is moving is trackable; The electronic device records a first movement prediction of the optical navigation device, and reads the recorded first movement prediction if the surface changes from being untraceable to being traceable.
18. The optical navigation system according to claim 17, wherein: The first motion prediction is the last successful motion prediction before the optical sensor determines that the surface is untrackable.
19. The optical navigation system according to claim 18, wherein: The electronic device detects a change in the moving direction of the optical navigation device; If the surface is trackable and the optical navigation device changes the movement direction, the electronic device records a second movement prediction of the optical navigation device as the first movement prediction.
20. The optical navigation system according to claim 19, wherein: If the movement direction change is greater than a direction change threshold, the electronic device notifies the optical navigation device that the movement direction change has occurred.
