Fingerprint sensing system and operation method thereof

Abstract

A fingerprint sensing system includes a fingerprint sensor, a controller, and a central processing unit (CPU). The fingerprint sensor senses a fingerprint to generate multiple consecutive fingerprint images. The controller generates an identification result based on at least one of the multiple consecutive fingerprint images and generates motion information based on the multiple consecutive fingerprint images. The CPU executes an application and a driver. The driver receives the identification result and the motion information, and the CPU launches the application in response to the identification result. The CPU controls the movement of a cursor in response to the motion information.

Description

Technical Field

[0001] This invention relates to a fingerprint sensing system, and more particularly to a fingerprint sensing system with gesture operation function and its operation method. Prior Technology

[0002] Due to the uniqueness of fingerprints, they are often used as a basis for identification. Traditional fingerprint sensing systems are only used to achieve fingerprint enrollment to log in a user's fingerprint and fingerprint verification to verify the user's identity. Summary of the Invention

[0003] One of the objectives of this invention is to provide a fingerprint sensing system with gesture operation function and its operation method.

[0004] According to the present invention, a fingerprint sensing system with gesture operation function includes a fingerprint sensing module and a central processing unit. The fingerprint sensing module includes a fingerprint sensor and a controller, wherein the controller is connected to the fingerprint sensor and the central processing unit. The fingerprint sensor is used to sense the fingerprint of a finger and generate multiple consecutive fingerprint images. The controller is used to identify at least one of the multiple consecutive fingerprint images to generate an identification result, and to generate at least one movement information based on the multiple consecutive fingerprint images. The central processing unit is used to execute an application and a driver. The driver receives the identification result and the at least one movement information; the central processing unit launches the application according to the identification result; and the central processing unit controls the movement of a cursor according to the at least one movement information.

[0005] According to the present invention, a fingerprint sensing system with gesture operation function includes a fingerprint sensing module and a central processing unit. The fingerprint sensing module includes a fingerprint sensor. The fingerprint sensor is used to sense the fingerprint of a finger and generate multiple consecutive fingerprint images. The central processing unit is used to execute an application and a driver. The fingerprint sensing module transmits the multiple consecutive fingerprint images to the driver. The driver identifies at least one of the multiple consecutive fingerprint images to generate a recognition result, and generates at least one movement information based on the multiple consecutive fingerprint images. The central processing unit launches the application according to the recognition result. The central processing unit controls the movement of a cursor based on the at least one movement information.

[0006] According to the present invention, an operation method of a fingerprint sensing system includes: sensing the fingerprint of a finger to generate multiple consecutive fingerprint images; identifying at least one of the multiple consecutive fingerprint images to generate an identification result; launching an application based on the identification result; generating at least one motion information based on the multiple consecutive fingerprint images; and controlling the movement of a cursor in response to the motion information.

[0007] The fingerprint sensing system of this invention is an alternative input device to existing touchpads, providing a different input option. The fingerprint sensing system of this invention is simpler and more elegant to operate; for example, the fingerprint sensing system of this invention can control the cursor through finger movement. Simple Explanation of the Diagram

[0008] Figure 1 shows an embodiment of the fingerprint sensing system with gesture operation function of the present invention. Figure 2 shows the central processing unit with applications and drivers. Figure 3 shows a flowchart of the operation method of the fingerprint sensing system of the present invention. Figure 4 shows an embodiment of generating motion information and angle information. Figure 5 shows an embodiment of generating mobile information. Figure 6 shows an embodiment of generating mobile information. Figure 7 shows an example of a rotary menu. Figure 8 shows an example of a long, narrow menu. Implementation

[0009] 1 shows an embodiment of a fingerprint sensing system of the present invention having a gesture operation function. The fingerprint sensing system 10 includes a fingerprint sensing module 11 , a vibration sensor 13 and a Central Processing Unit (CPU) 14 . The fingerprint sensing module 11 includes a fingerprint sensor 111 and a controller 112 . The controller 112 is connected to a fingerprint sensor 111 , a vibration sensor 13 and a central processing unit 14 . The controller 112 may be, but is not limited to, a Microcontroller Unit (MCU). 2, the central processing unit 14 is used to run an application 15 and a driver 16 . The driver 16 is used to provide communication between the central processing unit 14 and the controller 112 . The vibration sensor 13 is used to provide a tactile feedback to the user, for example, the vibration sensor 13 may inform the user by vibration that the finger has been in contact with the fingerprint sensor 111, that the fingerprint of the finger has been registered, or that the fingerprint of the finger has been authenticated. Applications 15 and drivers 16 may be built in the operating system. In one embodiment, the Central Processing Unit 14 may be a Central Processing Unit CPU (Central Processing Unit) of a desktop or notebook computer, the operating system may be, but not limited to, a Windows operating system of Microsoft Corporation, and the application 15 may be, but not limited to, for implementing a cursor control function or displaying a menu on the display, such as a roulette menu or a bar menu, a roulette menu or a bar menu for providing a variety of functional options. Driver 16 can be, but is not limited to, Windows hallo. In one embodiment, the fingerprint sensing module 11 may be integrated within a keystroke, such as a power key or a COPILOT key. In one embodiment, the fingerprint sensor 111 and the controller 112 are integrated in one integrated circuit device, in other embodiments, the controller 111 and the fingerprint sensor 112 may also be two separate integrated circuit devices. In one embodiment, the vibration sensor 13 may also be omitted.

[0010] Both application 15 and driver 16 are operated by a central processing unit 14. Therefore, a person familiar with the field of information technology should be able to understand that the actions performed by application 15 and driver 16 are performed by resorting to the central processing unit 14 .

[0011] Figure 3 shows a flowchart of the operation method of the fingerprint sensing system of the present invention. Referring to Figures 1, 2, and 3, the fingerprint sensor 111 can sense the user's fingerprint to generate multiple consecutive fingerprint images, as shown in step S10. Next, the controller 112 identifies at least one of the multiple consecutive fingerprint images to generate an identification result, as shown in step S11. Specifically, in step S11, the controller 112 compares at least one of the multiple consecutive fingerprint images with a registered fingerprint template to generate the identification result. A pass result indicates that the user has passed authentication. A fail result indicates that the user has not passed authentication. The identification result may further include which finger passed fingerprint verification, such as the index finger or thumb. The identification result may also include which user passed fingerprint verification. In one embodiment, the controller 112 has a fingerprint recognition algorithm (not shown) and an algorithm accelerator (not shown). The fingerprint recognition algorithm of the controller 112 is implemented in firmware, and the algorithm accelerator of the controller 112 can be implemented in hardware circuitry and / or firmware. The fingerprint recognition algorithm and the algorithm accelerator are used to recognize fingerprint images. In one embodiment, the processing time of the algorithm accelerator for a single fingerprint image is less than 35ms, allowing the processing speed of the algorithm accelerator to be greater than 30FPS. In one embodiment, the fingerprint recognition algorithm and the algorithm accelerator can also be built into the driver program 16. In this embodiment, the fingerprint recognition algorithm and the algorithm accelerator in the driver program 16 are implemented in software. The controller 112 or the fingerprint sensor 111 transmits multiple consecutive fingerprint images to the driver program 16 of the central processing unit 14, and the driver program 16 then recognizes at least one of the multiple consecutive fingerprint images to generate the recognition result.

[0012] The driver 16 obtains the recognition result from the controller 112, or the driver 16 recognizes at least one of the multiple consecutive fingerprint images to generate the recognition result, which means that the central processing unit 14 obtains the fingerprint verification recognition result. Next, the central processing unit 14 launches the application 15 based on the recognition result, as shown in step S12. Although only one application 15 is shown in the embodiment of FIG2, there can actually be multiple applications 15. The central processing unit 14 can launch different applications 15 in response to different recognition results. In one embodiment, the controller 112 or the central processing unit 14 stores fingerprint templates of multiple fingers (e.g., index finger, middle finger, ring finger, thumb, and little finger) of a user. The controller 112 or the driver program 16 can determine whether the finger sensed by the fingerprint sensor 111 is the user's index finger, middle finger, ring finger, thumb, or little finger based on the fingerprint templates to generate the recognition result. The central processing unit 14 can then launch different applications 15 or different modules within the applications 15. The launched applications can display different wheel menus or long bar menus on a display (not shown), and different wheel menus or long bar menus provide different functions. In other words, different fingers can launch different applications. In another embodiment, the controller 112 or the central processing unit 14 stores fingerprint templates of multiple users. The controller 112 or the driver 16 can determine the user's identity as user A, user B, or an unregistered user based on the fingerprint templates to generate the identification result. The central processing unit 14 can then launch different applications 15 or different modules within applications 15 based on the identification result. The launched applications 14 can display different wheel menus or bar menus on a display (not shown), and these different wheel menus or bar menus provide different functions. In other words, different users can open different applications.

[0013] After application 15 is launched, fingerprint sensing system 10 proceeds to step S13. In step S13, controller 112 generates at least one motion information and / or at least one angle information based on the multiple consecutive fingerprint images and sends it to driver 16. In one embodiment, the multiple consecutive fingerprint images generated by fingerprint sensor 111 can also be transmitted to driver 16 of central processing unit 14 via controller 112 or transmission interface, and driver 16 then generates at least one motion information and / or at least one angle information based on the multiple consecutive fingerprint images.

[0014] Figure 4 illustrates an embodiment using computer vision methods to generate motion and angle information. The controller 112 or central processing unit 14 can determine the relative displacement of two consecutive fingerprint images 20 and 21, and determine the rotation direction and angle of fingerprint image 21 relative to fingerprint image 20. Methods for determining the relative displacement, rotation direction, and rotation angle of two fingerprint images 20 and 21 include, but are not limited to, computer vision methods. Well-known computer vision methods include AKAZE, SURF, SIFT, or other feature point matching methods, such as using LBP (Local Binary Pattern) for feature matching. In the embodiment of Figure 4, the controller 112 or central processing unit 14 uses computer vision methods to find multiple identical feature points (at least four) in fingerprint images 20 and 21, such as feature points 30, 31, 32, and 33 in the figure. Based on the positions of these four feature points in fingerprint images 20 and 21, and through the Random Sample Consensus (RANSAC) algorithm, the finger's movement amount dx in the X direction (horizontal direction), the finger's movement amount dy in the Y direction (vertical direction), and the finger's rotation angle can be obtained. The direction of finger movement (e.g., upward or downward vertically, or left or right horizontally) can be determined based on the X-direction movement amount dx and the Y-direction movement amount dy. In one embodiment, the controller 112 or the central processing unit 14 can determine the direction of finger movement based on whether the X-direction movement amount dx and the Y-direction movement amount dy are positive or negative. The direction of finger rotation can be determined based on whether the calculated rotation angle is positive or negative.

[0015] Figure 5 shows another embodiment of generating movement information. In step S13, the controller 112 or the central processing unit 14 can also use a block matching algorithm to obtain movement information. As shown in Figure 5, the block matching algorithm uses the first region 221 of the t-th fingerprint image 22 of the multiple consecutive fingerprint images as a template, and finds the second region 231 in the (t+1)-th fingerprint image 23 of the multiple consecutive fingerprint images that is most similar to the first region 221, where t is a positive integer greater than 0. Finally, the block matching algorithm calculates the amount of movement of the finger in the vertical direction (Y direction) and the horizontal direction (X direction) based on the coordinates (X3, Y3) and (X4, Y4) of the center points 2211 and 2311 of the first region 221 and the second region 231, where the movement amount dx in the X direction is X4-X3 and the movement amount dy in the Y direction is Y4-Y3. The controller 112 or the central processing unit 14 can determine the direction of finger movement based on whether the X-direction movement amount dx and the Y-direction movement amount dy are positive or negative. Generally, the first region 221 is the central region of the fingerprint image 22, but the present invention is not limited thereto.

[0016] Figure 6 shows another embodiment of generating motion information. In step S13, the controller 112 or the central processing unit 14 can also obtain motion information through the centroid of the fingerprint image. The controller 112 or the central processing unit 14 calculates the first centroid A of the t-th fingerprint image 24 of the plurality of consecutive fingerprint images and calculates the second centroid B of the (t+1)-th fingerprint image 25 of the plurality of consecutive fingerprint images, where t is a positive integer greater than 0. Next, the controller 112 or the central processing unit 14 can calculate the amount of finger movement dx in the X direction and the amount of finger movement dy in the Y direction based on the positional difference between the first centroid A and the second centroid B, and can determine the direction of finger movement based on whether the amount of movement dx and dy are positive or negative. In one embodiment, the fingerprint sensor 111 includes 5 X-direction electrodes and 5 Y-direction electrodes. The intersection of these 5 X-direction electrodes and 5 Y-direction electrodes forms 25 sensing points. The method for calculating the center of gravity position involves summing the inductive values ​​at the sensing points on each electrode to obtain the inductive value for that electrode, thus calculating five inductive values ​​from the five X-axis electrodes and five inductive values ​​from the five Y-axis electrodes. Next, the X-axis coordinates of the center of gravity can be calculated based on the coordinates of these five X-axis electrodes and their inductive values. For example, the X-axis coordinates of the center of gravity can be calculated using the following formula: (X1*C1+X2*C2+X3*C3+X4*C4+X5*C5) / (X1+X2+X3+X4+X5) Formula 1 Among them, X1~X5 are the coordinates of these five X-direction electrodes, and C1~C5 are the induced amounts of these five X-direction electrodes, respectively. In the same way, the Y-direction coordinates of the center of gravity can be calculated based on the coordinates of these five Y-direction electrodes and their sensing.

[0017] In other embodiments, the at least one movement information may include at least one of the X-direction movement dx, the Y-direction movement dy and the finger movement direction, the at least one angular information including at least one of the rotation direction and the rotation angle.

[0018] After step S13, the fingerprint sensing system 10 performs step S14. In step S14, the central processing unit 14 selects one of a plurality of functional options in a menu (e.g., the aforementioned roulette menu or strip menu) and performs the function of the selected functional option based on the at least one moving information and / or at least one such angle information.

[0019] In an embodiment of step S14, the central processing unit 14 controls the movement of the cursor in accordance with the movement information and selects a functional option based on the position of the cursor. Specifically, assuming that the application 15 displays a roulette menu or strip menu with multiple function options on the display (not shown in the figure) in step S12, the central processing unit 14 can control the movement of the cursor in accordance with the movement information in step S14. The default gesture may be, but is not limited to, letting the finger leave the fingerprint sensor 111 or clicking the fingerprint sensor 111 . In an embodiment, since the resolution (DPI) of the fingerprint sensor 111 is different from the resolution of the display, the method of controlling the cursor movement includes multiplying the X-direction movement dx as well as the Y-direction movement dy as the cursor's movement after multiplying the previous parameter value S. In another embodiment, the method of controlling cursor movement includes magnifying multiple consecutive fingerprint images N times using bilinear interpolation or bicubic interpolation, and then obtaining N times X-direction movement dx and N times Y-direction movement dy from the enlarged number of consecutive fingerprint images as shown in Figures 4 to 6 . The aforementioned parameters S and N may be fixed or variable values. In an embodiment, the parameters S and N may be linearly boosted or decreased with the previous shifts dx and dy, for example, when the previous calculated shifts dx and dy are larger, the numerical values ​​of parameters S and N can be relatively increased.

[0020] In an embodiment of step S14, to avoid misjudging the direction of movement due to finger jitter, the central processing unit 14 judges the direction of movement of the finger based on the amount of movement dx in the multi-sense movement or the cumulative value of the amount of movement in the vertical direction dy reaches a critical value within a preset length of time, and according to the direction of movement selects the function options corresponding to the direction of movement. When the cumulative value of the amount of movement dx in the horizontal direction is greater than the critical value for that preset length of time, it means that the user intentionally slides the finger in the horizontal direction. Similarly, when the cumulative value of the vertical movement quantity dy is greater than the critical value for that preset length of time, it means that the user intentionally slides the finger in the vertical direction. Of course, based on the amount of movement dx in the horizontal direction and the amount dy of movement in the vertical direction, the central processing unit 14 can also determine that the finger is intentionally moved in other directions, such as upper left, lower left, upper right or lower right. More specifically, assuming the default time length is 1 second, and the fingerprint sensor 111 can acquire 30 consecutive fingerprint images per second, thus generating 29 strokes of horizontal movement dx and vertical movement dy per second, the central processing unit 14 sustains a cumulative horizontal movement dx or vertical movement dy.

[0021] In an embodiment of step S14, the central processing unit 14 determines which of the plurality of functional options of the roulette menu is selected based on the at least one angle of information and performs the function of the selected functional option. 7 shows an embodiment of a roulette menu comprising functional options A~F. When the application 15 is launched, the roulette menu of Figure 7 is displayed on the display. In an embodiment, the application 15 sets the function option A of the roulette menu as the default option, which is labeled when the application 15 is just started. Methods of marking functional options include, but are not limited to, enlarging the pattern of the selected functional option (as shown in Figure 7) or highlighting the selected functional option with different colors. After the display shows the roulette menu of Figure 7, the user can turn the finger to select the function options on the roulette menu. For example, assuming that the change in rotation angle of the finger is a threshold value every 30 degrees, when the finger rotates in a clockwise direction and the change in rotation angle exceeds 30 degrees, the application 15 will move one option position in the clockwise direction to select function option B. Conversely, when the finger is rotated in a counterclockwise direction and the change in rotation angle exceeds 60 degrees, the application 15 will move the two option positions in the counterclockwise direction to select the function option E. After the user has selected the desired function option, the user may allow the application 15 to perform the function of the selected function option by default gestures. The default gesture may be, but is not limited to, letting the finger leave the fingerprint sensor 111 or clicking the fingerprint sensor 111 .

[0022] In one embodiment, the central processing unit 14 may control vibration sensor 13 to activate to provide a haptic feedback to the user when the fingerprint sensing system 10 moves the cursor to one function option in response to at least one movement of information or allows the roulette menu to switch to another function option in response to at least one angle of information.

[0023] In an embodiment of step S14, the central processing unit 14 determines which of the plurality of function options of a long strip menu is selected based on the at least one moving information, and performs the function of the selected function option. 8 shows an embodiment of a long strip menu comprising functional options G~K. When the application 15 is launched, it causes the display to display the long bar menu of FIG. In an embodiment, the application 15 sets the function option I in the middle of the strip menu as the default option, so that the function option I is labeled when the application 15 is just started. Methods of labeling functional options include, but are not limited to, enlarging the pattern of the selected functional option or highlighting the selected functional option in a different color (as shown in Figure 8 ). After the display displays the strip menu of FIG. 8 , the user may slightly move the finger on the fingerprint sensor 111 to select a function option on the strip menu. For example, when the cumulative value of the vertical movement amount dy of the finger reaches a critical value within a preset length of time and the cumulative value is positive, the central processing unit 14 judges that the finger is moving upward, so the application 15 will move up an option position to select the function option H. In contrast, when the cumulative value of the vertically moving amount dy of that finger reaches that critical value within that preset length of time and the cumulative value is negative, the central processing unit 14 judges that the finger is moving downward, and therefore the application 15 will move downward one option position to select the function option J . After the user has selected the desired function option, the user may allow the application 15 to perform the function of the selected function option by default gestures. The default gesture may be, but is not limited to, letting the finger leave the fingerprint sensor 111 or clicking the fingerprint sensor 111 .

[0024] In an embodiment, after the user selects and executes the desired function option, the user may also manipulate the function of the performed function option through the fingerprint sensing system 10 of the invention. For example, when the function option performed by the user is volume control or brightness control, the user may set the volume value or brightness value by moving or rotating the finger on the fingerprint sensor 111 .

[0025] In the fingerprint sensing system 10 of the present invention, after selecting a function option in the menu, the user can perform the function corresponding to the function option by making a gesture on the fingerprint sensor 111. The gesture includes, but is not limited to, a tap gesture, a double tap gesture, a long touch gesture, a cursor gesture, a rotate right gesture, or a rotate left gesture.

[0026] The fingerprint sensing system 10 determines a click gesture by detecting that a finger has touched the fingerprint sensor 111 and then removed it, and the contact time between the finger and the fingerprint sensor 111 is less than a first preset value. In one embodiment, the fingerprint sensing system 10 determines whether a finger has touched the fingerprint sensor 111 by means including but not limited to the average grayscale value of the fingerprint image output by the fingerprint sensor 111. If the average grayscale value is greater than or equal to a second preset value, it indicates that a finger has touched the fingerprint sensor 111. Conversely, if the average grayscale value is less than the second preset value, it indicates that no finger has touched the fingerprint sensor 111.

[0027] The fingerprint sensing system 10 determines a double-tap gesture by detecting the first contact of a finger with the fingerprint sensor 111 and the first departure of the finger from the fingerprint sensor 111, then detecting the second contact of the finger with the fingerprint sensor 111 and the second departure of the finger from the fingerprint sensor 111. The contact time of the finger's two contacts with the fingerprint sensor 111 is less than a first preset value, and the time from the first contact of the finger with the fingerprint sensor 111 to the second departure of the finger from the fingerprint sensor 111 is less than a third preset value.

[0028] The fingerprint sensing system 10 determines the long press gesture by detecting that the contact time of the finger with the fingerprint sensor 111 is greater than a fourth preset value, and the total movement of the finger is less than a fifth preset value.

[0029] The fingerprint sensing system 10 determines the cursor gesture by detecting that the contact time of the finger with the fingerprint sensor 111 is greater than the fourth preset value, and that the total movement of the finger is greater than or equal to the fifth preset value.

[0030] The fingerprint sensing system 10 determines a right-hand rotation gesture by determining, based on multiple consecutive fingerprint images, that the finger rotation angle θ4 is greater than a sixth preset value (e.g., +30 degrees), and that the cumulative values ​​of the finger's X-direction movement dx and Y-direction movement dy are both less than a seventh preset value (indicating that the user has no intention of moving the finger). In one embodiment, the fingerprint sensing system 10 generates the rotation angle θ4 by accumulating the rotation angles θ3 of multiple consecutive fingerprint images within a preset time period.

[0031] The fingerprint sensing system 10 determines a left-hand rotation gesture by detecting that the finger rotation angle θ4 is less than an eighth preset value (e.g., -30 degrees), and that the finger's X-direction movement dx and Y-direction movement dy are both less than the seventh preset value (indicating that the user has no intention of moving the finger).

[0032] The above description is merely an embodiment of the present invention and is not intended to limit the present invention in any way. Although the present invention has been disclosed above by way of embodiment, it is not intended to limit the present invention. Anyone skilled in the art can make some modifications or alterations to the above-disclosed technical content to create equivalent embodiments without departing from the scope of the present invention. Any simple modifications, equivalent changes and alterations made to the above embodiments based on the technical essence of the present invention without departing from the scope of the present invention shall still fall within the scope of the present invention.

[0033] 10: Fingerprint sensing system 11: Fingerprint sensing module 111: Fingerprint sensor 112: Controller 13: Vibration sensor 14: Central Processing Unit 15: Applications 16: Driver 20: Fingerprint image 21: Fingerprint image 22: Fingerprint image 221: Area 1 2211: Center point 23: Fingerprint image 231: Second Region 2311: Center point 24: Fingerprint image 25: Fingerprint image 30: Feature points 31: Feature Points 32: Feature Points 33: Feature Points S10: Steps S11: Steps S12: Steps S13: Steps S14: Steps

Claims

1. A fingerprint sensing system, comprising: A fingerprint sensing module includes a fingerprint sensor and a controller, wherein the controller is connected to the fingerprint sensor, the fingerprint sensor is used to sense the fingerprint of a finger to generate multiple consecutive fingerprint images, the controller is used to generate a recognition result based on at least one of the multiple consecutive fingerprint images, and to generate at least one movement information based on the multiple consecutive fingerprint images; and a central processing unit coupled to the fingerprint sensing module, the central processing unit is used to execute an application and a driver; wherein the driver receives the recognition result and the at least one movement information, the central processing unit starts the application according to the recognition result, and the central processing unit controls the movement of a cursor according to the at least one movement information.

2. The fingerprint sensing system as claimed in claim 1, wherein the at least one movement information includes at least one of horizontal movement amount, vertical movement amount, and movement direction.

3. The fingerprint sensing system as claimed in claim 2, wherein the central processing unit determines the direction of finger movement based on the cumulative value of the vertical or horizontal movement reaching a threshold within a preset time period.

4. The fingerprint sensing system as described in claim 2 further includes multiplying the horizontal movement amount and the vertical movement amount by a parameter value to obtain the movement amount of the cursor.

5. The fingerprint sensing system as described in claim 1 further includes using bilinear interpolation or bicubic interpolation to generate the cursor movement.

6. The fingerprint sensing system as claimed in claim 1, wherein the application displays multiple function options on a display in the form of a rotary menu, and the central processing unit determines which of the multiple function options is selected based on the position of the cursor.

7. The fingerprint sensing system as claimed in claim 1, wherein the application displays multiple function options on a display in the form of a long menu, and the central processing unit determines which of the multiple function options is selected based on the position of the cursor.

8. The fingerprint sensing system as claimed in claim 1, wherein the controller further includes generating at least one angle information based on the plurality of consecutive fingerprint images.

9. The fingerprint sensing system as claimed in claim 8, wherein the at least one angle information includes at least one of a rotation angle and a rotation direction.

10. The fingerprint sensing system as claimed in claim 8, wherein the application displays multiple function options on a display in the form of a rotary menu, and the central processing unit determines the rotation direction of the finger based on the at least one angle information, and then determines which of the multiple function options is selected.

11. The fingerprint sensing system as claimed in claim 8, wherein the application displays multiple function options on a display in the form of a long menu, and the central processing unit determines the direction of finger movement based on the at least one movement information, and then determines which of the multiple function options is selected.

12. The fingerprint sensing system of claim 1, wherein the method by which the controller generates the at least one movement information includes comparing feature points of two consecutive fingerprint images using a computer vision method to calculate the amount of movement of the finger in the vertical and horizontal directions as the at least one movement information.

13. The fingerprint sensing system of claim 1, wherein the method by which the controller generates the at least one movement information comprises: The first region of the t-th fingerprint image from the multiple consecutive fingerprint images is used as a template, where t is a positive integer greater than 0; Find the second region that is most similar to the first region in the (t+1)th fingerprint image of the multiple consecutive fingerprint images; and calculate the amount of movement of the finger in the vertical and horizontal directions based on the coordinates of the first region and the second region as the at least one movement information.

14. The fingerprint sensing system of claim 1, wherein the method by which the controller generates the at least one movement information comprises: Calculate the first centroid position of the t-th fingerprint image from the multiple consecutive fingerprint images, where t is a positive integer greater than 0; Calculate the second centroid position of the (t+1)th fingerprint image from the multiple consecutive fingerprint images; and generate the amount of movement of the finger in the vertical and horizontal directions based on the first centroid position and the second centroid position as the at least one movement information.

15. The fingerprint sensing system of claim 8, wherein the controller generates the at least one angle information by calculating the rotation angle of the finger or the rotation direction of the finger as the at least one angle information using a computer vision method based on two consecutive fingerprint images.

16. The fingerprint sensing system as claimed in claim 1 further includes a vibration sensor connected to the controller for providing tactile feedback to the user.

17. A fingerprint sensing system, comprising: A fingerprint sensing module includes a fingerprint sensor for sensing the fingerprint of a finger to generate multiple consecutive fingerprint images. The system also includes a central processing unit coupled to the fingerprint sensing module, the central processing unit executing an application and a driver; wherein the fingerprint sensing module transmits a plurality of consecutive fingerprint images to the driver; wherein the driver identifies at least one of the plurality of consecutive fingerprint images to generate an identification result, and generates at least one movement information based on the plurality of consecutive fingerprint images, the central processing unit launching the application in response to the identification result; wherein the central processing unit controls the movement of a cursor based on the at least one movement information.

18. The fingerprint sensing system of claim 17, wherein the at least one movement information includes at least one of horizontal movement amount, vertical movement amount, and movement direction.

19. The fingerprint sensing system of claim 18, wherein the central processing unit determines the direction of finger movement based on the cumulative value of the vertical or horizontal movement reaching a threshold within a preset time period.

20. The fingerprint sensing system as claimed in claim 18 further includes multiplying the horizontal movement amount and the vertical movement amount by a parameter value to obtain the movement amount of the cursor.

21. The fingerprint sensing system as described in claim 17 further includes using bilinear interpolation or bicubic interpolation to generate the cursor movement.

22. The fingerprint sensing system as claimed in claim 17, wherein the application displays multiple function options on a display in the form of a rotary menu, and the central processing unit determines which of the multiple function options is selected based on the position of the cursor.

23. The fingerprint sensing system as claimed in claim 17, wherein the application displays multiple function options on a display in the form of a long menu, and the central processing unit determines which of the multiple function options is selected based on the position of the cursor.

24. The fingerprint sensing system as claimed in claim 17, wherein the driver further includes generating at least one angle information based on the plurality of consecutive fingerprint images.

25. The fingerprint sensing system of claim 24, wherein the at least one angle information includes at least one of rotation angle and rotation direction.

26. The fingerprint sensing system of claim 24, wherein the application displays multiple function options on a display in the form of a rotary menu, and the central processing unit determines the rotation direction of the finger based on the at least one angle information, and then determines which of the multiple function options is selected.

27. The fingerprint sensing system of claim 24, wherein the application displays multiple function options in the form of a bar menu on a display, and the central processing unit determines the direction of finger movement based on the at least one movement information, and then determines which of the multiple function options is selected.

28. The fingerprint sensing system of claim 17, wherein the method of the driver generating the at least one movement information includes comparing feature points of two consecutive fingerprint images using a computer vision method to calculate the amount of movement of the finger in the vertical and horizontal directions as the at least one movement information.

29. The fingerprint sensing system of claim 17, wherein the method by which the driver generates the at least one movement information comprises: The first region of the t-th fingerprint image from the multiple consecutive fingerprint images is used as a template, where t is a positive integer greater than 0; Find the second region that is most similar to the first region in the (t+1)th fingerprint image of the multiple consecutive fingerprint images; and calculate the amount of movement of the finger in the vertical and horizontal directions based on the coordinates of the first region and the second region as the at least one movement information.

30. The fingerprint sensing system of claim 17, wherein the method by which the driver generates the at least one movement information comprises: Calculate the first centroid position of the t-th fingerprint image from the multiple consecutive fingerprint images, where t is a positive integer greater than 0; Calculate the second centroid position of the (t+1)th fingerprint image from the multiple consecutive fingerprint images; and generate the amount of movement of the finger in the vertical and horizontal directions based on the first centroid position and the second centroid position as the at least one movement information.

31. The fingerprint sensing system of claim 24, wherein the method by which the driver generates the at least one angle information is to calculate the rotation angle of the finger or the rotation direction of the finger as the at least one angle information using a computer vision method based on two consecutive fingerprint images.

32. The fingerprint sensing system as claimed in claim 17 further includes a vibration sensor connected to the controller for providing tactile feedback to the user.

33. A method of operating a fingerprint sensing system, comprising the following steps: sensing a fingerprint of a finger to generate multiple consecutive fingerprint images; identifying at least one of the multiple consecutive fingerprint images to generate an identification result; launching an application based on the identification result; generating at least one motion information based on the multiple consecutive fingerprint images; and controlling the movement of a cursor based on the at least one motion information.

34. The operation method as described in claim 33, wherein the at least one movement information includes at least one of horizontal movement amount, vertical movement amount, and movement direction.

35. The method of operation as described in claim 34 further includes determining the direction of movement of the finger based on the cumulative value of the vertical movement or the horizontal movement reaching a critical value within a preset time period.

36. The method of operation as described in claim 34, wherein the step of controlling the movement of the cursor based on the at least one movement information includes multiplying the horizontal movement amount and the vertical movement amount by a parameter value to obtain the movement amount of the cursor.

37. The method of operation as described in claim 33, wherein the step of controlling the movement of the cursor based on the at least one movement information includes using bilinear interpolation or bicubic interpolation to generate the movement amount of the cursor.

38. The method of operation as described in claim 33, wherein the application displays multiple function options on a display in the form of a rotary menu, wherein the step of determining which of the multiple function options is selected includes determining which of the multiple function options is selected based on the position of the cursor.

39. The method of operation as described in claim 33, wherein the application displays multiple function options on a display in the form of a long bar menu, and the central processing unit determines which of the multiple function options is selected based on the position of the cursor.

40. The method of operation as described in claim 33 further includes generating at least one angle information based on the plurality of consecutive fingerprint images.

41. The operation method as described in claim 40, wherein the at least one angle information includes at least one of rotation angle and rotation direction.

42. The method of operation as described in claim 40, wherein the application displays multiple function options on a display in the form of a rotary menu, and the central processing unit determines the rotation direction of the finger based on the at least one angle information, and then determines which of the multiple function options is selected.

43. The method of operation as described in claim 40, wherein the application displays multiple function options on a display in the form of a long menu, and the central processing unit determines the direction of finger movement based on the at least one movement information, and then determines which of the multiple function options is selected.

44. The method of operation as described in claim 33, wherein the step of generating the at least one movement information includes comparing feature points of two consecutive fingerprint images using a computer vision method to calculate the amount of movement of the finger in the vertical and horizontal directions as the at least one movement information.

45. The method of operation as described in claim 33, wherein the step of generating the at least one movement information includes: The first region of the t-th fingerprint image from the multiple consecutive fingerprint images is used as a template, where t is a positive integer greater than 0; Find the second region that is most similar to the first region in the (t+1)th fingerprint image of the multiple consecutive fingerprint images; and calculate the amount of movement of the finger in the vertical and horizontal directions based on the coordinates of the first region and the second region as the at least one movement information.

46. ​​The method of operation as described in claim 33, wherein the step of generating the at least one movement information includes: Calculate the first centroid position of the t-th fingerprint image from the multiple consecutive fingerprint images, where t is a positive integer greater than 0; Calculate the second centroid position of the (t+1)th fingerprint image from the multiple consecutive fingerprint images; and generate the amount of movement of the finger in the vertical and horizontal directions based on the first centroid position and the second centroid position as the at least one movement information.

47. The method of operation as described in claim 40, wherein the step of generating the at least one angle information includes calculating, using a computer vision method, the rotation angle of the finger or the rotation direction of the finger as the at least one angle information based on two consecutive fingerprint images.

48. The method of operation as described in claim 40 further includes providing tactile feedback to the user in response to touch, movement or rotation of the finger.

Images