Fingerprint sensing system and operating method thereof

Abstract

The invention discloses a fingerprint sensing system and an operation method thereof. The fingerprint sensing system comprises a fingerprint sensor, a controller and a central processing unit. The fingerprint sensor senses a fingerprint to generate a plurality of continuous fingerprint images. The controller generates an identification result according to at least one of the plurality of continuous fingerprint images, and generates movement information or angle information according to the plurality of continuous fingerprint images. The central processing unit is used for executing an application program and a driving program. The driving program receives the identification result and the movement information or the angle information, and the central processing unit starts the application program in response to the identification result. The application provides a plurality of function options, and the central processor performs a function of the selected function option in response to the movement information or the angle information.

Description

Technical Field

[0001] The present invention relates to a fingerprint sensing system, and more particularly to a fingerprint sensing system with gesture operation function and its operation method. Background Art

[0002] Due to the uniqueness of fingerprints, fingerprints are often used as a basis for identity recognition. Traditional fingerprint sensing systems are only used to achieve the fingerprint enrollment function to register the user's fingerprint and the fingerprint verification function to verify the user's identity. Summary of the Invention

[0003] One of the objectives of the present invention is to provide a fingerprint sensing system with gesture operation function and its operation method.

[0004] The present invention provides a fingerprint sensing system with gesture operation function, including a fingerprint sensing module and a central processing unit. The fingerprint sensing module includes a fingerprint sensor and a controller, wherein the controller is connected to the fingerprint sensor and the central processing unit. The fingerprint sensor is used to sense the fingerprint of a finger to generate multiple consecutive fingerprint images. The controller is used to identify at least one of the multiple consecutive fingerprint images to generate an identification result, and is used to generate at least one movement information or at least one angle information based on the multiple consecutive fingerprint images. The central processing unit is used to execute an application program and a driver program, wherein the application program is used to provide multiple function options. The driver program receives the identification result and the at least one movement information or the at least one angle information, the central processing unit starts the application program according to the identification result, and the central processing unit determines which one of the multiple function options is selected according to the at least one movement information or the at least one angle information, and executes the function of the selected function option.

[0005] The present invention also provides a fingerprint sensing system with gesture operation function, including a fingerprint sensing module and a central processing unit. The fingerprint sensing module includes a fingerprint sensor. The fingerprint sensor is used to sense the fingerprint of a finger to generate multiple consecutive fingerprint images. The central processing unit is used to execute an application program and a driver program. The fingerprint sensing module transmits the multiple consecutive fingerprint images to the driver program. The driver program identifies at least one of the multiple consecutive fingerprint images to generate an identification result, and generates at least one movement information or at least one angle information based on the multiple consecutive fingerprint images. The central processing unit starts the application program according to the identification result. The central processing unit determines which one of the multiple function options is selected according to the at least one movement information or the at least one angle information, and executes the function of the selected function option.

[0006] The present invention further provides an operation method for a fingerprint sensing system, including: sensing the fingerprint of a finger to generate a plurality of consecutive fingerprint images; identifying at least one of the plurality of consecutive fingerprint images to generate an identification result; starting an application program according to the identification result, wherein the application program provides a plurality of function options; generating at least one movement information or at least one angle information according to the plurality of consecutive fingerprint images; and determining which one of the plurality of function options is selected according to the movement information or the angle information, and executing the function of the selected function option.

[0007] The fingerprint sensing system of the present invention is another input device different from the existing touchpad, used to provide another input option. The fingerprint sensing system of the present invention is more simple and elegant in operation. For example, the fingerprint sensing system of the present invention can start different application programs through the fingerprints of different fingers, and can also select function options by rotating the finger. Brief Description of the Drawings

[0008] Figure 1 Showing an embodiment of the fingerprint sensing system with gesture operation function of the present invention.

[0009] Figure 2 Showing a central processing unit with an application program and a driver.

[0010] Figure 3 Showing a flowchart of the operation method of the fingerprint sensing system of the present invention.

[0011] Figure 4 Showing an embodiment of generating movement information and angle information.

[0012] Figure 5 Showing an embodiment of generating movement information.

[0013] Figure 6 Showing an embodiment of generating movement information.

[0014] Figure 7 Showing an embodiment of a roulette menu.

[0015] Figure 8 Showing an embodiment of a long menu.

[0016] Explanation of the reference numerals: 10-fingerprint sensing system; 11-fingerprint sensing module; 111-fingerprint sensor; 112-controller; 13-vibration sensor; 14-central processing unit; 15-application; 16-driver; 20-fingerprint image; 21-fingerprint image; 22-fingerprint image; 221-first area; 2211-center point; 23-fingerprint image; 231-second area; 2311-center point; 24-fingerprint image; 25-fingerprint image; 30-feature point; 31-feature point; 32-feature point; 33-feature point; S10-step; S11-step; S12-step; S13-step; S14-step. DETAILED DESCRIPTION

[0017] Figure 1 The embodiment of the fingerprint sensing system with gesture operation function of the present invention is shown. The fingerprint sensing system 10 includes a fingerprint sensing module 11, a vibration sensor 13 and a central processing unit (CPU) 14. The fingerprint sensing module 11 includes a fingerprint sensor 111 and a controller 112. The controller 112 is connected to the fingerprint sensor 111, the vibration sensor 13 and the central processing unit 14. The controller 112 can be, but is not limited to, a microcontroller unit (MCU). Figure 2 As shown, the central processing unit 14 is used to execute an application 15 and a driver 16. The driver 16 is used to provide communication between the central processing unit 14 and the controller 112. The vibration sensor 13 is used to provide a tactile feedback to the user. For example, the vibration sensor 13 can inform the user through vibration that the finger has touched the fingerprint sensor 111, the fingerprint of the finger has been registered, or the fingerprint of the finger has passed the authentication. The application 15 and the driver 16 can be built in the operating system. In one embodiment, the central processing unit 14 can be a central processing unit CPU (Central Processing Unit) of a desktop computer or a notebook computer, the operating system can be but not limited to the Windows operating system of Microsoft Corporation, and the application 15 can be but not limited to realizing a cursor control function or displaying a menu on a display, such as a roulette menu or a long menu, and the roulette menu or the long menu is used to provide a variety of function options. The driver 16 can be but not limited to Windows Hallo. In one embodiment, the fingerprint sensing module 11 can be integrated into a button, such as a power button or a COPILOT button. In one embodiment, the fingerprint sensor 111 and the controller 112 are integrated into one integrated circuit device. In other embodiments, the controller 111 and the fingerprint sensor 112 may also be two independent integrated circuit devices. In one embodiment, the vibration sensor 13 may also be omitted.

[0018] The application program 15 and the driver program 16 are both operated by the central processing unit 14. Therefore, those of ordinary skill in the art of information technology should be able to understand that the actions performed by the application program 15 and the driver program 16 are carried out through the central processing unit 14.

[0019] Figure 3 A flowchart showing the operation method of the fingerprint sensing system of the present invention is shown. Refer to Figure 1 , Figure 2 and Figure 3 , the fingerprint sensor 111 can sense the fingerprint of the user to generate a plurality of consecutive fingerprint images, as shown in step S10. Next, the controller 112 identifies at least one of the plurality of consecutive fingerprint images to generate an identification result, as shown in step S11. Specifically, in step S11, the controller 112 compares at least one of the plurality of consecutive fingerprint images with the registered fingerprint template to generate the identification result. The identification result is "pass", indicating that the user has passed the authentication. The identification result is "fail", indicating that the user has not passed the authentication. The content of the identification result may further include which finger has passed the fingerprint verification, such as the index finger or the thumb. The content of the identification result may also include which user has passed the fingerprint verification. In one embodiment, the controller 112 has a fingerprint recognition algorithm (not shown in the figure) and an algorithm accelerator (not shown in the figure). The fingerprint recognition algorithm of the controller 112 is implemented by firmware, and the algorithm accelerator of the controller 112 can be implemented by hardware circuit and / or firmware. The fingerprint recognition algorithm and the algorithm accelerator are used to perform the identification of fingerprint images. In one embodiment, the processing time of the algorithm accelerator for one fingerprint image is less than 35 ms, so that the processing speed of the algorithm accelerator can be greater than 30 FPS. In one embodiment, the fingerprint recognition algorithm and the algorithm accelerator can also be built in the driver program 16. In this embodiment, the fingerprint recognition algorithm and the algorithm accelerator in the driver program 16 are implemented by software. The controller 112 or the fingerprint sensor 111 transmits the plurality of consecutive fingerprint images to the driver program 16 of the central processing unit 14, and then the driver program 16 identifies at least one of the plurality of consecutive fingerprint images to generate the identification result.

[0020] Whether the driver program 16 obtains the identification result from the controller 112 or the driver program 16 identifies at least one of the plurality of consecutive fingerprint images to generate the identification result, it means that the central processing unit 14 obtains the identification result of the fingerprint verification. Next, the central processing unit 14 starts the application program 15 according to the identification result, as shown in step S12. Although Figure 2In the embodiment, only one application 15 is shown, but actually there can be multiple applications 15. The central processing unit 14 can start different applications 15 according to different recognition results. In one embodiment, the controller 112 or the central processing unit 14 stores fingerprint templates of multiple fingers (such as index finger, middle finger, ring finger, thumb and little finger) of one user. The controller 112 or the driver 16 can judge whether the finger sensed by the fingerprint sensor 111 is the index finger, middle finger, ring finger, thumb or little finger of the user according to the fingerprint templates of the multiple fingers to generate the recognition result. The central processing unit 14 can start different applications 15 accordingly, or start different modules in the application 15. The started application can display different roulette menus or strip menus on a display (not shown in the figure). Different roulette menus or strip menus provide different multiple functions. In other words, different fingers can start different applications. In another embodiment, the controller 112 or the central processing unit 14 stores fingerprint templates of multiple users. The controller 112 or the driver 16 can judge the identity of the user as user A, user B or an unregistered user according to the fingerprint templates of the multiple users to generate the recognition result. The central processing unit 14 can then start different applications 15 according to the recognition result, or start different modules in the application 15. The started application 14 can display different roulette menus or strip menus on a display (not shown in the figure). Different roulette menus or strip menus provide different multiple functions. In other words, different users can open different applications.

[0021] After the application 15 is started, the fingerprint sensing system 10 proceeds to step S13. In step S13, the controller 112 generates at least one movement information and / or at least one angle information based on the multiple consecutive fingerprint images and gives them to the driver 16. In one embodiment, the multiple consecutive fingerprint images generated by the fingerprint sensor 111 can also be transmitted to the driver 16 of the central processing unit 14 via the controller 112 or the transmission interface, and the driver 16 then generates at least one movement information and / or at least one angle information based on the multiple consecutive fingerprint images.

[0022] Figure 4An embodiment of generating movement information and angle information using computer vision methods is shown. The controller 112 or the central processing unit 14 can determine the relative displacement between two consecutive fingerprint images 20 and 21, and determine the rotation direction and rotation angle of the fingerprint image 21 relative to the fingerprint image 20. The methods for determining the relative displacement, rotation direction and rotation angle of the two fingerprint images 20 and 21 include, but are not limited to, computer vision methods. Well-known computer vision methods such as AKAZE, SURF, SIFT or other feature point matching methods, for example, using LBP (Local Binary Pattern) for feature matching, etc. In Figure 4 the embodiment, the controller 112 or the central processing unit 14 finds multiple feature points (at least four) in the fingerprint images 20 and 21 through computer vision methods, and converts the fingerprint image data around the multiple feature points into feature descriptors through mathematical operations. Finally, the method of comparing distances is used to determine which feature points to retain. For example, Figure 4 the feature points 30, 31, 32 and 33 in represent the feature points retained after comparison. According to the positions of these four feature points in the fingerprint image 20 and the fingerprint image 21, through the operation of the RANdom SAmple Consensus (RANSAC) algorithm, the movement amount dx of the finger in the X direction (horizontal direction), the movement amount dy of the finger in the Y direction (vertical direction) and the rotation angle of the finger can be obtained. According to the movement amount dx in the X direction and the movement amount dy in the Y direction, the movement direction of the finger can be judged (for example, moving up or down in the vertical direction, or moving left or right in the horizontal direction). In an embodiment, the controller 112 or the central processing unit 14 can judge the movement direction of the finger according to whether the movement amount dx in the X direction and the movement amount dy in the Y direction are positive or negative. According to whether the calculated rotation angle is positive or negative, the rotation direction of the finger can be judged.

[0023] Figure 5 Another embodiment of generating movement information is shown. In step S13, the controller 112 or the central processing unit 14 can also use the block matching algorithm to obtain movement information. As Figure 5As shown in the figure, in the block matching algorithm, the first region 221 of the t-th fingerprint image 22 among the multiple consecutive fingerprint images is used as a template, and the second region 231 most similar to the first region 221 is found in the (t + 1)-th fingerprint image 23 among the multiple consecutive fingerprint images, where t is a positive integer greater than 0. Finally, the block matching algorithm calculates the movement amounts of the finger in the vertical direction (Y direction) and the horizontal direction (X direction) based on the coordinates (X3, Y3) and (X4, Y4) of the center points 2211 and 2311 of the first region 221 and the second region 231. The movement amount dx in the X direction is X4 - X3, and the movement amount dy in the Y direction is Y4 - Y3. The controller 112 or the central processing unit 14 can determine the movement direction of the finger based on whether the movement amount dx in the X direction and the movement amount dy in the Y direction are positive or negative. Generally, the first region 221 is the central region of the fingerprint image 22, but the present invention is not limited thereto.

[0024] Figure 6 Another embodiment of generating movement information is shown. In step S13, the controller 112 or the central processing unit 14 can also obtain movement information through the center of gravity of the fingerprint image. The controller 112 or the central processing unit 14 calculates the first center of gravity A of the t-th fingerprint image 24 among the multiple consecutive fingerprint images and calculates the second center of gravity B of the (t + 1)-th fingerprint image 25 among the multiple consecutive fingerprint images, where t is a positive integer greater than 0. Next, the controller 112 or the central processing unit 14 can calculate the movement amount dx in the X direction and the movement amount dy in the Y direction of the finger according to the position difference between the first center of gravity A and the second center of gravity B, and can determine the movement direction of the finger based on whether the movement amounts dx and dy are positive or negative. In one embodiment, the fingerprint sensor 111 includes 5 X-direction electrodes and 5 Y-direction electrodes. The intersection of these 5 X-direction electrodes and 5 Y-direction electrodes forms 25 sensing points. The method for calculating the center of gravity position includes accumulating the sensing amounts of the sensing points on each electrode as the sensing amount of the electrode to calculate the 5 sensing amounts of the 5 X-direction electrodes and the 5 sensing amounts of the 5 Y-direction electrodes. Next, the X-direction coordinate of the center of gravity can be calculated according to the coordinates of these 5 X-direction electrodes and their sensing amounts. For example, the X-direction coordinate of the center of gravity is calculated using the following formula:

[0025] (X1*C1 + X2*C2 + X3*C3 + X4*C4 + X5*C5) / (X1 + X2 + X3 + X4 + X5) Formula 1

[0026] where X1 to X5 are the coordinates of the 5 X-direction electrodes respectively, and C1 to C5 are the sensing amounts of the 5 X-direction electrodes respectively. Similarly, the Y-direction coordinate of the center of gravity can be calculated according to the coordinates of these 5 Y-direction electrodes and their sensing amounts.

[0027] In other embodiments, the at least one movement information may include at least one of the X-direction movement amount dx, the Y-direction movement amount dy, and the finger movement direction, and the at least one angle information includes at least one of the rotation direction and the rotation angle.

[0028] After step S13, the fingerprint sensing system 10 proceeds to step S14. In step S14, the central processing unit 14 selects one of a plurality of function options in a menu (such as the aforementioned roulette menu or strip menu) according to the at least one movement information and / or at least one of the angle information, and executes the function of the selected function option.

[0029] In an embodiment of step S14, the central processing unit 14 controls the movement of the cursor according to the movement information, and selects a function option according to the position of the cursor. Specifically, assuming that the application 15 displays a roulette menu or a strip menu with a plurality of function options on a display (not shown in the figure) in step S12, the central processing unit 14 can control the movement of the cursor according to the movement information in step S14. After the cursor moves to the function option to be selected, the user can use a preset gesture to make the application 15 execute the function of the function option at the position of the cursor. The preset gesture may be, but is not limited to, lifting the finger from the fingerprint sensor 111 or clicking on the fingerprint sensor 111. In one embodiment, since the resolution (DPI) of the fingerprint sensor 111 is different from the resolution of the display, the method of controlling the cursor movement includes multiplying the X-direction movement amount dx and the Y-direction movement amount dy by a parameter value S as the movement amount of the cursor. In another embodiment, the method of controlling the cursor movement includes using bilinear interpolation or bicubic interpolation to magnify a plurality of consecutive fingerprint images by N times, and then according to Figures 4 to 6 the method shown, obtaining N times the X-direction movement amount dx and N times the Y-direction movement amount dy of the magnified plurality of consecutive fingerprint images as the movement amount of the cursor. The aforementioned parameters S and N may be fixed values or variable values. In one embodiment, the parameters S and N may be linearly increased or decreased according to the previous movement amounts dx and dy. For example, when the previously calculated movement amounts dx and dy are larger, the values of the parameters S and N may be relatively increased.

[0030] In an embodiment of step S14, to avoid misjudging the moving direction due to finger shaking, the central processing unit 14 determines the moving direction of the finger based on the cumulative value of the horizontal direction movement amount dx or the vertical direction movement amount dy in a plurality of movement information reaching a critical value within a preset time length, and selects a function option corresponding to the moving direction according to the moving direction. When the cumulative value of the horizontal direction movement amount dx is greater than the critical value within the preset time length, it means that the user intentionally slides the finger in the horizontal direction. Similarly, when the cumulative value of the vertical direction movement amount dy is greater than the critical value within the preset time length, it means that the user intentionally slides the finger in the vertical direction. Of course, according to the horizontal direction movement amount dx and the vertical direction movement amount dy, the central processing unit 14 can also determine that the finger is intentionally moving in other directions, such as upper left, lower left, upper right or lower right. More specifically, assume that the preset time length is 1 second, and the fingerprint sensor 111 can obtain 30 consecutive fingerprint images per second. Therefore, 29 horizontal direction movement amounts dx and vertical direction movement amounts dy can be generated per second. The central processing unit 14 continuously accumulates the horizontal direction movement amount dx or the vertical direction movement amount dy. If the total movement amount in the right direction reaches the preset critical value first, it is determined that the user's finger moves to the right.

[0031] In an embodiment of step S14, the central processing unit 14 determines which one of the multiple function options of the roulette menu is selected according to the at least one angle information, and executes the function of the selected function option. Figure 7 An embodiment of displaying a roulette menu is shown. The roulette menu includes function options A to F. When the application program 15 is started, a Figure 7 roulette menu will be displayed on the display. In an embodiment, the application program 15 sets the function option A of the roulette menu as the preset option. When the application program 15 is just started, the function option A will be marked. The methods of marking the function option include but are not limited to enlarging the pattern of the selected function option (as Figure 7 shown) or highlighting the selected function option with a different color. When the display shows Figure 7After the roulette menu, the user can rotate their finger to select a function option on the roulette menu. For example, assuming that the change in the rotation angle of the finger is a threshold value of every 30 degrees, when the finger rotates clockwise and the change in the rotation angle exceeds 30 degrees, the application 15 will move one option position clockwise to select the function option B. On the contrary, when the finger rotates counterclockwise and the change in the rotation angle exceeds 60 degrees, the application 15 will move two option positions counterclockwise to select the function option E. After the user selects the desired function option, the user can use a preset gesture to make the application 15 execute the function of the selected function option. The preset gesture can be but is not limited to lifting the finger off the fingerprint sensor 111 or clicking on the fingerprint sensor 111.

[0032] In one embodiment, when the fingerprint sensing system 10 moves the cursor to a function option in response to the at least one movement information or switches the roulette menu to another function option in response to the at least one angle information, the central processing unit 14 can control the vibration sensor 13 to activate to provide a haptic feedback to the user.

[0033] In one embodiment of step S14, the central processing unit 14 determines which one of the multiple function options of a long strip menu is selected based on the at least one movement information, and executes the function of the selected function option. Figure 8 An embodiment of displaying a long strip menu, the long strip menu includes function options G - K. When the application 15 is launched, it will cause the display to show Figure 8 the long strip menu. In one embodiment, the application 15 sets the function option I in the middle of the long strip menu as the preset option. Therefore, when the application 15 is just launched, the function option I will be marked. The methods of marking the function option include but are not limited to enlarging the pattern of the selected function option or highlighting the selected function option with a different color (such as Figure 8 shown). When the display shows Figure 8After the long strip-shaped menu, the user can slightly move the finger on the fingerprint sensor 111 to select the function option on the long strip-shaped menu. For example, when the cumulative value of the vertical movement amount dy of the finger reaches a critical value within a preset time length and the cumulative value is positive, the central processing unit 14 determines that the finger moves upward. Therefore, the application program 15 will move up one option position to select the function option H. On the contrary, when the cumulative value of the vertical movement amount dy of the finger reaches the critical value within the preset time length and the cumulative value is negative, the central processing unit 14 determines that the finger moves downward. Therefore, the application program 15 will move down one option position to select the function option J. After the user selects the desired function option, the user can use a preset gesture to make the application program 15 execute the function of the selected function option. The preset gesture can be but is not limited to moving the finger away from the fingerprint sensor 111 or clicking on the fingerprint sensor 111.

[0034] In an embodiment, after the user selects the desired function option and executes it, the user can also use the fingerprint sensing system 10 of the present invention to control the function of the executed function option. For example, when the function option executed by the user is volume control or brightness control, the user can set the volume value or brightness value by moving or rotating the finger on the fingerprint sensor 111.

[0035] In the fingerprint sensing system 10 of the present invention, after selecting a function option in the menu, the user can execute the function corresponding to the function option through a gesture on the fingerprint sensor 111. The gesture includes but is not limited to a tap gesture, a double tap gesture, a long touch gesture, a cursor gesture, a rotate right gesture, or a rotate left gesture.

[0036] The fingerprint sensing system 10 determines a click gesture by detecting that the finger touches the fingerprint sensor 111 and then detecting that the finger leaves the fingerprint sensor 111, and the contact time of the finger touching the fingerprint sensor 111 is less than a first preset value. In an embodiment, the method for the fingerprint sensing system 10 to determine whether a finger touches the fingerprint sensor 111 includes but is not limited to judging by the grayscale average value of the fingerprint image output by the fingerprint sensor 111. If the grayscale average value is greater than or equal to a second preset value, it means that a finger touches the fingerprint sensor 111. On the contrary, if the grayscale average value is less than the second preset value, it means that no finger touches the fingerprint sensor 111.

[0037] The method by which the fingerprint sensing system 10 determines a double-tap gesture includes detecting that the finger first touches the fingerprint sensor 111 and then detecting that the finger first leaves the fingerprint sensor 111, and then detecting that the finger second touches the fingerprint sensor 111 and then detecting that the finger second leaves the fingerprint sensor 111, wherein the contact time of the finger touching the fingerprint sensor 111 twice is less than the first preset value, and the time length from the finger first touching the fingerprint sensor 111 to the finger second leaving the fingerprint sensor 111 is less than a third preset value.

[0038] The method by which the fingerprint sensing system 10 determines a long-press gesture includes detecting that the contact time of the finger touching the fingerprint sensor 111 is greater than a fourth preset value, and the total movement amount of the finger is less than a fifth preset value.

[0039] The method by which the fingerprint sensing system 10 determines a cursor gesture includes detecting that the contact time of the finger touching the fingerprint sensor 111 is greater than the fourth preset value, and the total movement amount of the finger is greater than or equal to the fifth preset value.

[0040] The method by which the fingerprint sensing system 10 determines a right-rotation gesture includes determining, based on multiple consecutive fingerprint images, that the rotation angle θ4 of the finger is greater than a sixth preset value (such as +30 degrees), and the cumulative value of the X-direction movement amount dx and the cumulative value of the Y-direction movement amount dy of the finger are both less than a seventh preset value (indicating that the user has no intention of moving the finger). In one embodiment, the fingerprint sensing system 10 accumulates the rotation angles θ3 of multiple consecutive fingerprint images within a preset time to generate the rotation angle θ4.

[0041] The method by which the fingerprint sensing system 10 determines a left-rotation gesture includes detecting that the rotation angle θ4 of the finger is less than an eighth preset value (such as -30 degrees), and the X-direction movement amount dx and the Y-direction movement amount dy of the finger are both less than the seventh preset value (indicating that the user has no intention of moving the finger).

[0042] The above are only embodiments of the present invention and do not impose any formal limitations on the present invention. Although the present invention has been provided above with embodiments, it is not intended to limit the present invention. Any person with ordinary knowledge in the technical field can make some changes or modifications to equivalent embodiments by using the above-disclosed technical content within the scope of the technical solution of the present invention. However, as long as it does not depart from the content of the technical solution of the present invention, any simple modification, equivalent change, and modification made to the above embodiments based on the technical essence of the present invention still fall within the scope of the technical solution of the present invention.

Claims

1. A fingerprint sensing system, characterized in that: include: A fingerprint sensing module, comprising a fingerprint sensor and a controller, wherein the controller is connected to the fingerprint sensor, the fingerprint sensor is used to sense a fingerprint of a finger to generate a plurality of continuous fingerprint images, the controller is used to generate a recognition result according to at least one of the plurality of continuous fingerprint images, and is used to generate at least one movement information or at least one angle information according to the plurality of continuous fingerprint images; and a central processing unit, coupled to the fingerprint sensing module, the central processing unit being used to execute an application and a driver, wherein the application is used to provide a plurality of function options; The driver receives the recognition result and the at least one movement information or the at least one angle information, the central processing unit starts the application according to the recognition result, and the central processing unit determines which one of the multiple function options is selected according to the at least one movement information or the at least one angle information, and executes the function of the selected function option.

2. The fingerprint sensing system according to claim 1, characterized in that: The at least one piece of movement information includes at least one of a horizontal movement amount, a vertical movement amount, and a movement direction, and the at least one piece of angle information includes at least one of a rotation angle and a rotation direction.

3. The fingerprint sensing system as claimed in claim 2, characterized in that: The central processing unit determines the moving direction of the finger according to whether the accumulated value of the vertical movement amount or the horizontal movement amount reaches a critical value within a preset time length.

4. The fingerprint sensing system as claimed in claim 2, characterized in that: The at least one movement information is used to control a cursor.

5. The fingerprint sensing system as claimed in claim 4, characterized in that: The method further includes multiplying the horizontal movement amount and the vertical movement amount by a parameter value to obtain the movement amount of the cursor.

6. The fingerprint sensing system as claimed in claim 4, characterized in that: It also includes using bilinear interpolation or bicubic interpolation to generate the cursor movement amount.

7. The fingerprint sensing system as claimed in claim 4, characterized in that: The application displays the multiple function options in the form of a wheel menu on a display, and the central processing unit determines which one of the multiple function options is selected according to the position of the cursor.

8. The fingerprint sensing system as claimed in claim 4, characterized in that: The application displays the plurality of function options in the form of a long bar menu on a display, and the central processing unit determines which one of the plurality of function options is selected according to the position of the cursor.

9. The fingerprint sensing system as claimed in claim 1, characterized in that: The application displays the multiple function options in the form of a wheel menu on a display, and the central processing unit determines the rotation direction of the finger according to the at least one angle information, and further determines which one of the multiple function options is selected.

10. The fingerprint sensing system according to claim 1, wherein: The application displays the multiple function options in the form of a long strip menu on a display, and the central processing unit determines the moving direction of the finger according to the at least one movement information, and further determines which one of the multiple function options is selected.

11. The fingerprint sensing system according to claim 1, wherein: The method for the controller to generate the at least one movement information includes comparing the feature points of two consecutive fingerprint images using a computer vision method to calculate the movement amount of the finger in the vertical direction and the horizontal direction as the at least one movement information.

12. The fingerprint sensing system according to claim 1, wherein: The method for the controller to generate the at least one movement information includes: Using the first area of ​​the t-th fingerprint image of the plurality of continuous fingerprint images as a template, where t is a positive integer greater than 0; Finding a second region in the t+1th fingerprint image of the plurality of continuous fingerprint images that is most similar to the first region; and The movement amount of the finger in the vertical direction and the horizontal direction is calculated according to the coordinates of the first area and the second area as the at least one movement information.

13. The fingerprint sensing system as claimed in claim 1, characterized in that: The method for the controller to generate the at least one movement information includes: Calculate the first centroid position of the t-th fingerprint image of the multiple consecutive fingerprint images, where t is a positive integer greater than 0; Calculating the second centroid position of the t+1th fingerprint image of the plurality of continuous fingerprint images; and The movement amount of the finger in the vertical direction and the horizontal direction is generated according to the first center of gravity position and the second center of gravity position as the at least one movement information.

14. The fingerprint sensing system according to claim 1, wherein: The controller generates the at least one angle information by using a computer vision method to calculate the rotation angle of the finger or the rotation direction of the finger according to two consecutive fingerprint images as the at least one angle information.

15. The fingerprint sensing system as claimed in claim 1, characterized in that: A vibration sensor is also included which is connected to the controller to provide a tactile feedback to the user.

16. A fingerprint sensing system, characterized in that: include: A fingerprint sensing module, comprising a fingerprint sensor, the fingerprint sensor is used to sense a fingerprint of a finger to generate a plurality of continuous fingerprint images; as well as a central processing unit, coupled to the fingerprint sensing module, the central processing unit being used to execute an application and a driver, wherein the application is used to provide a plurality of function options; Wherein, the fingerprint sensing module transmits the plurality of continuous fingerprint images to the driver; The driver program identifies at least one of the plurality of continuous fingerprint images to generate a recognition result, and generates at least one movement information or at least one angle information according to the plurality of continuous fingerprint images, and the central processing unit activates the application program according to the recognition result; The central processing unit determines which one of the plurality of function options is selected according to the at least one movement information or the at least one angle information, and executes the function of the selected function option.

17. The fingerprint sensing system according to claim 16, wherein: The at least one piece of movement information includes at least one of a horizontal movement amount, a vertical movement amount, and a movement direction, and the at least one piece of angle information includes at least one of a rotation angle and a rotation direction.

18. The fingerprint sensing system according to claim 17, wherein: The central processing unit determines the moving direction of the finger according to whether the accumulated value of the vertical movement amount or the horizontal movement amount reaches a critical value within a preset time length.

19. The fingerprint sensing system according to claim 17, wherein: The at least one movement information is used to control a cursor.

20. The fingerprint sensing system of claim 19, wherein: The method further includes multiplying the horizontal movement amount and the vertical movement amount by a parameter value to obtain the movement amount of the cursor.

21. The fingerprint sensing system of claim 19, wherein: It also includes using bilinear interpolation or bicubic interpolation to generate the cursor movement amount.

22. The fingerprint sensing system of claim 19, wherein: The application displays the multiple function options in the form of a wheel menu on a display, and the central processing unit determines which one of the multiple function options is selected according to the position of the cursor.

23. The fingerprint sensing system of claim 19, wherein: The application displays the plurality of function options in the form of a long bar menu on a display, and the central processing unit determines which one of the plurality of function options is selected according to the position of the cursor.

24. The fingerprint sensing system of claim 16, wherein: The application displays the multiple function options in the form of a wheel menu on a display, and the central processing unit determines the rotation direction of the finger according to the at least one angle information, and further determines which one of the multiple function options is selected.

25. The fingerprint sensing system of claim 16, wherein: The application displays the multiple function options in the form of a long strip menu on a display, and the central processing unit determines the moving direction of the finger according to the at least one movement information, and further determines which one of the multiple function options is selected.

26. The fingerprint sensing system of claim 16, wherein: The method for the driver to generate the at least one movement information includes comparing the feature points of two consecutive fingerprint images by computer vision method to calculate the movement amount of the finger in the vertical direction and the horizontal direction as the at least one movement information.

27. The fingerprint sensing system of claim 16, wherein: The method for the driver to generate the at least one movement information includes: Using the first area of ​​the t-th fingerprint image of the plurality of continuous fingerprint images as a template, where t is a positive integer greater than 0; Finding a second region in the t+1th fingerprint image of the plurality of continuous fingerprint images that is most similar to the first region; and The movement amount of the finger in the vertical direction and the horizontal direction is calculated according to the coordinates of the first area and the second area as the at least one movement information.

28. The fingerprint sensing system of claim 16, wherein: The method for the driver to generate the at least one movement information includes: Calculate the first centroid position of the t-th fingerprint image of the multiple consecutive fingerprint images, where t is a positive integer greater than 0; Calculating the second centroid position of the t+1th fingerprint image of the plurality of continuous fingerprint images; and The movement amount of the finger in the vertical direction and the horizontal direction is generated according to the first center of gravity position and the second center of gravity position as the at least one movement information.

29. The fingerprint sensing system of claim 16, wherein: The method for the driver to generate the at least one angle information is to use a computer vision method to calculate the rotation angle of the finger or the rotation direction of the finger according to two consecutive fingerprint images as the at least one angle information.

30. The fingerprint sensing system of claim 16, wherein: A vibration sensor is also included which is connected to the controller to provide a tactile feedback to the user.

31. A method for operating a fingerprint sensing system, characterized in that: The following steps are involved: Sensing a fingerprint of a finger to generate multiple continuous fingerprint images; Recognize at least one of the plurality of continuous fingerprint images to generate a recognition result; Starting an application according to the recognition result, wherein the application provides a plurality of function options; generating at least one piece of movement information or at least one piece of angle information according to the plurality of continuous fingerprint images; as well as Which one of the plurality of function options is selected is determined according to the at least one movement information or the at least one angle information, and the function of the selected function option is executed.

32. The operating method according to claim 31, characterized in that: The at least one piece of movement information includes at least one of a horizontal movement amount, a vertical movement amount, and a movement direction, and the at least one piece of angle information includes at least one of a rotation angle and a rotation direction.

33. The operating method according to claim 32, characterized in that: The method also includes determining the moving direction of the finger according to whether the accumulated value of the vertical movement amount or the horizontal movement amount reaches a critical value within a preset time length.

34. The operating method according to claim 32, characterized in that: Also included is using the at least one movement information to control a cursor.

35. The operating method according to claim 34, characterized in that: The step of using the at least one movement information to control the cursor includes multiplying the horizontal movement amount and the vertical movement amount by a parameter value to obtain the movement amount of the cursor.

36. The operating method according to claim 34, characterized in that: The step of using the at least one movement information to control the cursor includes using bilinear interpolation or bicubic interpolation to generate the movement amount of the cursor.

37. The operating method according to claim 34, characterized in that: The application displays the plurality of function options in the form of a wheel menu on a display, wherein the step of determining which one of the plurality of function options is selected includes determining which one of the plurality of function options is selected according to the position of the cursor.

38. The operating method according to claim 34, characterized in that: The application displays the plurality of function options in the form of a long bar menu on a display, and the central processing unit determines which one of the plurality of function options is selected according to the position of the cursor.

39. The operating method according to claim 31, characterized in that: The application displays the multiple function options in the form of a wheel menu on a display, and the central processing unit determines the rotation direction of the finger according to the at least one angle information, and further determines which one of the multiple function options is selected.

40. The operating method according to claim 31, characterized in that: The application displays the multiple function options in the form of a long strip menu on a display, and the central processing unit determines the moving direction of the finger according to the at least one movement information, and further determines which one of the multiple function options is selected.

41. The operating method according to claim 31, characterized in that: The step of generating the at least one piece of movement information includes comparing the feature points of two consecutive fingerprint images by computer vision method to calculate the movement amount of the finger in the vertical direction and the horizontal direction as the at least one piece of movement information.

42. The operating method according to claim 31, characterized in that: The step of generating the at least one movement information comprises: Using the first area of ​​the t-th fingerprint image of the plurality of continuous fingerprint images as a template, where t is a positive integer greater than 0; Finding a second region in the t+1th fingerprint image of the plurality of continuous fingerprint images that is most similar to the first region; and The movement amount of the finger in the vertical direction and the horizontal direction is calculated according to the coordinates of the first area and the second area as the at least one movement information.

43. The operating method according to claim 31, characterized in that: The step of generating the at least one movement information comprises: Calculate the first centroid position of the t-th fingerprint image of the multiple consecutive fingerprint images, where t is a positive integer greater than 0; Calculating the second centroid position of the t+1th fingerprint image of the plurality of continuous fingerprint images; and The movement amount of the finger in the vertical direction and the horizontal direction is generated according to the first center of gravity position and the second center of gravity position as the at least one movement information.

44. The operating method according to claim 31, characterized in that: The step of generating the at least one angle information includes calculating the rotation angle of the finger or the rotation direction of the finger as the at least one angle information according to two consecutive fingerprint images using a computer vision method.

45. The operating method according to claim 31, characterized in that: The method also includes providing a tactile feedback to the user in response to the touch of the finger, the at least one movement information or the at least one angle information.

Images