Fingerprint authentication device, fingerprint authentication method and program
By generating a presentation image of the root position of the fingernail in the fingerprint authentication device, the user can accurately touch the fingerprint sensor, and solve the problem of low fingerprint information registration or authentication efficiency in the prior art, and achieve efficient fingerprint information acquisition.
Patent Information
- Application Number
- CN202080055552.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-09-18
- Filing Date
- 2020-09-04
- Publication Date
- 2025-08-26
- Estimated Expiration
- 2040-09-04
AI Technical Summary
In the prior art, the registration or authentication of fingerprint information is relatively low and difficult to effectively execute.
By generating and displaying a presentation image of the root position of the finger nail in the fingerprint authentication device, the user is assisted to accurately touch the fingerprint sensor, and the fingerprint image is processed in combination with the processing unit to obtain accurate fingerprint information.
It improves the efficiency of registration and authentication of fingerprint information, ensures accurate acquisition of fingerprint images, and is suitable for various types of fingerprint sensors.
Smart Images

Figure CN114223022B_ABST
Abstract
Description
Technical Field
[0001] The present technology relates to a fingerprint authentication device, a fingerprint authentication method, and a program, and more particularly, to a fingerprint authentication device, a fingerprint authentication method, and a program that efficiently perform registration of fingerprint information or fingerprint authentication. Background Art
[0002] Patent Document 1 discloses displaying a fingerprint registration interface, detecting a plurality of finger gestures performed by a finger on a fingerprint sensor, and collecting fingerprint information from the plurality of finger gestures.
[0003] Citation List
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Publication No. 2018-195316 Summary of the Invention
[0006] Problems to be solved by the present invention
[0007] It is desirable to efficiently perform registration of fingerprint information or authentication of fingerprints.
[0008] The present technology is constructed in view of such circumstances, and makes it possible to efficiently perform registration of fingerprint information or authentication of fingerprints.
[0009] Solution to the problem
[0010] A fingerprint authentication device or program according to one aspect of the present technology relates to: a fingerprint authentication device including: a display control unit that generates a presentation image for presenting the position of the base of the nail of a finger when detecting a fingerprint; and a processing unit that uses the generated presentation image to obtain an image of the fingerprint; or relates to a program for causing a computer to function as such a fingerprint authentication device.
[0011] A fingerprint authentication method according to one aspect of the present technology relates to a fingerprint authentication method for a fingerprint authentication device including a display control unit and a processing unit, the method comprising: using the display control unit to generate a presentation image for presenting the position of the base of the nail of a finger when detecting a fingerprint; and using the processing unit to obtain an image of the fingerprint using the generated presentation image.
[0012] According to a fingerprint authentication device, fingerprint authentication method, and program according to one aspect of the present technology, a rendered image representing the position of the nail base of a finger when a fingerprint image is obtained is generated, and an image of the fingerprint is obtained using the generated rendered image. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] [ Figure 1[is a block diagram showing an exemplary configuration of a fingerprint authentication device according to an embodiment to which the present technology is applied;
[0014] [ Figure 2 ] is a diagram comparing the size of the detection area of the fingerprint sensor and the size of the fingerprint;
[0015] [ Figure 3 ] is a perspective view illustrating the appearance of a smartphone-type device equipped with a fingerprint authentication device;
[0016] [ Figure 4 ] is a front view illustrating the appearance of a wristband-type device equipped with a fingerprint authentication device;
[0017] [ Figure 5 ] is shown Figure 1 A block diagram of an exemplary configuration of a fingerprint registration processing unit in FIG.
[0018] [ Figure 6 ] is a diagram illustrating a finger position presentation image to be displayed on the display unit when the fingerprint registration process starts;
[0019] [ Figure 7 ] is shown in Figure 3 An illustration of an exemplary display of a finger position presentation image in the case of a smartphone-type device, wherein a fingerprint sensor is embedded in the display;
[0020] [ Figure 8 ] is shown in Figure 3 An illustration of an exemplary display of a finger position presentation image in the case of a smartphone-type device shown, wherein a fingerprint sensor is embedded in a portion other than a display;
[0021] [ Figure 9 ] is shown Figure 4 FIG. 1 is a diagram illustrating an exemplary display of an image representing finger positions in a wristband-type device;
[0022] [ Figure 10 ] is a diagram illustrating a fingerprint image obtained by a fingerprint sensor when a user touches a first finger position represented by a finger position representation image with a finger;
[0023] [ Figure 11 ] is an enlarged view illustrating the end points of a fingerprint ridge;
[0024] [ Figure 12 ] is an enlarged view illustrating the branch points of a fingerprint ridge;
[0025] [ Figure 13 ] is a diagram illustrating a finger position presentation image presenting a second finger position;
[0026] [ Figure 14] is an example of when the user touches the Figure 13 a diagram of a fingerprint image obtained by the fingerprint sensor when the finger position rendering image presents a second finger position;
[0027] [ Figure 15 ] is a diagram for explaining the correspondence between the finger position represented by the finger position presenting image and the position of the fingerprint image obtained by the fingerprint sensor in a case where the finger touches the position represented by the finger position presenting image, and is a diagram showing the finger position represented by the finger position presenting image;
[0028] [ Figure 16 ] is a diagram for explaining the correspondence between the finger position represented by the finger position representation image and the position of the fingerprint image obtained by the fingerprint sensor when the finger touches the position represented by the finger position representation image. This diagram is a diagram showing the position of the fingerprint image obtained by the fingerprint sensor;
[0029] [ Figure 17 ] is a diagram illustrating a finger position presentation image showing a third finger position;
[0030] [ Figure 18 ] is an example of when the user touches the Figure 17 a diagram of a fingerprint image obtained by the fingerprint sensor when the finger position rendering image presents a third position;
[0031] [ Figure 19 ] is a diagram showing a state in which a fingerprint image and feature amounts of the entire fingerprint range are obtained;
[0032] [ Figure 20 ] is a diagram illustrating a first mode of an acquisition state image presenting an acquisition state of feature amounts;
[0033] [ Figure 21 ] is a diagram illustrating a second mode of an acquisition status image presenting an acquisition status of feature amounts;
[0034] [ Figure 22 ] is a diagram illustrating a third mode of an acquisition state image presenting an acquisition state of a feature amount;
[0035] [ Figure 23 ] is a diagram illustrating an error image showing an acquisition state of a feature amount;
[0036] [ Figure 24 ] is used to explain Figure 5 Flowchart of an exemplary fingerprint registration process performed by the fingerprint registration processing unit in FIG.
[0037] [ Figure 25 ] is a block diagram showing an exemplary configuration of a fingerprint authentication processing unit;
[0038] [ Figure 26 ] is a diagram illustrating the positional distribution of feature quantities (feature points) of a fingerprint registered as a template;
[0039] [ Figure 27 ] is a diagram illustrating a finger position presentation image to be displayed on a display unit during fingerprint authentication;
[0040] [ Figure 28 ] is a flowchart for explaining an exemplary fingerprint authentication process performed by a fingerprint authentication processing unit;
[0041] [ Figure 29 ] is a block diagram illustrating an exemplary hardware configuration of a computer that executes a series of processes using a program. DETAILED DESCRIPTION
[0042] Hereinafter, embodiments of the present technology will be described with reference to the drawings.
[0043] <<Embodiment of Fingerprint Authentication Device>>
[0044] Figure 1 is a block diagram illustrating an exemplary configuration of a fingerprint authentication device according to an embodiment to which the present technology is applied.
[0045] Figure 1 The fingerprint authentication device 11 is installed in, for example, a wearable device (e.g., a smartphone or a wristband-type device) or a device such as a tablet terminal. The fingerprint authentication device 11 includes a fingerprint sensor 12, an operation input unit 13, a storage unit 14, a display unit 15, and a processing unit 16.
[0046] The fingerprint sensor 12 detects a fingerprint that is in contact with a detection area (detection plane). Specifically, the fingerprint sensor 12 obtains an image of the fingerprint within the range of contact with the detection area (fingerprint image) and provides it to the processing unit 16. The fingerprint sensor 12 can be of any type, such as an optical type, an electrostatic type, and an ultrasonic type. Note that as an optical fingerprint sensor, a fingerprint sensor is known that illuminates a fingerprint placed on a detection area with light, collects light reflected by the fingerprint with a microlens array, and photoelectrically converts the light with an imaging element to obtain a fingerprint image.
[0047] Furthermore, the fingerprint sensor 12 is a small-area sensor in which a detection region for detecting a fingerprint is small relative to a substantially entire range of a fingerprint (hereinafter referred to as the entire range of a fingerprint). Figure 2 1 is a diagram comparing the size of the detection area of the fingerprint sensor 12 and the entire range of the fingerprint. Figure 2In the present invention, the vertical and horizontal widths of detection area 12A of fingerprint sensor 12 are set to be approximately 1 / 4 to 1 / 2 of the vertical and horizontal widths of the entire range of fingerprint 31, respectively. Therefore, the range of the fingerprint image that can be captured by fingerprint sensor 12 at a time is a portion of the entire range of fingerprint 31. By changing the contact portion of fingerprint 31 with detection area 12A and capturing fingerprint images multiple times, a fingerprint image of the entire range of fingerprint 31 can be obtained. Note that this technology is applicable even if fingerprint sensor 12 is not a small-area sensor.
[0048] exist Figure 1 In the example, the operation input unit 13 is a touch panel or operation buttons, and supplies a user operation performed by a user to the processing unit 16.
[0049] The storage unit 14 stores information supplied from the processing unit 16, and further supplies the stored information to the processing unit 16. For example, the storage unit 14 stores fingerprint information of a user to be registered in the fingerprint authentication device 11.
[0050] The display unit 15 displays on a display an image represented by an image signal supplied from the processing unit 16. Note that the display unit 15 may be a display unit in a device connected to the fingerprint authentication device 11 via communication such as Bluetooth (registered trademark), or may be a plurality of separate display units.
[0051] The processing unit 16 performs various types of processing by executing programs. The processing unit 16 includes a processing switching unit 21, a fingerprint registration processing unit 22, a fingerprint authentication processing unit 23, and an image output unit 24 as functional blocks realized by program execution.
[0052] When a user operation for registering a fingerprint is performed on the operation input unit 13, the process switching unit 21 prohibits the processing of the fingerprint authentication processing unit 23 and enables the processing of the fingerprint registration processing unit 22. On the other hand, when a user operation for performing fingerprint authentication is performed on the operation input unit 13, the processing of the fingerprint registration processing unit 22 is prohibited and the processing of the fingerprint authentication processing unit 23 is enabled.
[0053] The fingerprint registration processing unit 22 performs processing to register a user's fingerprint (fingerprint registration processing). Specifically, when registering a user's fingerprint, the fingerprint registration processing unit 22 obtains the fingerprint's feature quantity based on the fingerprint image from the fingerprint sensor 12 as fingerprint information associated with the fingerprint, and creates a template (standard pattern) for fingerprint authentication. The fingerprint registration processing unit 22 then causes the storage unit 14 to store the created template.
[0054] Furthermore, the fingerprint registration processing unit 22 generates a finger position presentation image presenting the finger position when the fingerprint image is obtained using the fingerprint sensor 12 and an acquisition status image presenting the acquisition status (feature amount) of fingerprint information, and supplies them to the image output unit 24 .
[0055] The fingerprint authentication processing unit 23 performs a fingerprint authentication process (fingerprint authentication process). Specifically, when performing fingerprint authentication, the fingerprint authentication processing unit 23 compares the fingerprint information detected from the fingerprint image from the fingerprint sensor 12 with the template stored in the storage unit 14. If the fingerprint information detected from the fingerprint image matches the template through comparison, the fingerprint authentication processing unit 23 determines that user authentication has succeeded. On the other hand, if the fingerprint information detected from the fingerprint image does not match the template, the fingerprint authentication processing unit 23 determines that user authentication has failed. The device equipped with the fingerprint authentication device 11 performs processing based on the authentication result of the fingerprint authentication processing unit 23, that is, the success or failure of the authentication.
[0056] Furthermore, the fingerprint authentication processing unit 23 generates a finger position presentation image presenting the finger position when the fingerprint image is obtained using the fingerprint sensor 12 , and supplies it to the image output unit 24 .
[0057] The image output unit 24 functions as a display control unit that generates an image signal in a predetermined format for causing the display unit 15 to display the image from the fingerprint registration processing unit 22 or the fingerprint authentication processing unit 23, and provides it to the display unit 15 to perform display control of displaying the image represented by the image signal.
[0058] <First Exemplary Apparatus Equipped with Fingerprint Authentication Apparatus 11>
[0059] Figure 3 1 is a perspective view illustrating the appearance of a smartphone-type device equipped with the fingerprint authentication device 11. Figure 3 In FIG. 4 , a smartphone-type device 41 includes a display 42 having a touch panel and a fingerprint sensor 43. The display 42, the touch panel, and the fingerprint sensor 43 correspond to Figure 1 The display unit 15, the operation input unit 13 and the fingerprint sensor 12 are included.
[0060] exist Figure 3 In the embodiment, a display 42 is provided on the front surface of the rectangular housing. The display 42 is, for example, an organic light emitting diode (OLED) display or a liquid crystal display, and includes a touch panel.
[0061] The fingerprint sensor 43 is embedded in the display 42. The fingerprint sensor 43 is, for example, an optical sensor including an imaging unit, and uses the imaging unit (not shown) to capture the fingerprint of the finger in contact with the surface of the detection area 44 to obtain a fingerprint image. However, the fingerprint sensor 43 may be another type of sensor, for example, an ultrasonic type.
[0062] Furthermore, the fingerprint sensor 43 is a small area sensor, wherein the detection area 44 is smaller than the entire range of the fingerprint, such as Figure 2 shown.
[0063] Furthermore, in the smartphone type device 41, a fingerprint sensor 45 may be provided on a side surface of the housing or the like (a portion other than the display 42) instead of the fingerprint sensor 43 embedded in the display 42. The fingerprint sensor 45 corresponds to Figure 1 The fingerprint sensor 12 in FIG. 1 is a small area sensor in which the detection area 46 is smaller than the entire range of the fingerprint. Figure 1 The fingerprint sensor 12 in the embodiment may not be embedded in the display unit 15 and may not include the display unit 15 capable of displaying an image superimposed on the detection area 12A.
[0064] <Second Exemplary Device Equipped with Fingerprint Authentication Device 11>
[0065] Figure 4 1 is a front view illustrating the appearance of a wristband-type device equipped with the fingerprint authentication device 11. Figure 4 In FIG. 5 , a wristband-type device 51 includes a band 52, a display 53, and a fingerprint sensor 54. The display 53 and the fingerprint sensor 54 correspond to Figure 1 The display unit 15 and the fingerprint sensor 12 are included.
[0066] exist Figure 4 , the band 52 is in the shape of a belt and is worn by the user by wrapping it around a wrist or the like.
[0067] The display 53 is, for example, an OLED display or a liquid crystal display, and is provided on the inner peripheral surface or the outer peripheral surface of the belt 52 .
[0068] The fingerprint sensor 54 is embedded in the display 53. The fingerprint sensor 54 is, for example, an optical sensor including an imaging unit, and uses the imaging unit (not shown) to capture the fingerprint of a finger in contact with the surface of the detection area 55 to obtain a fingerprint image. However, the fingerprint sensor 54 may be another type of sensor, for example, an ultrasonic type sensor. In addition, the fingerprint sensor 54 is a small area sensor.
[0069] <Exemplary Configuration of Fingerprint Registration Processing Unit 22>
[0070] Figure 5 It shows Figure 1 2 is a block diagram of an exemplary configuration of the fingerprint registration processing unit 22 in FIG.
[0071] exist Figure 5 In the embodiment, the fingerprint registration processing unit 22 includes a fingerprint image capturing unit 61, a feature amount detecting unit 62, a checking unit 63, a central processing unit 64, a fingerprint image combining unit 65, a finger position presentation image generating unit 66 and an acquisition status image generating unit 67.
[0072] The fingerprint image capturing unit 61 captures (obtains) a fingerprint image from the fingerprint sensor 12 based on an instruction from the central processing unit 64 , and supplies it to the feature amount detecting unit 62 and the fingerprint image combining unit 65 .
[0073] The feature amount detection unit 62 extracts a plurality of feature points (minutiae) included in the fingerprint based on the fingerprint image from the fingerprint image capture unit 61, and detects a feature amount indicating the position and direction of each feature point as fingerprint information. The feature amount detection unit 62 supplies the detected feature amount to the verification unit 63.
[0074] The checking unit 63 registers the feature amounts from the feature amount detection unit 62 that are not registered as templates as templates in the storage unit 14. That is, the checking unit 63 checks the feature amounts registered as templates with the feature amounts from the feature amount detection unit 62. Then, the checking unit 63 registers the feature amounts from the feature amount detection unit 62 that are not registered as templates as templates in the storage unit 14.
[0075] Furthermore, in a case where the degree of matching between the feature amount registered as the template and the feature amount from the feature amount detection unit 62 is equal to or higher than a predetermined threshold, for example, the collation unit 63 determines that the feature amount registered as the template and the feature amount from the feature amount detection unit 62 match each other. On the other hand, in a case where the degree of matching between the feature amount registered as the template and the feature amount from the feature amount detection unit 62 is less than the threshold, the collation unit 63 determines that the feature amount registered as the template and the feature amount from the feature amount detection unit 62 do not match each other. The collation unit 63 then supplies the collation result as to whether the feature amount registered as the template and the feature amount from the feature amount detection unit 62 match each other to the central processing unit 64.
[0076] Whenever a verification result is provided from the verification unit 63, the central processing unit 64 instructs the fingerprint image capturing unit 61 to capture a new fingerprint image from the fingerprint sensor 12. Furthermore, the central processing unit 64 instructs the finger position presentation image generating unit 66 to change the finger position presented to the user using the finger position presentation image based on the verification result from the verification unit 63. Furthermore, the central processing unit 64 provides the acquisition status image generating unit 67 with the acquisition status of the feature quantity in the feature quantity detecting unit 62.
[0077] The fingerprint image combining unit 65 combines (combines) fingerprint images obtained from different parts of the entire fingerprint range, which are fingerprint images from the fingerprint image capturing unit 61, to generate a fingerprint image of the entire fingerprint range. The fingerprint image combining unit 65 causes the storage unit 14 to store the combined fingerprint image. Note that the fingerprint image does not necessarily need to be stored, and the fingerprint image combining unit 65 does not necessarily need to be provided.
[0078] The finger position presentation image generation unit 66 generates a finger position presentation image that presents the finger position when the fingerprint image is obtained using the fingerprint sensor 12, and supplies it to the image output unit 24. In addition, in the case where the central processing unit 64 issues an instruction to change the finger position, the finger position presentation image generation unit 66 generates a finger position presentation image that presents the change in the finger position to be displayed, and supplies it to the image output unit 24. Note that even in the case of information other than the finger position presentation image 71, the finger position presentation image generation unit 66 generates information to be displayed on the display unit 15 and supplies it to the image output unit 24.
[0079] The acquisition status image generation unit 67 generates an acquisition status image that presents the acquisition status of the feature amount to the user based on the acquisition status of the feature amount from the central processing unit 64 , and supplies it to the image output unit 24 .
[0080] <Details of Processing by Fingerprint Registration Processing Unit 22>
[0081] Next, the fingerprint registration processing in the fingerprint registration processing unit 22 will be described in detail.
[0082] Figure 6 is a diagram illustrating a finger position presentation image to be displayed on the display unit 15 when the fingerprint registration process starts. Figure 6 A to C in FIG. 7 show the finger position presentation images 71 sequentially displayed on the display unit 15 immediately after the fingerprint registration process starts.
[0083] Note that the finger positions represented by the finger position representation image are sequentially changed from a predetermined first finger position to an M-th (M is an integer of 2 or greater) finger position. Figure 6The finger position presentation image 71 of A to C in FIG. 7A presents the first finger position.
[0084] exist Figure 6 In FIG. 1A , finger position presentation image 71 is a cross-shaped cross image 72 in which horizontal line 72A intersects vertical line 72B. Finger position reference point 72C is the intersection of horizontal line 72A and vertical line 72B. Cross image 72 is displayed with finger position reference point 72C located substantially at the center of detection area 12A of fingerprint sensor 12. Note that the dotted frame indicating detection area 12A is not displayed on display unit 15.
[0085] The fingertip image 73 is added to the cross image 72 in a manner superimposed on the cross image 72. Figure 6 After A, the display unit 15 displays Figure 6 The finger position in B is presented in image 71. Fingertip image 73 includes the outline of the fingertip and nail image 74. Nail root 74A is the boundary between the exposed part of the nail and the skin, indicating the middle position in the width direction of the nail (finger). Then, fingertip image 73 is displayed so that nail root 74A coincides with finger position reference point 72C in cross image 72.
[0086] A circular mark 75 is added to the cross image 72 and the fingertip image 73 in a manner superimposed on the cross image 72 and the fingertip image 73. Figure 6 After B, the display unit 15 displays Figure 6 The finger position in C is presented in image 71 . The circular mark 75 is a circular image centered at the finger position reference point 72C of the cross image 72 .
[0087] First, in Figure 6 In FIG. 1A , a cross image 72 is displayed to indicate the location to be touched by the user.
[0088] Later, in Figure 6 In Figure B, fingertip image 73 is displayed to prompt the user to touch cross image 72 so that the base of the nail is located at finger position reference point 72C of cross image 72. The back of the base of the nail is the basic center position of the fingerprint, regardless of individual differences such as finger size, and is an important part of the fingerprint with a high density of characteristic points (minutiae). When the base of the nail is aligned with the position of finger position reference point 72C, it is possible to align the basic center position of the fingerprint with the position of finger position reference point 72C regardless of individual differences such as finger size.
[0089] Furthermore, the orientation of the fingertip when touching detection area 12A is presented to the user through fingertip image 73. That is, the user is prompted to touch the position of cross image 72 so that the direction of the central axis of the fingertip matches the direction of vertical line 72B of cross image 72 and the width direction of the fingertip matches the direction of horizontal line 72A of cross image 72.
[0090] Later, in Figure 6 In FIG. 3 , a circular mark 75 is displayed in such a manner as to emphasize the position of the finger position reference point 72C, thereby enabling the user to recognize that it is important to align the base of the nail with the finger position reference point 72C.
[0091] By using this presentation of the finger position of the finger position presentation image 71, it is possible to enable the user to touch with high reproducibility with the base of the nail aligned with the position of the finger position reference point 72C, regardless of the user, and touch the position of the finger position reference point 72C at the center position of the fingerprint.
[0092] Note that, in other words, the finger position presentation image 71 is a presentation image that presents the position of the base of the nail.
[0093] When the fingerprint registration process in the fingerprint registration processing unit 22 starts, Figure 5 The finger position presentation image generation unit 66 generates the Figure 6 The finger positions A to C are presented in an image 71 , which is supplied to the image output unit 24 and displayed on the display unit 15 .
[0094] Here, Figure 7 It is shown in Figure 3 FIG. 7 is a diagram showing an exemplary display of a finger position presentation image 71 in the case of a smartphone-type device 41 equipped with a fingerprint authentication device 11, wherein the fingerprint sensor 43 ( Figure 7 (not shown) is embedded in the display 42.
[0095] exist Figure 7 In the embodiment, a fingerprint sensor 43 embedded in the display 42 is provided on the display 42 (see Figure 3 ) is displayed at the position of the detection area 44. Note that the dotted line image indicating the detection area 44 is not displayed. Figure 6 As shown in Figures A to C, when the fingerprint registration process starts, a cross image 72, a fingertip image 73, and a circular mark 75 are superimposed and displayed in a step-by-step manner. In addition, a guidance message 76 of "Please touch as shown below" is displayed on the display 42 together with the finger position presentation image 71. Figure 5 The finger position presentation image generation unit 66 generates an image including the finger position presentation image 71 and the guide information 76 to be displayed on the display 42 in this manner, and supplies it to the image output unit 24 .
[0096] Figure 8 It is shown in Figure 3 FIG. 1 is a diagram showing an exemplary display of a finger position presentation image 71 in the case of a smartphone-type device 41 in which a fingerprint sensor 45 is embedded in a portion other than the display 42 .
[0097] exist Figure 8 In the example, an appearance image 78 is displayed on the display 42, which imitates the appearance of a part of the range of the smartphone type device 41, that is, the part including the right side surface where the fingerprint sensor 45 is provided. In addition, an arrow image 77 indicating the position of the detection area 46 provided with the fingerprint sensor 45 is displayed on the display 42, and an arrow image 77A indicating the position of the detection area 46A corresponding to the detection area 46 is also displayed in the appearance image 78. Then, the finger position presentation image 71 is displayed at the position of the detection area 46A in the appearance image 78. Note that there is no Figure 8 The finger position is shown in the image 71. Figure 6 The arrow images 77 and 77A, the fingertip image 73, and the circular mark 75 are superimposed and displayed in a step-by-step manner at the start of the fingerprint registration process.
[0098] Figure 8 The finger position presentation image 71 presents the finger position relative to the detection area 46A in the appearance image 78, thereby indirectly presenting the finger position relative to the detection area 46 of the fingerprint sensor 45. In addition, the finger position presentation image 71 displayed in the appearance image 78 is obtained by Figure 6 The finger position presentation image 71 in C is an image obtained by rotating it 90° counterclockwise, and indicates that the orientation of the fingertip is set in the horizontal direction when touching the detection area 46. In addition, a guidance message 76 of "Please touch as shown below" is displayed on the display 42. Note that it is also possible to Figure 8 A cross image 72 is displayed in the finger position presentation image 71 .
[0099] Figure 5 The finger position presentation image generation unit 66 generates an image including arrow images 77 and 77A, an appearance image 78 and a finger position presentation image 71, displays it on the display 42 in this manner, and supplies it to the image output unit 24.
[0100] Figure 9 It shows Figure 4 FIG. 1 is a diagram showing an exemplary display of a finger position presentation image 71 in the wristband-type device 51 .
[0101] exist Figure 9 In the embodiment, a fingerprint sensor 54 is embedded in the display 53 (see Figure 3 ) is displayed at the position of the detection area 55 of the finger position presentation image 71. Note that the dotted line image indicating the detection area 55 is not displayed. Figure 6 As shown in Figures A to C, at the start of the fingerprint registration process, a cross image 72, a fingertip image 73, and a circular mark 75 are superimposed and displayed in a step-by-step manner. Figure 5 The finger position presentation image generation unit 66 generates a finger position presentation image 71 to be displayed on the display 42 in this manner, and supplies it to the image output unit 24 .
[0102] In the display of the above-mentioned finger position presentation image 71, the finger position presentation image generation unit 66 may generate a cross image 72, a fingertip image 73, and a circular mark 75. Figure 6 The finger position in C of FIG. 71 is presented so that the display unit 15 (displays 42 and 53) displays it without generating Figure 6 The finger positions A and B in image 71 are presented.
[0103] Furthermore, the finger position presentation image generation unit 66 may generate an image including any one or both of the cross image 72, the fingertip image 73, and the circular mark 75 as the finger position presentation image 71 so as to be displayed on the display unit 15. By notifying the user that the base of the user's nail will be aligned with the position of the finger position reference point 72C of the cross image 72, only the cross image 72 may be displayed. By notifying the user that the base of the user's finger will be aligned with the nail base 74A ( Figure 6 ) is aligned with the position of the circular mark 75, it is possible to display only the fingertip image 73. By notifying the user that the base of the user's nail will be aligned with the position of the circular mark 75, it is possible to display only the circular mark 75.
[0104] In addition, as in Figure 6 In A to C, not only when the fingerprint registration process starts, but also in the case of changing and redisplaying the display position of the finger position presenting image 71, that is, in the case of changing and redisplaying the finger position presented by the finger position presenting image 71, the cross image 72, the fingertip image 73 and the circular mark 75 can be superimposed and displayed in a step-by-step manner.
[0105] Furthermore, the fingertip image 73 may be an image of only the nail image 74 (an image without the outline of the fingertip).
[0106] Figure 10 is a diagram illustrating a fingerprint image obtained by the fingerprint sensor 12 in a case where the user touches the first finger position represented by the finger position representation image 71 with a finger.
[0107] exist Figure 10In FIG. 1 , fingerprint 91 is a diagram showing a user's fingerprint in a simplified manner. Fingerprint image 92 shows the fingerprint image when the user touches the fingerprint image with his finger. Figure 6 The fingerprint image 92 is obtained by the fingerprint sensor 12 when the first finger position is presented by the finger position presentation image 71. In addition, the fingerprint image 92 represents a fingerprint image obtained from the contact portion of the fingerprint 91 relative to the detection area 12A of the fingerprint sensor 12. The fingerprint image 92 obtained by the fingerprint sensor 12 is represented by Figure 5 The fingerprint image capturing unit 61 captures the fingerprint and then provides it to the feature amount detecting unit 62.
[0108] The feature amount detection unit 62 extracts the fingerprint from the fingerprint image 92. Figure 10 The feature points 93 (minutiae points) illustrated in FIG are extracted and feature quantities of the extracted feature points 93 are calculated. The feature points 93 are, for example, endpoints or branch points of ridges of the fingerprint 91, and the feature quantities are values indicating the positions and directions of the feature points 93.
[0109] Figure 11 is an enlarged view illustrating the end points of the ridges of the fingerprint 91. Figure 11 In FIG. 1 , ridges 91A, 91B, and 91C represent raised portions of the skin, and end point 93A represents the portion where the protrusion of ridge 91A terminates. Figure 5 Feature quantity detection unit 62 extracts endpoint 93A in fingerprint image 92 as feature point 93. Feature quantity detection unit 62 then obtains the xy coordinate value (x, y) of the xy coordinate system as the position of endpoint 93A. Note that the x-axis of the xy coordinate system is the horizontal axis of fingerprint image 92, and the y-axis of the xy coordinate system is the vertical axis of fingerprint image 92. Furthermore, feature quantity detection unit 62 obtains the angle θ formed by the axis at endpoint 93A of ridge 91A and the x-axis. Feature quantity detection unit 62 then sets the value (x, y, θ) including the xy coordinate value (x, y) of endpoint 93A and angle θ as the feature quantity (x, y, θ) representing the position and orientation of feature point 93.
[0110] also, Figure 12 is an enlarged view illustrating the branching points of the ridges of the fingerprint 91. Figure 12 In FIG. 1 , ridges 91A, 91B, and 91C are portions where the skin is raised, and branch point 93B indicates a portion where ridge 91A branches into ridges 91B and 91C. Figure 5Feature quantity detection unit 62 extracts branch point 93B in fingerprint image 92 as feature point 93. Feature quantity detection unit 62 then obtains the xy coordinate value (x, y) of the xy coordinate system as the position of branch point 93B. Furthermore, feature quantity detection unit 62 obtains the angle θ formed by the axis at branch point 93B of ridge 91A and the x-axis. Feature quantity detection unit 62 then sets the value (x, y, θ) including the xy coordinate value (x, y) of branch point 93B and angle θ as the feature quantity (x, y, θ) representing the position and orientation of feature point 93.
[0111] exist Figure 5 In the example, the feature amount detection unit 62 supplies the feature amount (x, y, θ) obtained by extracting each feature point 93 from the fingerprint image 92 to the verification unit 63 .
[0112] The checking unit 63 checks the feature amount from the feature amount detection unit 62 with the feature amount registered as a template. Then, the checking unit 63 registers the feature amount from the feature amount detection unit 62 that is not registered as a template as a template. Note that, initially after the fingerprint registration process starts, none of the feature amounts supplied from the feature amount detection unit 62 are registered as templates, and therefore all feature amounts are registered as templates.
[0113] Furthermore, the finger position represented by the finger position representation image 71 displayed on the display unit 15 does not change until a predetermined condition (described later) is satisfied and the user continues to touch the same position with their finger. While the user continues this state, fingerprint image 92 at substantially the same position as fingerprint 91 is repeatedly captured by the fingerprint sensor 12 to the fingerprint image capturing unit 61. The feature amount detected from the fingerprint image 92 at substantially the same position is then repeatedly supplied from the feature amount detecting unit 62 to the checking unit 63.
[0114] Whenever a feature quantity is supplied from the feature quantity detection unit 62, the collation unit 63 collates the feature quantity from the feature quantity detection unit 62 with the feature quantity registered in the template. The collation unit 63 then determines that a match is found when the degree of matching between the feature quantity from the feature quantity detection unit 62 and the feature quantity registered in the template is equal to or higher than a predetermined threshold, and determines that a mismatch is found when the degree of matching is lower than the threshold. The collation unit 63 supplies the collation result as to whether the feature quantity from the feature quantity detection unit 62 and the feature quantity registered in the template match each other to the central processing unit 64.
[0115] Furthermore, the verification unit 63 estimates the correspondence between the feature quantities detected by the feature quantity detection unit 62 and the feature quantities registered in the template based on the positional relationship between the feature quantities (feature points) detected by the feature quantity detection unit 62 and the positional relationship between the feature quantities (feature points) registered in the template. Specifically, the verification unit 63 associates the feature quantities of the same feature point with the feature quantities detected by the feature quantity detection unit 62 and the feature quantities registered in the template. The verification unit 63 then corrects the positional and rotational displacements of all feature quantities (x, y, θ) detected at once by the feature quantity detection unit 62 by parallel translation and rotational transfer of the xy coordinate system, so that the associated feature quantities (x, y, θ) of the same feature point have the same value.
[0116] Note that in Figure 5 In the present invention, the fingerprint image obtained by the fingerprint sensor 12 is supplied from the fingerprint image capturing unit 61 to the fingerprint image combining unit 65. The fingerprint image combining unit 65 synthesizes (combines) the fingerprint images supplied from the fingerprint image capturing unit 61 and generates a combined image of the entire range from which the fingerprint sensor 12 has obtained the fingerprint image. The fingerprint image combining unit 65 then performs matching processing (e.g., processing using only a phase correlation method) when combining the fingerprint images from the fingerprint image capturing unit 61 into a combined image, and detects and corrects the positional displacement and rotational displacement of the fingerprint image from the fingerprint image capturing unit 61 relative to the combined image. The verification unit 63 can correct the positional displacement and rotational displacement of the feature quantity from the feature quantity detection unit 62 by obtaining information on the positional displacement and rotational displacement from the fingerprint image combining unit 65.
[0117] Whenever a verification result is provided by the verification unit 63, the central processing unit 64 causes the fingerprint image capture unit 61 to capture a fingerprint image. The central processing unit 64 then determines whether the verification result from the verification unit 63 matches N times consecutively (N is a predetermined positive integer). Here, if the verification result from the verification unit 63 matches N times consecutively, it can be considered that there are substantially no feature quantities to be newly registered as templates in the fingerprint images 92 repeatedly captured by the fingerprint image capture unit 61 from the fingerprint sensor 12. Therefore, if the verification result from the verification unit 63 matches N times consecutively, the central processing unit 64 instructs the finger position presentation image generation unit 66 to change the finger position presented by the finger position presentation image 71.
[0118] When the central processing unit 64 issues an instruction to change the finger position, the finger position presentation image generation unit 66 generates a finger position presentation image 71 for presenting the second finger position and provides it to the image output unit 24 .
[0119] Figure 13is a diagram illustrating a finger position presentation image 71 presenting a second finger position. Figure 13 The finger position presents image 71 with Figure 6 The finger position in C is the same as that in image 71, so it corresponds to Figure 6 Those parts of the finger position presentation image 71 in FIG. 7A are denoted by the same reference numerals, and description thereof will be omitted.
[0120] exist Figure 13 In, with Figure 6 Compared with the case of , the finger position presented by the finger position presentation image 71 is shifted to the left. Figure 6 When the basic center position of the detection area 12A of the fingerprint sensor 12 is displayed in C, the finger position reference point 72C of the finger position rendering image 71 is displayed. Figure 13 , the finger position reference point 72C of the finger position presentation image 71 is displayed at a left position outside the detection area 12A.
[0121] User from Figure 6 The finger position presentation image 71 presents the first finger position of the moving finger, and the base of the nail is located at Figure 13 The finger position presenting image 71 is touched in such a manner that the finger position reference point 72C is located. Figure 13 The position presented by the finger position presentation image 71. Therefore, the contact portion of the fingerprint with respect to the detection area 12A of the fingerprint sensor 12 changes.
[0122] Figure 14 This is an example of a user touching the Figure 13 The finger position presentation image 71 is a diagram showing a fingerprint image obtained by the fingerprint sensor 12 in a case where the second finger is in a position.
[0123] exist Figure 14 In FIG. 1 , fingerprint 91 is a diagram showing a user's fingerprint in a simplified manner. Fingerprint image 92 shows the fingerprint image when the user touches the fingerprint image with his finger. Figure 13 The fingerprint image obtained by the fingerprint sensor 12 when the fingerprint position presentation image 71 is displayed. In addition, the fingerprint image 92 represents a fingerprint image obtained from the contact portion of the fingerprint 91 with respect to the detection area 12A of the fingerprint sensor 12. The captured fingerprint image 92A indicated by the dotted line represents a fingerprint image that has been captured by the fingerprint sensor 12, which is an image obtained when the fingerprint 91 is touched by the finger. Figure 6 The finger position presentation image 71 presents the fingerprint image captured when the first finger position is present.
[0124] like Figure 13 As shown, Figure 6Compared with the case of the fingerprint, the finger position presented by the finger position presentation image 71 is shifted to the left, and when the finger is viewed from the fingerprint side, the contact portion of the fingerprint 91 relative to the detection area 12A is shifted to the left. Figure 14 , fingerprint image 92 is obtained from a range on the left side of fingerprint 91 compared to fingerprint image 92A. In addition, the fingerprint image in a partial range of fingerprint image 92 overlaps with the fingerprint image in a partial range of fingerprint image 92A.
[0125] Here, Figure 15 and Figure 16 1 is a diagram showing a correspondence relationship between the finger position represented by the finger position presenting image 71 and the position of the fingerprint image obtained by the fingerprint sensor 12 in a case where the finger touches the position represented by the finger position presenting image 71 . Figure 15 A shows a case where the finger position presentation image 71 is displayed in such a manner that the finger position reference point 72C of the finger position presentation image 71 is located substantially at the center of the detection area 12A of the fingerprint sensor 12 . Figure 16 B shows the touch by the finger Figure 15 The position of the fingerprint image 92 obtained by the fingerprint sensor 12 is the position of the finger position presentation image 71 in A. Figure 16 In FIG. 8A , a fingerprint image 92 is obtained from a substantially central area of the fingerprint 91 .
[0126] Figure 15 B shows a case where the finger position presentation image 71 is displayed in such a manner that the finger position reference point 72C of the finger position presentation image 71 is located at the upper left diagonal position relative to the center position of the detection area 12A of the fingerprint sensor 12 . Figure 16 B shows the touch by the finger Figure 15 In the case of the position presented by the finger position presentation image 71 in B, the position of the fingerprint image 92 obtained by the fingerprint sensor 12. Figure 16 In FIG. 8B , the fingerprint image 92 is obtained from the range of the lower left corner diagonally opposite to the center range of the fingerprint 91 .
[0127] Figure 15 C shows a case where the finger position presentation image 71 is displayed in such a manner that the finger position reference point 72C of the finger position presentation image 71 is located at the upper right diagonal position relative to the center position of the detection area 12A of the fingerprint sensor 12 . Figure 16 C shows the touch by the finger Figure 15 In the case where the finger position presentation image 71 in C presents the position, the position of the fingerprint image 92 obtained by the fingerprint sensor 12 is shown. Figure 16 In FIG. 3 , the fingerprint image 92 is obtained from the range of the lower right corner diagonally opposite to the substantially central range of the fingerprint 91 .
[0128] Figure 15 D shows a case where the finger position presentation image 71 is displayed in such a manner that the finger position reference point 72C of the finger position presentation image 71 is located at the lower left diagonal position relative to the center position of the detection area 12A of the fingerprint sensor 12 . Figure 16 D shows the touch by the finger Figure 15 The position of the fingerprint image 92 obtained by the fingerprint sensor 12 is the position of the finger position presentation image 71 in D. Figure 16 In D, the fingerprint image 92 is obtained from the range of the upper left corner diagonally opposite to the center range of the fingerprint 91.
[0129] Figure 15 E shows a case where the finger position presentation image 71 is displayed in such a manner that the finger position reference point 72C of the finger position presentation image 71 is located at the diagonally lower right position relative to the center position of the detection area 12A of the fingerprint sensor 12 . Figure 16 E shows the touch by the finger Figure 15 The position of the fingerprint image 92 obtained by the fingerprint sensor 12 is the position of the finger position presentation image 71 in E. Figure 16 In FIG. 8 , a fingerprint image 92 is obtained from a range diagonally to the upper right corner of the center range of the fingerprint 91 .
[0130] The fingerprint sensor 12 obtains Figure 14 The fingerprint image 92 is captured by the fingerprint image capturing unit 61 and then supplied to the feature amount detecting unit 62. Then, Figure 5 The fingerprint registration processing unit 22 performs processing similar to that in the case where the finger position presentation image 71 presents the first finger position (description omitted).
[0131] In a case where the collation results from the collation unit 63 match N times continuously, the central processing unit 64 instructs the finger position presentation image generation unit 66 to change the finger position presented by the finger position presentation image 71 .
[0132] When the central processing unit 64 issues an instruction to change the finger position, the finger position presentation image generation unit 66 generates a finger position presentation image 71 for presenting the third finger position and provides it to the image output unit 24 .
[0133] Figure 17 is a diagram illustrating a finger position presentation image 71 presenting a third finger position. Figure 17 The finger position presents image 71 with Figure 6 The finger position in C is the same as that in image 71, so it corresponds to Figure 6Those parts of the finger position presentation image 71 in FIG. 7A are denoted by the same reference numerals, and description thereof will be omitted.
[0134] exist Figure 17 In, with Figure 13 Compared with the case of FIG, the finger position presented by the finger position presentation image 71 is shifted to the lower side.
[0135] User from Figure 13 The finger position presentation image 71 presents the second position of the finger moved, and the root of the nail is located at Figure 17 The finger position presenting image 71 is touched in such a manner that the finger position reference point 72C is located. Figure 17 The finger position presenting image 71 presents the third finger position. Figure 6 and 13 Compared with the case of FIG. 1 , the contact portion of the fingerprint with respect to the detection area 12A of the fingerprint sensor 12 changes.
[0136] Figure 18 This is an example of a user touching the Figure 17 The finger position presentation image is a diagram showing a fingerprint image obtained by the fingerprint sensor 12 in a case where the finger position presentation image presents a third position.
[0137] exist Figure 18 In FIG. 1 , fingerprint 91 is a diagram showing a user's fingerprint in a simplified manner. Fingerprint image 92 shows the fingerprint image when the user touches the fingerprint image with his finger. Figure 17 The fingerprint image obtained by the fingerprint sensor 12 when the third finger position is represented by the finger position presentation image 71. In addition, the fingerprint image 92 represents a fingerprint image obtained from the contact portion of the fingerprint 91 with respect to the detection area 12A of the fingerprint sensor 12. The captured fingerprint image 92A represented by the dotted line represents a fingerprint image that has been captured by the fingerprint sensor 12, which is an image obtained when the user touches the detection area 12A with his finger. Figure 6 and Figure 13 The finger position presentation image 71 presents the first and second finger positions when the fingerprint image is captured.
[0138] like Figure 17 As shown, Figure 13 Compared to the case where the finger position presented by the finger position presentation image 71 is shifted to the lower side, when the finger is viewed from the fingerprint side, the contact portion of the fingerprint 91 with respect to the detection area 12A is shifted to the upper side. Figure 18 , fingerprint image 92 is obtained from a range on the upper left side of fingerprint 91 compared to fingerprint image 92A.
[0139] Furthermore, the fingerprint image in a partial range of the fingerprint image 92 overlaps with the fingerprint image in a partial range of the fingerprint image 92A.
[0140] The fingerprint sensor 12 obtains Figure 18 The fingerprint image 92 is captured by the fingerprint image capturing unit 61 and then supplied to the feature amount detecting unit 62. Then, Figure 5 The fingerprint registration processing unit 22 performs processing similar to that in the case where the finger position presentation image 71 presents the first and second finger positions (description omitted).
[0141] In the case where the collation results from the collation unit 63 match N times continuously, the central processing unit 64 instructs the finger position presentation image generation unit 66 to change the finger position presented to the user by the finger position presentation image 71 .
[0142] When the central processing unit 64 issues an instruction to change the finger position, the finger position presentation image generation unit 66 generates a finger position presentation image 71 for presenting the fourth finger position and supplies it to the image output unit 24 .
[0143] As described above, the finger position presentation image generation unit 66 sequentially changes the finger position to be presented in the finger position presentation image 71 to the predetermined first to M-th finger positions so that the contact portion of the fingerprint with respect to the detection area 12A of the fingerprint sensor 12 extends over the entire range of the fingerprint. With this arrangement, a fingerprint image of the entire range of the fingerprint 91 is obtained, as shown in FIG. Figure 19 As shown. Furthermore, feature points 93 throughout the entire range of the fingerprint are detected by feature quantity detection unit 62 and registered as a template in storage unit 14 for use in fingerprint authentication. Note that if, for example, the user touches a position different from the finger position represented by finger position representation image 71, there may be a missing portion of the fingerprint where a fingerprint image and feature quantity are not obtained. In this case, finger position representation image 71 can be displayed at a position where a fingerprint image of the missing portion can be obtained, in order to obtain a fingerprint image and feature quantity for the missing portion.
[0144] According to the use of Figure 6 、 Figure 13 、 Figure 17 The finger position presentation of the finger position presentation image 71 in the etc. enables the user to easily and accurately touch the finger position presented by the finger position presentation image 71, thereby facilitating the acquisition of fingerprint information (feature quantity) within the expected range of the fingerprint. Therefore, in the case where the fingerprint sensor 12 is a small area sensor, the time required to register the fingerprint and the number of touches by changing the finger position are reduced, and the registration of the fingerprint (fingerprint information) is efficiently performed. According to the technology of Japanese Patent Application Publication No. 2018-195316, it is difficult to specify the touch position with high reproducibility as in the prior art, and it is difficult to reduce the number of touches in the case where the fingerprint sensor 12 is a small area sensor.
[0145] <Get Status Image>
[0146] Next, an acquisition status image representing the acquisition status of feature amounts will be described.
[0147] After the display unit 15 displays the finger position presentation image 71 presenting the mth (m is a positive integer) finger position, and before the display unit 15 displays the finger position presentation image 71 presenting the next (m+1)th finger position, Figure 5 The central processing unit 64 in the apparatus counts the number of feature quantities (feature points) detected by the feature quantity detection unit 62. Then, the central processing unit 64 obtains the progress of the feature quantity detection (hereinafter referred to as the progress of the feature quantity acquisition) based on the count d of the feature quantities, and supplies it to the acquisition status image generation unit 67. For example, the central processing unit 64 sets the number of feature quantities with a progress of 100% as the comparison value D, and calculates the progress of the feature quantity acquisition (d / D)×100 (percentage) based on the count d of the feature quantities and the comparison value D. The comparison value D is predetermined based on the general number of feature quantities detected from fingerprints within the range having the size of the detection area 12A of the fingerprint sensor 12. In addition, in the case where the count d of the feature quantity is greater than the comparison value D, the progress of the feature quantity acquisition is set to 100%.
[0148] Note that the progress of feature quantity acquisition may be a value calculated based on the density of detected feature quantities (feature points).
[0149] The acquisition status image generation unit 67 generates an acquisition status image that presents the acquisition status of the feature amount to the user based on the progress of the feature amount acquisition from the central processing unit 64, and supplies it to the image output unit 24. With this arrangement, the acquisition status image generated by the acquisition status image generation unit 67 is displayed on the display unit 15.
[0150] Figure 20 : is a diagram illustrating a first mode of an acquisition state image showing an acquisition state of a feature amount. Figure 20 In FIG. 1 , the acquisition status image 106 includes the fingerprint image 101 and the fingerprint image 102A in the indicator area 102 .
[0151] The fingerprint image 101 is an image imitating a fingerprint, and in a case where the progress of feature amount acquisition is 0%, the entire image is uniformly displayed on the display unit 15 as a low-density image.
[0152] The fingerprint image 102A in the indicator area 102 is displayed at a density corresponding to the progress of feature acquisition, and is displayed as an image whose density increases as the progress increases. When the progress is 100%, the fingerprint image 102A is displayed at the maximum density. The density of the fingerprint image 101 in the area other than the indicator area 102 is displayed as an image with a constant lower density regardless of the progress of feature acquisition.
[0153] Note that it is sufficient if the clarity of the image changes according to the progress, and in addition to the change in image density, the degree of blurring, the degree of mosaic processing, brightness, illuminance, saturation, etc. may also be changed.
[0154] Furthermore, the position of the indication area 102 in the fingerprint image 101 indicates the position of the fingerprint image obtained within the entire fingerprint range by the fingerprint sensor 12. With this arrangement, the user can recognize the position where the feature amount (fingerprint information) acquisition is performed.
[0155] Notice, Figure 5 The acquisition state image generation unit 67 can be obtained from Figure 5 The fingerprint image combining unit 65 in 102A obtains and generates the fingerprint image actually obtained by the fingerprint sensor 12, instead of the fingerprint images 101 and 102A.
[0156] according to Figure 20 The acquisition status image 106 enables the user to grasp the acquisition status of the feature quantity, so that the movement of the position where the feature quantity is obtained (the change of the touch position) can be smoothly performed, thereby reducing the time required to register the fingerprint. In addition, the user can intuitively grasp in which part of the fingerprint range the feature quantity is not obtained, and effectively change the position to be touched. In addition, by feeding back the acquisition status of the feature quantity to the user in real time, the presence / absence of the feature quantity acquisition can be accurately presented to the user, and the user can be prompted to improve the touch method. According to the technology of Japanese Patent Application Publication No. 2018-195316, it is impossible to intuitively grasp the part where the feature quantity is not obtained, and it is difficult to effectively change the position to be touched.
[0157] Figure 21 : is a diagram illustrating a second mode of an acquisition state image showing an acquisition state of a feature amount. Figure 21 In FIG. 1A , fingerprint 91 is a simplified diagram illustrating a user's fingerprint. Feature points 93 represent detected (obtained) feature points, and feature points 94 represent undetected (unobtained) feature points. Segmentation frame 103 divides the range of fingerprint 91 into a plurality (four) of segmented regions 104A to 104D. The number of segmented regions into which segmentation frame 103 divides the range of fingerprint 91 is not limited to four.
[0158] Figure 21The acquisition status image 107 in B is an acquisition status image displayed on the display unit 15. Figure 21 In FIG. 1B , the acquired state image 107 includes the fingerprint image 101 and the segmented frame 110 .
[0159] The fingerprint image 101 is an image imitating a fingerprint, and in a case where the progress of feature amount acquisition is 0% over the entire range of the fingerprint 91, the entire image is uniformly displayed on the display unit 15 as a low-density image.
[0160] The segmentation frame 111 is to divide the range of the fingerprint image 101 into Figure 21 Frame images of a plurality of (four) divided regions 112A to 112D of the divided frame 103 in FIG.
[0161] Figure 5 The central processing unit 64 in the Figure 21 The progress of feature amount acquisition of each of the segmented areas 104A to 104D in A is recorded and supplied to the acquisition state image generation unit 67. The acquisition state image generation unit 67 Figure 21 Fingerprint images are generated in the corresponding segmented areas 112A to 112D in the acquired state image 107 in B as having Figure 21 The progress of acquiring the feature amounts in the corresponding segmented regions 104A to 104D in A corresponds to the density of the image.
[0162] exist Figure 21 In the acquisition state image 107 in FIG. 1B , the density of the fingerprint image in each segmented area 112A to 112D increases as Figure 21 The value A increases with the progress of feature quantity acquisition in the corresponding segmented regions 104A to 104D.
[0163] exist Figure 21 In the acquisition state image 107 in B, in the image corresponding to the segmented area 112A Figure 21 In the segmented area 104A in A, the progress of feature quantity acquisition has reached approximately 100%, and the fingerprint image in the segmented area 112A is displayed as an image with a higher density. Figure 21 In the acquisition state image 107 in FIG. 1B, in the image corresponding to the divided areas 112B to 112D except the divided area 112A, Figure 21 In the segmented areas 104B to 104D in A, the progress of feature amount acquisition is approximately 0%, and the fingerprint images in the segmented areas 112B to 112D are displayed as images with relatively low density.
[0164] according to Figure 21The acquisition status image 107 allows the user to understand the acquisition status of the feature quantity, allowing them to smoothly move the location where the feature quantity is acquired (change the touch position), thereby reducing the time required to register the fingerprint. In addition, the user can intuitively understand which part of the fingerprint range the feature quantity is not acquired in and effectively change the touch position. In addition, by providing real-time feedback on the acquisition status of the feature quantity to the user, the user can accurately be presented with the presence / absence of feature quantity acquisition and be prompted to improve the touch method.
[0165] Figure 22 3 is a diagram illustrating a third mode of an acquisition state image showing an acquisition state of a feature amount. Figure 22 In Figures A to E, the acquired state image 108 includes a base image 121 and at least one of a low-density region 122A or a high-density region 122B.
[0166] The base image 121 is any image, and an image of a cat is used as an example.
[0167] The low-density region 122A is an image region with a lower density than the high-density region 122B, and the high-density region 122B is an image region with a higher density than the low-density region 122A.
[0168] When the progress of feature amount acquisition is 0% after the finger position presentation image 71 presenting the m-th finger position is displayed on the display unit 15, the entire range of the basic image 121 is in the low-density area 122A, as shown in FIG. Figure 22 The acquisition state of A is shown in image 108.
[0169] Meanwhile, as the progress of feature amount acquisition increases, the area of the low-density region 122A in the base image 121 decreases, and the area of the high-density region 122B increases, as shown in FIG. Figure 22 B to E are shown in the acquisition state image 108. For example, the high-density area 122B is enlarged from the central part of the base image 121 to the peripheral part. Figure 22 The acquisition status image 108 in E shows a case where the progress of feature amount acquisition has reached 100% and the entire range of the base image 121 of the acquisition status image 108 is in the high-density region 122B.
[0170] Notice, Figure 22The acquisition status image 108 in the image may be an image corresponding to the entire range of the fingerprint, and the progress of feature quantity acquisition may be presented in a corresponding area (base image 121) of the acquisition status image 108, corresponding to each small area in the case where the entire range of the fingerprint is divided into small areas. Any method of changing the image clarity can be used to present the progress of feature quantity acquisition in each corresponding area of the acquisition status image 108, for example, increasing the image density as the progress becomes higher, or decreasing the blur as the progress becomes higher.
[0171] according to Figure 22 The acquisition status image 108 enables the user to grasp the acquisition status of the feature quantity, so that the movement of the position where the feature quantity is obtained (change of the touch position) can be smoothly performed, thereby reducing the time required to register the fingerprint. In addition, the user can intuitively grasp in which part of the fingerprint range the feature quantity is not obtained, and effectively change the position to be touched. In addition, by feeding back the acquisition status of the feature quantity to the user in real time, the presence / absence of the feature quantity acquisition can be accurately presented to the user, and the user can be prompted to improve the touch method. In addition, the user can be given a game feeling, that is, as the feature quantity acquisition proceeds, the content of the basic image 121 gradually appears, thereby reducing the inconvenience of registration.
[0172] In addition, Figure 5 In a case where the feature quantity detection unit 62 does not properly detect the feature quantity and the progress of feature quantity acquisition does not exceed a predetermined threshold, even after a predetermined time has passed, the acquisition status image generation unit 67 can generate an error image for presenting the error as an acquisition status image, and can provide it to the image output unit 24 for display on the display unit 15.
[0173] Figure 23 is a diagram illustrating an error image. Figure 23 In FIG. 1 , the error image 109 includes the fingerprint image 101 imitating the fingerprint and the framed cross mark 131 .
[0174] With such an error image 109 displayed on the display unit 15 , the user can visually recognize that the feature amount is not appropriately obtained.
[0175] In addition, if an error has occurred, the fingerprint authentication device 11 or a device equipped with the fingerprint authentication device 11 may vibrate without changing the display state of the acquisition status image. In addition, if an error has occurred, images or characters such as the finger position presentation image 71 displayed on the display unit 15 may flicker.
[0176] <Fingerprint Registration Process>
[0177] Figure 24Is used to explain the Figure 5 Flowchart of an exemplary fingerprint registration process performed by the fingerprint registration processing unit 22 in FIG.
[0178] In step S11, the finger position presentation image generation unit 66 generates a finger position presentation image 71 that presents the position touched by the user's finger in the detection area 12A of the fingerprint sensor 12. The finger position presentation image generation unit 66 then supplies the generated finger position presentation image 71 to the image output unit 24 and causes the display unit 15 to display it. The process proceeds from step S11 to step S12.
[0179] In step S12, the fingerprint image capturing unit 61 obtains a fingerprint image from the fingerprint sensor 12, and supplies it to the feature amount detecting unit 62. The process proceeds from step S12 to step S13.
[0180] In step S13, the feature amount detection unit 62 extracts feature points from the fingerprint image supplied from the fingerprint image capture unit 61 in step S12, calculates the feature amount (template) of each feature point, and supplies it to the verification unit 63. The process proceeds from step S13 to step S14.
[0181] In step S14, the checking unit 63 checks the feature quantity supplied from the feature quantity detection unit 62 in step S13 with the feature quantity already registered as the template. The checking unit 63 then supplies the central processing unit 64 with a check result as to whether the feature quantity supplied from the feature quantity detection unit 62 and the template match each other. The process proceeds from step S14 to step S15.
[0182] In step S15, the checking unit 63 registers, as a template, the feature amounts that have not been registered as templates among the feature amounts supplied from the feature amount detecting unit 62 in step S13. The process proceeds from step S15 to step S16.
[0183] In step S16 , the central processing unit 64 determines whether the feature amount supplied from the feature amount detection unit 62 matches the template N times continuously based on the collation result supplied from the collation unit 63 in step S14 .
[0184] In the case where N consecutive matches are not determined in step S16, the process proceeds to step S19.
[0185] Furthermore, if it is determined in step S16 that a match has been made N times in succession, the process proceeds to step S17, and the central processing unit 64 determines whether the fingerprint image and feature amount of the entire range (all parts) of the fingerprint have been obtained. That is, the central processing unit 64 determines whether the finger position represented by the finger position representation image in step S11 has changed to the predetermined M-th finger position.
[0186] If it is not determined in step S17 that the fingerprint image and the feature quantities of all parts of the fingerprint have been obtained, that is, if it is not determined in step S11 that the finger position represented by the finger position representation image has changed to the M-th finger position, the process proceeds to step S18, and the central processing unit 64 instructs the finger position representation image generation unit 66 to change the finger position to be represented by the finger position representation image. The process proceeds from step S18 to step S19.
[0187] In step S19, the central processing unit 64 counts the number D of feature quantities (feature points) detected by the feature quantity detection unit 62 while the finger position represented by the finger position presentation image 71 remains unchanged, and calculates the progress of feature quantity acquisition (d / D)×100 (percentage) from the feature quantity count d and the predetermined comparison value D. The central processing unit 64 then supplies the calculated progress of feature quantity acquisition to the acquisition status image generation unit 67. The acquisition status image generation unit 67 generates an acquisition status image representing the acquisition status of the feature quantity based on the progress of feature quantity acquisition from the central processing unit 64, supplies it to the image output unit 24, and causes the display unit 15 to display it. The process returns from step S19 to step S11, and the process of step S11 is repeated.
[0188] In addition, in the case where the central processing unit 64 instructs the finger position rendering image generation unit 66 to change the finger position in step S18, the process returns to step S11, and the finger position rendering image generation unit 66 generates a finger position rendering image of the changed finger position, provides it to the image output unit 24, and causes the display unit 15 to display the finger position rendering image of the changed finger position.
[0189] Furthermore, in the case where it is determined in step S17 that fingerprint images of all parts of the fingerprint have been obtained, that is, in the case where the finger position represented by the finger position representation image is determined to have changed to the Mth finger position in step S11, the process is terminated.
[0190] <Exemplary Configuration of Fingerprint Authentication Processing Unit 23>
[0191] Next, we will describe Figure 1 The fingerprint authentication processing unit 23 in.
[0192] Figure 25 2 is a block diagram showing an exemplary configuration of the fingerprint authentication processing unit 23.
[0193] exist Figure 25, the fingerprint authentication processing unit 23 includes a fingerprint image capturing unit 141 , a feature amount detecting unit 142 , a checking unit 143 , a central processing unit 144 , and a finger position presentation image generating unit 146 .
[0194] The fingerprint image capturing unit 141 captures a fingerprint image from the fingerprint sensor 12 based on an instruction from the central processing unit 144 , and supplies it to the feature amount detecting unit 142 .
[0195] The feature amount detection unit 142 extracts a plurality of feature points (minutiae) included in the fingerprint based on the fingerprint image from the fingerprint image capture unit 141 and detects a feature amount indicating the position and direction of each feature point. The feature amount detection unit 142 supplies each detected feature amount to the verification unit 143.
[0196] The checking unit 143 reads the Figure 5 The template generated by the fingerprint registration processing unit 22 in the fingerprint registration processing unit 22 is used to check the feature quantity registered as the template with the feature quantity from the feature quantity detection unit 142. Then, when the degree of matching between the feature quantity registered as the template and the feature quantity from the feature quantity detection unit 142 (hereinafter also referred to as the detected feature quantity) is equal to or higher than a predetermined threshold, for example, the checking unit 143 determines that the detected feature quantity matches the template, and when it is less than the threshold, determines that the detected feature quantity does not match the template. The checking unit 143 then provides the checking result as to whether the detected feature quantity matches the template to the central processing unit 144.
[0197] The central processing unit 144 reads the template from the storage unit 14 and instructs the finger position rendering image generation unit 146 about the finger position to be presented in the finger position rendering image in such a manner that the fingerprint sensor 12 obtains a fingerprint image within the fingerprint range, wherein a large number of feature quantities as the template are distributed.
[0198] The finger position presentation image generation unit 146 generates a finger position presentation image presenting the finger position instructed by the central processing unit 144 , supplies it to the image output unit 24 , and causes the display unit 15 to display it.
[0199] <Details of fingerprint verification process>
[0200] Next, the details of the fingerprint authentication process will be described.
[0201] Figure 26 is a diagram illustrating the positional distribution of the feature quantities (feature points) of fingerprints registered in the template. Figure 26, fingerprint 91 is a diagram showing a fingerprint of a user whose feature quantity is registered as a template. Feature point 93 is a feature point detected as a feature quantity of the template. Fingerprint image acquisition range 161 indicates the range of the fingerprint image obtained by detection area 12A of fingerprint sensor 12.
[0202] When the fingerprint authentication process begins, Figure 25 The central processing unit 144 in the image processing apparatus reads the template stored in the storage unit 14 and grasps the position distribution of the feature points 93 for which the feature amounts of the template have been detected. Then, based on the position distribution of the feature points 93, the central processing unit 144 detects, as the appropriate position of the fingerprint image acquisition range 161, the position of the fingerprint image acquisition range 161 in which the number of feature points 93 included in the fingerprint image acquisition range 161 is the largest or the position of the fingerprint image acquisition range 161 in which the number of feature points 93 included in the fingerprint image acquisition range 161 is equal to or higher than a predetermined threshold.
[0203] Furthermore, the central processing unit 144 obtains the finger position where the appropriate position of the fingerprint image acquisition range 161 is the contact portion of the fingerprint with respect to the detection area 12A of the fingerprint sensor 12. The central processing unit 144 then instructs the finger position presentation image generation unit 146 to generate a finger position presentation image presenting the obtained finger position.
[0204] The finger position presentation image generation unit 146 generates a finger position presentation image presenting the finger position instructed by the central processing unit 144 , supplies it to the image output unit 24 , and causes the display unit 15 to display it.
[0205] Figure 27 is a diagram illustrating a finger position presentation image to be displayed on the display unit 15 at the time of fingerprint authentication. Figure 27 The finger position presents image 71 with Figure 6 The finger position in the image 71 is the same as that in the Figure 6 The corresponding parts in the finger position presentation image 71 are denoted by the same reference numerals, and description thereof will be omitted.
[0206] Depend on Figure 27 The finger position presented in the finger position presentation image 71 corresponds to Figure 26 The position of the fingerprint image acquisition range 161 in the detection area 12A is detected as the appropriate position. The finger position reference point 72C of the finger position presentation image 71 is displayed at the lower left position with respect to the center position of the detection area 12A. When the user touches the finger position represented by the finger position presentation image 71 with a finger, the fingerprint sensor 12 obtains Figure 26The fingerprint image in the fingerprint image acquisition range 161. Since the fingerprint image obtained by the fingerprint sensor 12 has a large number of feature quantities, it is possible to suppress Figure 5 Authentication error in the verification unit 143.
[0207] Figure 28 Is used to explain the Figure 25 Flowchart of an exemplary fingerprint authentication process performed by the fingerprint authentication processing unit 23 in FIG.
[0208] In step S21, the finger position rendering image generation unit 146 generates a finger position rendering image that renders the finger position indicated by the central processing unit 144, provides it to the image output unit 24, and causes the display unit 15 to display it. Note that the central processing unit 144 instructs the finger position rendering image generation unit 146 about the finger position to be rendered by the finger position rendering image based on the position distribution of the feature quantity (feature point) as the template. In addition, in the case where, for example, the authentication failure continues and the processing of step S21 is repeated multiple times, the central processing unit 144 can instruct the finger position rendering image generation unit 146 to change the finger position to be rendered by the finger position rendering image. The process proceeds from step S21 to step S22. The user touches the finger position rendered by the finger position rendering image displayed on the display unit 15 with his finger.
[0209] In step S22, the fingerprint image capturing unit 141 obtains a fingerprint image from the fingerprint sensor 12, and supplies it to the feature amount detecting unit 142. The process proceeds from step S22 to step S23.
[0210] In step S23, the feature amount detection unit 142 extracts feature points (end points and branch points of the ridges of the fingerprint) based on the fingerprint image supplied from the fingerprint image capturing unit 141 in step S22, and detects the positions and directions of the feature points as the detected feature amounts. Note that the feature amount detection process in the feature amount detection unit 142 is the same as that in the step S23. Figure 5 The feature amount detection process in the feature amount detection unit 62 of the fingerprint registration processing unit 22 is the same, so its description will be omitted. The feature amount detection unit 142 supplies the detected feature amount to the verification unit 143. The process proceeds from step S23 to step S24.
[0211] In step S24, the collating unit 143 collates the detected feature quantity supplied from the feature quantity detecting unit 142 in step S23 with the feature quantity as a template stored in the storage unit 14, and supplies the collation result to the central processing unit 144. The process proceeds from step S24 to step S25.
[0212] In step S25 , the central processing unit 144 determines whether the detected feature amount matches the template based on the collation result supplied from the collation unit 143 in step S24 .
[0213] If it is determined in step S25 that the detected feature amount does not match the template, the process proceeds to step S26, and the central processing unit 64 causes the finger position presentation image generation unit 146 (or the image generation unit (not shown)) to generate a presentation image indicating that authentication has failed, and causes the display unit 15 to display the presentation image. The process returns from step S26 to step S21, and the processing of steps S21 to S25 is repeated.
[0214] Furthermore, in the case where it is determined in step S25 that the detected feature amount matches the template, the process proceeds to step S27, and the central processing unit 144 causes the finger position presentation image generation unit 146 (or the image generation unit (not shown)) to generate a notification image notifying that the authentication is successful, and causes the display unit 15 to display the notification image. The fingerprint authentication process is then terminated.
[0215] According to the fingerprint authentication process of the fingerprint authentication processing unit 23 described above, the user can easily and accurately touch the finger position presented by the finger position presentation image 71 in a manner similar to the case of the fingerprint registration process, thereby facilitating the acquisition of fingerprint information (feature quantity) within the expected range of the fingerprint. Therefore, the time required for fingerprint authentication and the number of touches performed by changing the finger position are reduced, and fingerprint authentication is performed efficiently.
[0216] Note that during fingerprint authentication, the finger position presented by finger position rendering image 71 can be changed in a manner similar to fingerprint registration, and feature quantities of a wide range of the entire fingerprint range can be obtained to perform the authentication process. In this case, using the finger position presented by finger position rendering image 71, the user can easily and accurately touch the presented position, thereby facilitating the acquisition of fingerprint information (feature quantities) within the expected range of the fingerprint. Therefore, the time required for authentication and the number of touches performed by changing the finger position are reduced, and fingerprint authentication is performed efficiently.
[0217] Furthermore, in the fingerprint authentication process, the acquisition status of the feature amount can be presented in a similar manner to the case of the fingerprint registration process, such as Figures 20 to 22In this case, the user is able to grasp the acquisition status of the feature quantity, so that in the case of performing a shift, the shift of the position where the feature quantity is obtained (the change of the touch position) can be smoothly performed, thereby reducing the time required to register the fingerprint. In addition, the user is able to intuitively grasp in which part of the fingerprint range the feature quantity is not obtained, and effectively change the position to be touched. In addition, by feeding back the acquisition status of the feature quantity to the user in real time, the presence / absence of the feature quantity acquisition can be accurately presented to the user, and the user can be prompted to improve the touch method. In addition, by displaying the Figure 22 The acquisition status image 108 shown can reduce the inconvenience of authentication.
[0218] <Computer>
[0219] The series of processes in the processing unit 16, the process switching unit 21, the fingerprint registration processing unit 22, the fingerprint authentication processing unit 23, and the image output unit 24 described above can be executed by hardware or by software. When the series of processes are executed by software, the program constituting the software is installed in a computer. Here, examples of the computer include a computer incorporated into dedicated hardware, a general-purpose personal computer capable of performing various functions by installing various programs, and the like.
[0220] Figure 29 : is a block diagram illustrating an exemplary hardware configuration of a computer that executes the above-described series of processes using a program.
[0221] In the computer, a central processing unit (CPU) 201 , a read-only memory (ROM) 202 , and a random access memory (RAM) 203 are coupled to each other via a bus 204 .
[0222] An input / output interface 205 is further connected to the bus 204 . An input unit 206 , an output unit 207 , a storage unit 208 , a communication unit 209 , and a drive 210 are connected to the input / output interface 205 .
[0223] The input unit 206 includes a keyboard, a mouse, a microphone, etc. The output unit 207 includes a display, a speaker, etc. The storage unit 208 includes a hard disk, a nonvolatile memory, etc. The communication unit 209 includes a network interface, etc. The drive 210 drives a removable medium 211, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
[0224] In the computer configured as described above, for example, the CPU 201 loads a program stored in the storage unit 208 into the RAM 203 via the input / output interface 205 and the bus 204 and executes the program, thereby performing the above-described series of processing.
[0225] The program to be executed by the computer (CPU 201) can be provided by being recorded in the removable medium 211, for example, as a package medium, etc. Furthermore, the program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
[0226] In the computer, by attaching the removable medium 211 to the drive 210, the program can be installed in the storage unit 208 via the input / output interface 205. In addition, the program can be received by the communication unit 209 via a wired or wireless transmission medium and installed in the storage unit 208. In addition, the program can be pre-installed in the ROM 202 or the storage unit 208.
[0227] Note that the program to be executed by the computer may be a program that performs processing in a time-series manner according to the order described in this specification, or may be a program that performs processing in parallel or at a necessary time (for example, when a call is made).
[0228] Note that the present technology can also adopt the following configurations.
[0229] <1> A fingerprint authentication device, comprising:
[0230] a display control unit configured to generate a presentation image for presenting the position of the base of the nail of the finger when the fingerprint is detected; and
[0231] A processing unit is configured to obtain an image of the fingerprint using the generated rendered image.
[0232] <2> according to <1> The fingerprint authentication device, wherein:
[0233] The presented image includes a cross image in a cross shape.
[0234] <3> according to <1> The fingerprint authentication device, wherein:
[0235] The presented image includes an image of a nail.
[0236] <4> according to <1> The fingerprint authentication device, wherein:
[0237] The presented image includes an image of a fingertip, and the image of the fingertip includes an image of a nail.
[0238] <5> according to <1> The fingerprint authentication device, wherein:
[0239] The presented image includes a circular image.
[0240] <6> according to <1> The fingerprint authentication device, wherein:
[0241] The presented image includes an image on which at least any two of a cross image, an image of a nail, and a circular image of a circle are superimposed.
[0242] <7> according to <1> The fingerprint authentication device, wherein:
[0243] The presented image includes an image in which at least any two images of a cross image of a cross, an image of a nail, and a circle image of a circle are superimposed in a step-by-step manner.
[0244] <8> according to <1> to <7> The fingerprint authentication device according to any one of the preceding claims, wherein:
[0245] The position of the nail base to be rendered is moved to a plurality of positions in the rendering image.
[0246] <9> according to <1> to <8> The fingerprint authentication device according to any one of the preceding claims, wherein:
[0247] The display control unit is configured to generate:
[0248] an image of a detection area for detecting the fingerprint; and
[0249] The presented image of the position of the nail root is presented on the image of the detection area.
[0250] <10> according to <1> to <9> The fingerprint authentication device according to any one of the preceding claims further comprises:
[0251] A display unit displays the presentation image generated by the display control unit.
[0252] <11> according to <10> The fingerprint authentication device, wherein:
[0253] The display control unit displays the presentation image superimposed on a detection area for detecting the fingerprint.
[0254] <12> according to <1> to <11> The fingerprint authentication device according to any one of the preceding claims further comprises:
[0255] An acquisition status image generation unit generates an acquisition status image for presenting an acquisition status of fingerprint information from the fingerprint.
[0256] <13> according to <12> The fingerprint authentication device, wherein:
[0257] The acquisition status image includes an image whose clarity changes according to the progress of the fingerprint information acquisition.
[0258] <14> according to <12> or <13> The fingerprint authentication device, wherein:
[0259] The acquisition status image includes an image for presenting the position of the area of the fingerprint where acquisition of the fingerprint information is performed.
[0260] <15> A fingerprint authentication method for a fingerprint authentication device, the fingerprint authentication device comprising:
[0261] display control unit; and
[0262] Processing unit, the method comprising:
[0263] generating a presentation image using the display control unit, the presentation image being used to present the position of the base of the nail of the finger when the fingerprint is detected; and
[0264] Using the processing unit, an image of the fingerprint is obtained using the generated rendering image.
[0265] <16> A program that enables a computer to:
[0266] a display control unit configured to generate a presentation image for presenting the position of the base of the nail of the finger when the fingerprint is detected; and
[0267] A processing unit is configured to obtain an image of the fingerprint using the generated rendered image.
[0268] Reference Signs List
[0269] 11 Fingerprint authentication device
[0270] 12 Fingerprint sensor
[0271] 13 Operation input unit
[0272] 14 storage units
[0273] 15 Display unit
[0274] 16 processing units
[0275] 21 Processing switching unit
[0276] 22 Fingerprint registration processing unit
[0277] 23 Fingerprint authentication processing unit
[0278] 24 Image output unit
[0279] 61 Fingerprint image capture unit
[0280] 62 Feature detection unit
[0281] 63 Verification Units
[0282] 64 central processing units
[0283] 65 Fingerprint Image Combination Unit
[0284] 66 Finger position presentation image generation unit
[0285] 67 Acquisition state image generation unit.
Claims
1. A fingerprint authentication device, comprising: a display control unit configured to generate a presentation image for presenting the position of the base of the nail of the finger when the fingerprint is detected, The presented image includes an image superimposed with at least any two images of a cross image, a nail image, and a circle image. wherein the image of the nail is displayed in a manner such that the base of the nail coincides with a reference point in the cross image, and the reference point in the cross image is the center of the circular image; and A processing unit is configured to obtain an image of the fingerprint using the generated rendered image.
2. The fingerprint authentication device according to claim 1, wherein: The presented image includes an image of a fingertip, and the image of the fingertip includes an image of a nail.
3. The fingerprint authentication device according to claim 1, wherein: The presented image includes an image in which at least any two images of a cross image of a cross, an image of a nail, and a circle image of a circle are superimposed in a step-by-step manner.
4. The fingerprint authentication device according to claim 1, wherein: The position of the nail base to be rendered is moved to a plurality of positions in the rendering image.
5. The fingerprint authentication device according to claim 1, wherein: The display control unit is configured to generate: an image of a detection area for detecting the fingerprint; as well as The presented image of the position of the nail root is presented on the image of the detection area.
6. The fingerprint authentication device according to claim 1, further comprising: A display unit displays the presentation image generated by the display control unit.
7. The fingerprint authentication device according to claim 6, wherein: The display control unit displays the presentation image superimposed on a detection area for detecting the fingerprint.
8. The fingerprint authentication device according to claim 1, further comprising: An acquisition status image generation unit generates an acquisition status image for presenting an acquisition status of fingerprint information from the fingerprint.
9. The fingerprint authentication device according to claim 8, wherein: The acquisition status image includes an image whose clarity changes according to the progress of the fingerprint information acquisition.
10. The fingerprint authentication device according to claim 8, wherein: The acquisition status image includes an image for presenting the position of the area of the fingerprint where acquisition of the fingerprint information is performed.
11. A fingerprint authentication method for a fingerprint authentication device, the fingerprint authentication device comprising: Display control unit; as well as Processing unit, the method comprising: generating a presentation image using the display control unit, the presentation image being used to present the position of the base of the nail of the finger when the fingerprint is detected, The presented image includes an image superimposed with at least any two images of a cross image, a nail image, and a circle image. wherein the image of the nail is displayed in a manner such that the base of the nail coincides with a reference point in the cross image, the reference point in the cross image being the center of the circular image; and Using the processing unit, an image of the fingerprint is obtained using the generated rendering image.
12. A computer-readable storage medium having stored thereon a program which, when executed, causes a computer to function as: a display control unit configured to generate a presentation image for presenting the position of the base of the nail of the finger when the fingerprint is detected, in, The presented image includes an image on which at least any two images of a cross image, a nail image, and a circle image are superimposed, wherein the image of the nail is displayed in a manner such that the base of the nail coincides with a reference point in the cross image, and the reference point in the cross image is the center of the circular image; and A processing unit is configured to obtain an image of the fingerprint using the generated rendered image.
Citation Information
Patent Citations
Device, method, and graphical user interface for manipulating user interfaces on the basis of unlock input
JP2018195316A
Notification processing method and electronic device
CN108701000A
Device, method, and graphical user interface for manipulating user interfaces based on fingerprint sensor inputs
US20150074615A1
Electronic device and method for acquiring fingerprint information
US20180114047A1