Fingerprint verification method and electronic device

Abstract

The embodiment of the present application provides a fingerprint verification method and electronic device, which relates to the technical field of electronic devices and can improve the efficiency and security of fingerprint verification. The specific method includes: the electronic device obtains the two-dimensional fingerprint information of the finger to be verified in response to the user's pressing operation in the fingerprint sensing area of ​​the electronic device; then compares the two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored on the electronic device; and based on the two-dimensional fingerprint information of the finger to be verified, generates the deformation information of the finger to be verified, and performs liveness detection on the finger to be verified based on the deformation information of the finger to be verified; if the two-dimensional fingerprint information of the finger to be verified is successfully compared with the pre-stored three-dimensional fingerprint information, and the liveness detection of the finger to be verified is successful, it is determined that the finger to be verified has passed the fingerprint verification; otherwise, the finger to be verified has not passed the fingerprint verification.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of electronic devices, and in particular to a fingerprint verification method and electronic device. Background Art

[0002] Fingerprint verification (such as fingerprint unlocking, fingerprint payment, etc.) is increasingly used in electronic devices. Fingerprint verification is to determine whether the verification is passed by comparing the fingerprint pre-entered by the user on the electronic device with the collected fingerprint to be verified. For users, the security of the fingerprint verification process is very important.

[0003] At present, during the fingerprint registration process, a high-precision camera that supports three-dimensional recognition technology is used to collect fingerprint images of a finger at five specific angles. Then, a three-dimensional fingerprint model of the finger is generated based on these five fingerprint images, and the three-dimensional fingerprint model is stored (hereinafter referred to as the recorded fingerprint model). During the fingerprint verification process, fingerprint comparison and fingerprint liveness detection are required. Specifically, the fingerprint comparison process is: collecting fingerprint images of the finger to be verified at five angles to generate a three-dimensional fingerprint model of the finger to be verified, and then comparing the three-dimensional fingerprint model of the finger to be verified with the recorded fingerprint model. If the difference between the two is within a preset error range, the fingerprint comparison is successful, otherwise, the fingerprint comparison fails; the fingerprint liveness detection process is: by extracting sweat pore information from one or more fingerprint images of the finger to be verified collected above, the sweat pore information includes at least one of the number of sweat pores, sweat pore density and sweat pore position, and then comparing the sweat pore information of the finger to be verified with the sweat pore information of the recorded finger. If the sweat pore information of the finger to be verified is consistent with the sweat pore information of the recorded finger, the liveness detection is successful, indicating that the fingerprint to be verified is not an impersonation fingerprint. If the fingerprint comparison is successful and the fingerprint liveness detection is successful, the finger to be verified passes the fingerprint verification.

[0004] However, in the above method, during the fingerprint comparison process, since it is necessary to collect fingerprint images of the user's finger to be verified at multiple angles, and to perform three-dimensional modeling based on the fingerprint images at multiple angles to generate a three-dimensional fingerprint model, the steps of the fingerprint comparison process are too cumbersome, resulting in a long fingerprint comparison time, which reduces the user experience. In the fingerprint liveness detection process, whether the fingerprint to be verified is an impersonation is determined based on the sweat pore information. Sweat pore information is usually a constant and can be easily counterfeited (such as a contract or a fingerprint on a mobile phone screen collected by others and then counterfeited). Therefore, the accuracy of fingerprint liveness detection is low. Summary of the Invention

[0005] The embodiments of the present application provide a fingerprint verification method and an electronic device, which can improve the efficiency and security of fingerprint verification.

[0006] To achieve the above objectives, the present invention adopts the following technical solutions:

[0007] In a first aspect, an embodiment of the present application provides a fingerprint verification method, which is applied to an electronic device, and the method includes: the electronic device obtains two-dimensional fingerprint information of the finger to be verified in response to a user's pressing operation in a fingerprint sensing area of ​​the electronic device; then the electronic device compares the obtained two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored on the electronic device, and the electronic device generates deformation information of the finger to be verified based on the two-dimensional fingerprint information of the finger to be verified, and the deformation information of the finger to be verified is used to indicate the morphological change state of the finger to be verified when the user performs a pressing operation in the fingerprint sensing area of ​​the electronic device; then, based on the deformation information of the finger to be verified, liveness detection is performed on the finger to be verified; finally, when the two-dimensional fingerprint information of the finger to be verified is successfully compared with the pre-stored three-dimensional fingerprint information, and the electronic device successfully performs liveness detection on the finger to be verified, the electronic device determines that the finger to be verified has passed the fingerprint verification; otherwise, the electronic device determines that the finger to be verified has not passed the fingerprint verification.

[0008] The two-dimensional fingerprint information of the finger to be verified may include but is not limited to valley information, ridge information, and minutiae information of the fingerprint.

[0009] In an embodiment of the present application, when the fingerprint information pre-stored in the electronic device (i.e., the recorded fingerprint information) is three-dimensional fingerprint information, the user performs fingerprint verification by pressing the fingerprint sensing area of ​​the electronic device with the finger to be verified, without having to use a camera to capture fingerprint images of the finger to be verified at multiple angles for fingerprint verification. This can reduce the time consumption of the fingerprint verification process and improve the efficiency of fingerprint verification. In addition, the electronic device can generate deformation information of the finger to be verified based on the two-dimensional fingerprint information of the finger to be verified, and perform liveness detection on the finger to be verified based on the deformation information. Since the deformation information of the finger is not easy to be forged, using the deformation information to perform liveness detection on the finger to be verified during the fingerprint verification process can effectively avoid attacks by forged fingerprints and improve the security of fingerprint verification.

[0010] In one possible implementation, before the above-mentioned electronic device compares the two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored on the electronic device, the fingerprint verification method provided in the embodiment of the present application also includes: the electronic device aligns the two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored on the electronic device, and determines the target area corresponding to the two-dimensional fingerprint information of the finger to be verified in the three-dimensional fingerprint information pre-stored on the electronic device.

[0011] The target area is the area corresponding to the two-dimensional fingerprint information of the finger to be verified in the three-dimensional fingerprint information pre-stored in the electronic device. Determining the target area is to determine which area of ​​the fingerprint information of the finger to be verified is the fingerprint information of the two-dimensional fingerprint information of the finger to be verified.

[0012] In one possible implementation, the electronic device aligns the two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored on the electronic device, and determines the target area corresponding to the two-dimensional fingerprint information of the finger to be verified in the three-dimensional fingerprint information pre-stored on the electronic device, including: the electronic device performs three-dimensional reconstruction on the two-dimensional fingerprint information of the finger to be verified to obtain the three-dimensional fingerprint information of the finger to be verified, and extracts the first feature of the three-dimensional fingerprint information of the finger to be verified, and at the same time, extracts the first feature of the three-dimensional fingerprint information pre-stored on the electronic device; wherein the first feature includes curvature information, depth information, angle information and edge information of the three-dimensional fingerprint information; then, the electronic device aligns the first feature of the three-dimensional fingerprint information of the finger to be verified with the first feature of the three-dimensional fingerprint information pre-stored on the electronic device, and determines the target area corresponding to the two-dimensional fingerprint information of the finger to be verified in the three-dimensional fingerprint information pre-stored on the electronic device.

[0013] In an embodiment of the present application, the two-dimensional fingerprint information of the finger to be verified is aligned with the three-dimensional fingerprint information pre-stored on the electronic device, and the target area corresponding to the two-dimensional fingerprint information of the finger to be verified in the three-dimensional fingerprint information pre-stored on the electronic device is determined. In this way, in the subsequent fingerprint comparison and liveness detection process, the target area is used for fingerprint comparison and liveness detection, and there is no need to compare and detect liveness for all information of the pre-stored three-dimensional fingerprint information, which can reduce the computational complexity and complexity of fingerprint verification.

[0014] In one possible implementation, the method for the electronic device to compare the two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored on the electronic device specifically includes: performing three-dimensional reconstruction on the two-dimensional fingerprint information of the finger to be verified to obtain the three-dimensional fingerprint information of the finger to be verified, then extracting the second feature of the three-dimensional fingerprint information of the finger to be verified, and at the same time, extracting the second feature of the fingerprint information of the target area in the three-dimensional fingerprint information pre-stored on the electronic device; wherein the second feature includes depth information, angle information, curvature information, edge information, ridge information and minutiae information; finally, the electronic device calculates the similarity between the second feature of the three-dimensional fingerprint information of the finger to be verified and the second feature of the fingerprint information of the target area, and determines whether the comparison between the two-dimensional fingerprint information of the finger to be verified and the three-dimensional fingerprint information pre-stored on the electronic device is successful based on the similarity; wherein, if the similarity is greater than or equal to a preset threshold, the comparison between the two-dimensional fingerprint information of the finger to be verified and the three-dimensional fingerprint information pre-stored on the electronic device is successful; otherwise, the comparison between the two-dimensional fingerprint information of the finger to be verified and the three-dimensional fingerprint information pre-stored on the electronic device fails.

[0015] The second feature may further include valley line information.

[0016] In an embodiment of the present application, fingerprint verification is performed by the user pressing the fingerprint sensing area of ​​the electronic device with the finger to be verified, and there is no need to use a camera to collect fingerprint images of the finger to be verified at multiple angles for fingerprint verification. In this way, the time consumption of the fingerprint verification process can be reduced and the efficiency of fingerprint verification can be improved.

[0017] In one possible implementation, the method for an electronic device to generate deformation information of a finger to be verified based on the two-dimensional fingerprint information of the finger to be verified specifically includes: the electronic device performs three-dimensional reconstruction on the two-dimensional fingerprint information of the finger to be verified to generate three-dimensional fingerprint information of the finger to be verified; then, extracts the third feature of the three-dimensional fingerprint information of the finger to be verified and the third feature of the fingerprint information of the target area in the three-dimensional fingerprint information pre-stored on the electronic device; wherein the third feature includes depth information, angle information, curvature information, edge information, ridge information and detail point information; finally, the electronic device generates the deformation information of the finger to be verified based on the third feature of the three-dimensional fingerprint information of the finger to be verified and the third feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information.

[0018] The third feature mentioned above may further include valley line information.

[0019] In one possible implementation, the method for the electronic device to perform liveness detection on a finger to be verified based on deformation information of the finger to be verified includes: the electronic device inputting the deformation information of the finger to be verified into a target liveness detection model, and determining whether liveness detection on the finger to be verified is successful based on the liveness detection probability output by the target liveness detection model. If the liveness detection probability is greater than a preset probability threshold, liveness detection on the finger to be verified is successful; otherwise, liveness detection on the finger to be verified fails.

[0020] In an embodiment of the present application, the electronic device can generate deformation information of the finger to be verified based on the two-dimensional fingerprint information of the finger to be verified, and perform liveness detection on the finger to be verified based on the deformation information. Since the deformation information of the finger is not easy to be imitated, using the deformation information to perform liveness detection on the finger to be verified during the fingerprint verification process can effectively avoid attacks of forged fingerprints and improve the security of fingerprint verification.

[0021] In one possible implementation, before the above-mentioned electronic device obtains the two-dimensional fingerprint information of the finger to be verified in response to the user's pressing operation in the fingerprint sensing area of ​​the electronic device, the fingerprint verification method provided in the embodiment of the present application also includes: the electronic device obtains three-dimensional fingerprint information pre-stored on the electronic device.

[0022] In one possible implementation, the electronic device obtains three-dimensional fingerprint information pre-stored on the electronic device, including: the electronic device starts the camera of the electronic device in response to the user's selection operation of the fingerprint entry option on the first interface of the electronic device; then, when the preview image in the preview interface of the electronic device meets the preset conditions, the camera collects images of the finger to be recorded at multiple different angles; finally, the electronic device generates the pre-stored three-dimensional fingerprint information based on the images of the finger to be recorded at multiple different angles.

[0023] In the embodiment of the present application, the electronic device captures images of the finger to be recorded at different angles and generates three-dimensional fingerprint information of the finger to be recorded based on the images at different angles. The fingerprint recording process has simple operation steps, short fingerprint recording time, and high user experience.

[0024] In one possible implementation, the above-mentioned preset conditions include at least one of the following: the preview interface of the electronic device includes the finger to be recorded, the distance between the finger to be recorded in the preview interface of the electronic device and the camera is within a preset distance range, or the finger to be recorded in the preview interface of the electronic device includes only one finger.

[0025] In one possible implementation, the preset distance interval is [2, 15] cm. Placing the finger to be recorded within the preset distance interval will achieve a better fingerprint capture effect, so that the fingerprint information generated based on the captured fingerprint image is more accurate.

[0026] In one possible implementation, the above method also includes determining whether the fingerprint information pre-stored in the electronic device includes the three-dimensional fingerprint information of the finger to be recorded. If the fingerprint information pre-stored in the electronic device includes the three-dimensional fingerprint information of the finger to be recorded, a prompt message is displayed, which is used to prompt the user to change the finger to be recorded.

[0027] In a possible implementation, the shooting mode of the electronic device is a macro mode. In the macro mode, the fingerprint image obtained is clearer and the fingerprint information is richer.

[0028] In a second aspect, the electronic device provided by the embodiment of the present application includes an acquisition module, a comparison module, a generation module, a liveness detection module, and a determination module. Among them, the acquisition module is used to respond to the user's pressing operation in the fingerprint sensing area of ​​the electronic device to obtain the two-dimensional fingerprint information of the finger to be verified; the comparison module is used to compare the two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored on the electronic device; the generation module is used to generate deformation information of the finger to be verified based on the two-dimensional fingerprint information of the finger to be verified, and the deformation information of the finger to be verified is used to indicate the morphological change state of the finger to be verified when the user presses the fingerprint sensing area of ​​the electronic device; the liveness detection module is used to perform liveness detection on the finger to be verified based on the deformation information of the finger to be verified; the determination module is used to determine that the finger to be verified has passed the fingerprint verification if the two-dimensional fingerprint information of the finger to be verified is successfully compared with the three-dimensional fingerprint information pre-stored on the electronic device and the liveness detection of the finger to be verified is successful; otherwise, it is determined that the finger to be verified has not passed the fingerprint verification.

[0029] In one possible implementation, the electronic device provided in an embodiment of the present application further includes a registration module. The registration module is configured to register the two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored on the electronic device, and determine a target area corresponding to the two-dimensional fingerprint information of the finger to be verified in the three-dimensional fingerprint information pre-stored on the electronic device.

[0030] In one possible implementation, the electronic device provided in the embodiment of the present application further includes a three-dimensional reconstruction module and a feature extraction module. The three-dimensional reconstruction module is used to perform three-dimensional reconstruction on the two-dimensional fingerprint information of the finger to be verified to obtain the three-dimensional fingerprint information of the finger to be verified; the feature extraction module is used to extract the first feature of the three-dimensional fingerprint information of the finger to be verified, and extract the first feature of the three-dimensional fingerprint information pre-stored on the electronic device; wherein the first feature includes curvature information, depth information, angle information and edge information of the three-dimensional fingerprint information; the registration module is specifically used to register the first feature of the three-dimensional fingerprint information of the finger to be verified with the first feature of the three-dimensional fingerprint information pre-stored on the electronic device, and determine the target area corresponding to the two-dimensional fingerprint information of the finger to be verified in the three-dimensional fingerprint information pre-stored on the electronic device.

[0031] In one possible implementation, the electronic device provided in the embodiment of the present application further includes a three-dimensional reconstruction module and a feature extraction module. The three-dimensional reconstruction module is used to perform three-dimensional reconstruction on the two-dimensional fingerprint information of the finger to be verified to obtain the three-dimensional fingerprint information of the finger to be verified; the feature extraction module is used to extract the second feature of the three-dimensional fingerprint information of the finger to be verified, and extract the second feature of the fingerprint information of the target area in the three-dimensional fingerprint information pre-stored on the electronic device; wherein the second feature includes depth information, angle information, curvature information, edge information, ridge information and minutiae information. The comparison module is specifically used to calculate the similarity between the second feature of the three-dimensional fingerprint information of the finger to be verified and the second feature of the fingerprint information of the target area, and determine whether the comparison between the two-dimensional fingerprint information of the finger to be verified and the three-dimensional fingerprint information pre-stored on the electronic device is successful based on the similarity; wherein, if the similarity is greater than or equal to a preset threshold, the comparison between the two-dimensional fingerprint information of the finger to be verified and the three-dimensional fingerprint information pre-stored on the electronic device is successful; otherwise, the comparison between the two-dimensional fingerprint information of the finger to be verified and the three-dimensional fingerprint information pre-stored on the electronic device fails.

[0032] In one possible implementation, the electronic device provided in the embodiment of the present application further includes a three-dimensional reconstruction module and a feature extraction module. The three-dimensional reconstruction module is used to perform three-dimensional reconstruction on the two-dimensional fingerprint information of the finger to be verified to obtain the three-dimensional fingerprint information of the finger to be verified; the feature extraction module is used to extract the third feature of the three-dimensional fingerprint information of the finger to be verified, and extract the third feature of the fingerprint information of the target area in the three-dimensional fingerprint information pre-stored on the electronic device; wherein the third feature includes depth information, angle information, curvature information, edge information, ridge information and detail point information; the generation module is also used to generate deformation information of the finger to be verified based on the third feature of the three-dimensional fingerprint information of the finger to be verified and the third feature of the fingerprint information of the target area in the three-dimensional fingerprint information pre-stored on the electronic device.

[0033] In one possible implementation, the liveness detection module is specifically used to input the deformation information of the finger to be verified into the target liveness detection model, and determine whether the liveness detection of the finger to be verified is successful based on the liveness detection probability output by the target liveness detection model; wherein, if the liveness detection probability is greater than a preset probability threshold, the liveness detection of the finger to be verified is successful; otherwise, the liveness detection of the finger to be verified fails.

[0034] In a possible implementation, the acquisition module is further configured to acquire three-dimensional fingerprint information pre-stored on the electronic device.

[0035] In one possible implementation, the acquisition module is specifically used to start the camera of the electronic device in response to the user's selection of the fingerprint entry option on the first interface of the electronic device; and when the preview image in the preview interface of the electronic device meets the preset conditions, the camera of the electronic device is used to collect images of the finger to be entered at multiple different angles; and based on the images of the finger to be entered at multiple different angles, generate three-dimensional fingerprint information pre-stored on the electronic device.

[0036] In one possible implementation, the above-mentioned preset conditions include at least one of the following: the preview interface of the electronic device includes the finger to be recorded, the distance between the finger to be recorded in the preview interface of the electronic device and the camera of the electronic device is within a preset distance range, or the finger to be recorded in the preview interface of the electronic device includes only one finger.

[0037] In a possible implementation, the preset distance interval is [2, 15] centimeters.

[0038] In one possible implementation, the electronic device provided in an embodiment of the present application further includes a display module. The determination module is further configured to determine whether the fingerprint information pre-stored in the electronic device includes the three-dimensional fingerprint information of the finger to be recorded; and the display module is configured to display a first prompt message if the fingerprint information pre-stored in the electronic device includes the three-dimensional fingerprint information of the finger to be recorded, the first prompt message being configured to prompt a user to change the finger to be recorded.

[0039] In a possible implementation, the shooting mode of the electronic device is a macro mode.

[0040] In a third aspect, an embodiment of the present application provides an electronic device comprising a memory and a processor. The memory is coupled to the processor; the memory is configured to store computer program code, wherein the computer program code comprises computer instructions; when the computer instructions are executed by the processor, the electronic device performs the method described in any one of the first aspect and its possible implementations.

[0041] In a fourth aspect, an embodiment of the present application provides a chip system, which is applied to an electronic device; the chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through lines; the interface circuit is used to receive a signal from a memory of the electronic device and send a signal to the processor, the signal including a computer instruction stored in the memory; when the processor executes the computer instruction, the electronic device executes the method described in the first aspect and any one of its possible implementations.

[0042] In a fifth aspect, an embodiment of the present application provides a computer storage medium for storing computer software instructions used for the above-mentioned electronic device, which includes a method for executing the above-mentioned first aspect and any one of its possible implementation methods.

[0043] In a sixth aspect, an embodiment of the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the method described in the first aspect and any one of its possible implementations.

[0044] It should be understood that the beneficial effects achieved by the technical solutions of the second to sixth aspects of the embodiments of the present application and the corresponding possible implementation methods can be referred to the technical effects of the first aspect and its corresponding possible implementation methods mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1A Schematic diagram 1 of the fingerprint entry process provided in an embodiment of the present application;

[0046] Figure 1B Flowchart 1 of a fingerprint verification process provided in an embodiment of the present application;

[0047] Figure 1C A fingerprint verification process provided in this embodiment of the application Figure 2 ;

[0048] Figure 2 A hardware schematic diagram of an electronic device provided in an embodiment of the present application;

[0049] Figure 3 Schematic diagram 1 of a fingerprint verification method provided in an embodiment of the present application;

[0050] Figure 4 A schematic diagram of two-dimensional fingerprint information provided in an embodiment of the present application;

[0051] Figure 5 A schematic diagram of a target area provided in an embodiment of the present application;

[0052] Figure 6 A fingerprint verification method provided in this embodiment of the present application Figure 2 ;

[0053] Figure 7 A fingerprint verification method provided in this embodiment of the present application Figure 3 ;

[0054] Figure 8 A fingerprint verification method provided in this embodiment of the present application Figure 4 ;

[0055] Figure 9 A fingerprint verification method provided in this embodiment of the present application Figure 5 ;

[0056] Figure 10 A schematic diagram of the fingerprint entry process provided in this embodiment of the application Figure 2 ;

[0057] Figure 11 A schematic diagram of the fingerprint entry process provided in this embodiment of the application Figure 3 ;

[0058] Figure 12 A schematic diagram of the fingerprint entry process provided in this embodiment of the application Figure 4 ;

[0059] Figure 13 A schematic diagram of the fingerprint entry process provided in this embodiment of the application Figure 5 ;

[0060] Figure 14 A schematic diagram of the fingerprint entry process provided in this embodiment of the application Figure 6 ;

[0061] Figure 15 A schematic diagram of the fingerprint entry process provided in this embodiment of the application Figure 7 ;

[0062] Figure 16 A schematic diagram of the fingerprint entry process provided in this embodiment of the application Figure 8 ;

[0063] Figure 17 A schematic diagram of a fingerprint entry process provided in an embodiment of the present application;

[0064] Figure 18 A first structural diagram of an electronic device provided in an embodiment of the present application;

[0065] Figure 19 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application Figure 2 . DETAILED DESCRIPTION

[0066] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0067] In the description and claims of the embodiments of this application, the terms "first" and "second" are used to distinguish different objects rather than to describe a specific order of objects. For example, the terms "first feature" and "second feature" are used to distinguish different features rather than to describe a specific order of features.

[0068] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0069] In the description of the embodiments of this application, unless otherwise specified, "multiple" means two or more. For example, "multiple processing units" means two or more processing units; "multiple systems" means two or more systems.

[0070] With the development of electronic technology, electronic products (such as smartphones) can provide more and more convenient services in people's lives. Among them, fingerprint verification is widely used in daily life and can be applied to scenarios such as fingerprint unlocking and fingerprint payment. For example, when unlocking a mobile phone, the user no longer needs to enter a six-digit password on the phone's display to unlock it. The user can simply place a finger (the fingerprint information of the finger is pre-stored in the phone) on the fingerprint sensing area of ​​the phone and press it to unlock the phone.

[0071] It should be understood that fingerprint registration is required before fingerprint verification. Currently, the fingerprint registration and verification methods can include the following two methods.

[0072] Method 1: 2D fingerprint entry and fingerprint verification

[0073] A two-dimensional fingerprint is a fingerprint information collected by the mobile phone when the user's finger presses on the fingerprint sensing area (also called the fingerprint collection area) of the mobile phone screen. Figure 1A As shown, after the user selects the new fingerprint option on the phone, the phone displays Figure 1A The fingerprint entry interface shown in (a) of FIG, so that the user can enter the fingerprint according to Figure 1AFollow the prompt information displayed in (a) to start recording fingerprints. Specifically, place the finger to be recorded in the fingerprint sensing area and press it. The phone collects fingerprint information in response to the pressing operation. In this fingerprint recording method, the user needs to adjust the finger pressing posture multiple times (for example, adjust the angle between the finger and the screen or fine-tune the position of the finger in the fingerprint sensing area) and repeatedly press the fingerprint sensing area of ​​the phone. Figure 1A (b) in the figure illustrates the display effect of the fingerprint entry interface after one press operation. Figure 1A Figure (c) shows the interface after the phone has completed fingerprint registration through multiple presses. Accordingly, when performing fingerprint verification, the user presses the fingerprint sensing area of ​​the phone, and the phone collects the fingerprint information of the finger to be verified. The phone then compares the fingerprint information of the finger to be verified with the fingerprint information already recorded in the phone and performs a liveness detection on the fingerprint information of the finger to be verified to determine whether the finger to be verified can pass fingerprint verification.

[0074] It can be seen that when using method 1 to enter fingerprints, users need to press the fingerprint sensing area of ​​the phone multiple times, which takes a long time and the user experience is low. Figure 1B As shown in the flowchart of the fingerprint verification process, during the fingerprint verification stage, the fingerprint information collected by pressing is two-dimensional fingerprint information. Generally, two-dimensional fingerprint information is easy to forge, resulting in inaccurate liveness detection results. When the forged two-dimensional fingerprint information is verified, it will pose a greater threat to the user's privacy and property safety.

[0075] Method 2: 3D fingerprint entry and fingerprint verification

[0076] A three-dimensional fingerprint is the result of collecting multiple fingerprint images of a finger through a camera, generating a three-dimensional model of the finger, and fusing the fingerprint information with the three-dimensional model.

[0077] During the fingerprint registration process, a high-precision camera that supports 3D recognition technology is used to collect multiple fingerprint images of a finger at specific angles (for example, 5). These multiple fingerprint images are then used to perform 3D fingerprint modeling on the finger to be verified, generating 3D fingerprint information of the finger and storing the 3D fingerprint information (hereinafter referred to as the registered fingerprint information). Figure 1C As shown in the flowchart of the fingerprint verification process, in the fingerprint verification process, similarly, fingerprint images of the finger to be verified at multiple specific angles are collected and three-dimensional fingerprint modeling is performed to generate three-dimensional fingerprint information of the finger to be verified. The three-dimensional fingerprint information of the fingerprint to be verified is then compared with the recorded three-dimensional fingerprint information. If the error between the two is within the preset error range, the fingerprint verification of the finger to be verified is successful. Otherwise, the fingerprint verification of the finger to be verified fails.

[0078] It can be seen that in the above-mentioned three-dimensional fingerprint entry and fingerprint verification scheme, during the fingerprint verification process, it is necessary to collect fingerprint images of the user at multiple specific angles and perform three-dimensional fingerprint modeling. Compared with the method of collecting the two-dimensional fingerprint information of the finger to be verified by pressing for fingerprint verification (i.e., method one), the fingerprint verification steps (i.e., method two) are more cumbersome, the fingerprint verification process is longer, and the user experience is lower. In addition, this three-dimensional fingerprint verification method only considers whether the three-dimensional fingerprint information of the finger to be verified matches the three-dimensional fingerprint information that has been entered, but does not consider the situation of forged fingerprints, that is, no liveness detection is performed on the finger to be verified. Therefore, the security of fingerprint verification is relatively low.

[0079] Based on the problems of long time consumption and low security in the fingerprint verification process in the prior art, the embodiments of the present application provide a fingerprint verification method and electronic device, which can obtain the two-dimensional fingerprint information of the finger to be verified in response to the user's pressing operation in the fingerprint sensing area of ​​the electronic device; then compare the two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored on the electronic device; and based on the two-dimensional fingerprint information of the finger to be verified, generate the deformation information of the finger to be verified; and perform liveness detection on the finger to be verified based on the deformation information of the finger to be verified; if the two-dimensional fingerprint information is successfully compared with the pre-stored three-dimensional fingerprint information and the liveness detection of the finger to be verified is successful, it is determined that the finger to be verified has passed the fingerprint verification; otherwise, the finger to be verified has not passed the fingerprint verification. The technical method provided by the embodiments of the present application can improve the efficiency of fingerprint verification and enhance the security of fingerprint verification.

[0080] For example, the electronic device in the embodiments of the present application may be a tablet computer, a mobile phone, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), and the like. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device.

[0081] The execution subject of the fingerprint verification method provided in the embodiment of the present application may be a device that supports fingerprint verification, and the execution device may be the following Figure 2 The electronic device shown. At the same time, the execution device can also be the central processing unit (CPU) of the electronic device. In the embodiment of the present application, the fingerprint verification method provided by the embodiment of the present application is described by taking the execution of the fingerprint verification method by the electronic device as an example.

[0082] Please refer to Figure 2 , the embodiment of the present application takes the electronic device as Figure 2Taking the mobile phone 200 shown as an example, the electronic device provided by the embodiment of the present application is introduced. Figure 2 The illustrated cell phone 200 is merely one example of an electronic device, and the cell phone 200 may have more or fewer components than shown, may combine two or more components, or may have a different configuration of components. Figure 2 The various components shown in the illustrative embodiment may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0083] like Figure 2 As shown, the mobile phone 200 may include: a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295, etc.

[0084] Among them, the above-mentioned sensor module 280 may include sensors such as pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor and bone conduction sensor.

[0085] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the mobile phone 200. In other embodiments, the mobile phone 200 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The components shown in the illustrations may be implemented in hardware, software, or a combination of software and hardware.

[0086] The processor 210 may include one or more processing units. For example, the processor 210 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0087] The controller can be the nerve center and command center of the mobile phone 200. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0088] Processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 210 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 210. If processor 210 needs to use the same instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 210 latency, and thus improves system efficiency.

[0089] In some embodiments, the processor 210 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0090] It is understood that the interface connection relationship between the modules illustrated in this embodiment is merely illustrative and does not limit the structure of the mobile phone 200. In other embodiments, the mobile phone 200 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0091] The charging management module 240 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While charging the battery 242, the charging management module 240 can also power the electronic device through the power management module 241.

[0092] The power management module 241 is used to connect the battery 242, the charging management module 240, and the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240 and provides power to the processor 210, the internal memory 221, the external memory, the display 294, the camera 293, and the wireless communication module 260. In some embodiments, the power management module 241 and the charging management module 240 can also be provided in the same device.

[0093] The wireless communication function of mobile phone 200 can be implemented through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor, and baseband processor. In some embodiments, antenna 1 of mobile phone 200 is coupled to mobile communication module 250, and antenna 2 is coupled to wireless communication module 260, so that mobile phone 200 can communicate with the network and other devices via wireless communication technology. For example, in the embodiment of the present application, mobile phone 200 can send the above-mentioned target data to other devices via wireless communication technology.

[0094] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile phone 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0095] Mobile communication module 250 can provide wireless communication solutions for mobile phone 200, including 2G / 3G / 4G / 5G. Mobile communication module 250 can include at least one filter, switch, power amplifier, low-noise amplifier (LNA), etc. Mobile communication module 250 can receive electromagnetic waves from antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation.

[0096] The mobile communication module 250 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via the antenna 1. In some embodiments, at least some functional modules of the mobile communication module 250 can be set in the processor 210. In some embodiments, at least some functional modules of the mobile communication module 250 can be set in the same device as at least some modules of the processor 210.

[0097] The wireless communication module 260 can provide wireless communication solutions for the mobile phone 200, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. For example, in the embodiment of the present application, the mobile phone 200 can access the Wi-Fi network through the wireless communication module 260.

[0098] Wireless communication module 260 can be one or more devices that integrate at least one communication processing module. Wireless communication module 260 receives electromagnetic waves via antenna 2, frequency-modulates and filters the electromagnetic wave signals, and transmits the processed signals to processor 210. Wireless communication module 260 can also receive signals to be transmitted from processor 210, frequency-modulate and amplify them, and then convert them into electromagnetic waves for radiation via antenna 2.

[0099] Mobile phone 200 implements display functionality through a GPU, display screen 294, and an application processor. The GPU is a microprocessor for image processing that connects display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or modify display information.

[0100] The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel. For example, in an embodiment of the present application, the display screen 294 can be used to display the application interface of the first application, such as the device sharing interface, the device search interface, and the QR code scanning interface.

[0101] Mobile phone 200 can implement a camera function through an ISP, a camera 293, a video codec, a GPU, a display 294, and an application processor. The ISP is used to process data fed back by the camera 293. The camera 293 is used to capture still images or videos. In some embodiments, mobile phone 200 may include one or N cameras 293, where N is a positive integer greater than one.

[0102] The external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 200. The external memory card communicates with the processor 210 via the external memory interface 220 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0103] The internal memory 221 can be used to store computer executable program code, which includes instructions. The processor 210 executes various functional applications and data processing of the mobile phone 200 by running the instructions stored in the internal memory 221. For example, in an embodiment of the present application, the processor 210 can execute instructions stored in the internal memory 221, and the internal memory 221 can include a program storage area and a data storage area.

[0104] The program storage area may store an operating system, at least one application required for a function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the mobile phone 200 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 221 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0105] The mobile phone 200 can implement audio functions such as music playback and recording through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone jack 270D, and the application processor.

[0106] The buttons 290 include a power button, a volume button, etc. The button 290 can be a mechanical button. It can also be a touch button. The motor 291 can generate a vibration prompt. The motor 291 can be used for an incoming call vibration prompt, or for touch vibration feedback. The indicator 292 can be an indicator light, which can be used to indicate the charging status, power changes, messages, missed calls, notifications, etc. The SIM card interface 295 is used to connect the SIM card. The SIM card can be connected to and separated from the mobile phone 200 by inserting it into the SIM card interface 295 or pulling it out from the SIM card interface 295. The mobile phone 200 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 295 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.

[0107] although Figure 2 Not shown, the mobile phone 200 may also include a flash, a micro-projection device, a near field communication (NFC) device, etc., which will not be described in detail here.

[0108] The methods in the following embodiments can all be implemented in an electronic device having the above hardware structure. Figure 2 Taking the mobile phone 200 shown as an example, the method of the embodiment of the present application is described.

[0109] The present application embodiment provides a fingerprint verification method, such as Figure 3 As shown, the fingerprint verification method may include S301-S306.

[0110] S301: The electronic device obtains two-dimensional fingerprint information of a finger to be verified in response to a user's pressing operation in a fingerprint sensing area of ​​the electronic device.

[0111] In the embodiment of the present application, after the user presses the finger to be verified on the fingerprint sensing area of ​​the electronic device, the electronic device collects the fingerprint image of the finger to be verified, and performs image enhancement, binarization, feature extraction and other processing operations on the fingerprint image to obtain the two-dimensional fingerprint information of the finger to be verified. The two-dimensional fingerprint information of the finger to be verified may include but is not limited to the valley line information, ridge line information and minutiae information of the fingerprint. Figure 4 It can be understood that the ridges of a fingerprint are the raised lines in the fingerprint, that is, the lines with a certain width and direction in the fingerprint image; the valleys of a fingerprint are the concave lines in the fingerprint, that is, the concave parts between the ridges; the minutiae information is used to indicate the characteristic points of the fingerprint, including the endpoints and bifurcation points of the fingerprint; among them, the endpoints are the two ends of the fingerprint lines of the finger; the bifurcation point is the intersection point where two lines in the fingerprint intersect to form one line. For example, Figure 4In the fingerprint image shown, the darker lines are called ridges and the lighter lines are called valleys. The endpoints and bifurcation points of the fingerprint are shown in Figure 4 Instructions in .

[0112] After the user presses the fingerprint sensing area of ​​the electronic device, the fingerprint information of the finger is collected by the fingerprint sensor in the electronic device. Optionally, the fingerprint sensor includes but is not limited to a semiconductor capacitive sensor, an optical sensor, a semiconductor thermal sensor, a semiconductor pressure sensor, an ultrasonic sensor, and a radio frequency sensor.

[0113] S302: The electronic device aligns the two-dimensional fingerprint information of the finger to be verified with the pre-stored three-dimensional fingerprint information, and determines a target area corresponding to the two-dimensional fingerprint information in the three-dimensional fingerprint information.

[0114] It should be understood that the target area is the area corresponding to the two-dimensional fingerprint information of the finger to be verified obtained in S301 in the three-dimensional fingerprint information pre-stored in the electronic device. The above determination of the target area is to determine which area of ​​the fingerprint information of the finger to be verified is the fingerprint information of the finger to be verified. Figure 5 A schematic diagram of the target area.

[0115] In the embodiment of the present application, the above-mentioned pre-stored three-dimensional fingerprint information is the fingerprint information entered during the fingerprint entry stage. The fingerprint entry process will be described in detail in the following embodiments.

[0116] Alternatively, as Figure 6 , the above S302 can be specifically implemented through S3021 to S3024.

[0117] S3021. The electronic device performs three-dimensional reconstruction on the two-dimensional fingerprint information of the finger to be verified to obtain the three-dimensional fingerprint information of the finger to be verified.

[0118] First, the electronic device estimates the pressing angle and depth information of the two-dimensional fingerprint information based on the two-dimensional fingerprint information of the finger to be verified obtained in S301.

[0119] The pressing angle is used to indicate the angle between the finger to be verified and the fingerprint sensing area of ​​the electronic device when the finger to be verified performs a pressing operation in the fingerprint sensing area of ​​the electronic device. For example, if the fingerprint sensing area of ​​the electronic device is pressed with the side of the finger to be verified, an angle will be generated between the plane where the center area of ​​the fingerprint of the finger to be verified is located and the plane where the fingerprint sensing area of ​​the electronic device is located. The angle is between 0° and 90°; if the fingerprint sensing area of ​​the electronic device is pressed with the front of the finger to be verified (the side of the finger with the fingerprint is defined as the front), the plane where the center area of ​​the fingerprint of the finger to be verified is located and the plane where the fingerprint sensing area of ​​the electronic device is located will be coplanar, and the above angle is 0°.

[0120] The above-mentioned depth information refers to the three-dimensional coordinate information of each pixel point in the fingerprint image of the finger to be verified.

[0121] Optionally, in an embodiment of the present application, the electronic device may input the two-dimensional fingerprint information of the finger to be verified into a neural network model through a pre-trained neural network model (the neural network model is used to estimate the pressure angle and depth information of the two-dimensional fingerprint information), thereby outputting the pressure angle and depth information of the two-dimensional fingerprint information through the neural network model. Alternatively, the electronic device may also match the two-dimensional fingerprint information of the finger to be verified with the two-dimensional fingerprint information in the local knowledge base through a local knowledge base (the local knowledge base includes multiple two-dimensional fingerprint information and the pressure angle and depth information corresponding to the multiple two-dimensional fingerprint information), and then use the pressure angle and depth information of the matched two-dimensional fingerprint information as the pressure angle and depth information of the two-dimensional fingerprint information of the finger to be verified. The specific selection can be made according to actual conditions and is not limited in the embodiment of the present application.

[0122] Secondly, the electronic device uses the pressing angle and depth information of the two-dimensional fingerprint information to perform three-dimensional reconstruction of the two-dimensional fingerprint information to obtain the three-dimensional fingerprint information of the finger to be verified.

[0123] In a feasible embodiment, the electronic device can generate a three-dimensional point cloud of the finger to be verified (the three-dimensional point cloud of the finger is used to represent the three-dimensional model of the finger) based on the pressure angle and depth information of the two-dimensional fingerprint information based on monocular vision technology, and then fuse the three-dimensional point cloud of the finger to be verified with the fingerprint information of the finger to be verified (including the above-mentioned ridge information, valley line information, pressure angle, and depth information of the finger to be verified) to obtain the three-dimensional fingerprint information of the finger to be verified.

[0124] In another feasible embodiment, the electronic device can input the two-dimensional fingerprint information to be verified and the pressing angle and depth information corresponding to the two-dimensional fingerprint information of the finger to be verified into a pre-trained neural network model (the neural network model is used to generate the three-dimensional fingerprint information of the finger to be verified) based on a deep learning algorithm to obtain the three-dimensional fingerprint information of the finger to be verified.

[0125] The above method of obtaining the three-dimensional fingerprint information of the finger to be verified based on the two-dimensional fingerprint information of the finger to be verified can be determined according to actual conditions and is not limited in the embodiments of the present application.

[0126] S3022. The electronic device extracts a first feature of the three-dimensional fingerprint information of the finger to be verified.

[0127] S3023. The electronic device extracts a first feature of the three-dimensional fingerprint information pre-stored in the electronic device.

[0128] The first feature in the three-dimensional fingerprint information of the finger to be verified and the first feature in the three-dimensional fingerprint information pre-stored in the electronic device may both include curvature information, depth information, angle information and edge information of the three-dimensional fingerprint information.

[0129] The above curvature information is used to indicate the speed of change of the ridge direction, the depth information is used to indicate the three-dimensional coordinate information of each pixel point in the fingerprint image, the angle information is used to indicate the angle between the fingerprint of the finger to be verified and the screen, and the edge information is used to indicate the edge of the pressed fingerprint in the fingerprint image.

[0130] S3024. The electronic device aligns the first feature of the three-dimensional fingerprint information of the finger to be verified with the first feature of the pre-stored three-dimensional fingerprint information, and determines a target area in the pre-stored three-dimensional fingerprint information corresponding to the two-dimensional fingerprint information of the finger to be verified.

[0131] Specifically, the first feature in the three-dimensional fingerprint information of the finger to be verified is respectively aligned with the first features of multiple areas of the pre-stored three-dimensional fingerprint information, and the alignment results of the three-dimensional fingerprint information of the finger to be verified and the multiple areas of the pre-stored three-dimensional fingerprint information are obtained. The alignment results include multiple similarities corresponding to the multiple areas, and then the area corresponding to the maximum value of the similarities among the multiple similarities is determined as the area in the pre-stored three-dimensional fingerprint information corresponding to the two-dimensional fingerprint information of the finger to be verified, that is, the target area.

[0132] Optionally, there may be multiple target regions. Assuming the number of target regions is n (n is a positive integer greater than or equal to 2), the similarities corresponding to the n target regions are greater than other similarities among the multiple similarities (corresponding to multiple regions).

[0133] In an embodiment of the present application, the two-dimensional fingerprint information of the finger to be verified is aligned with the three-dimensional fingerprint information pre-stored on the electronic device, and the target area corresponding to the two-dimensional fingerprint information of the finger to be verified in the three-dimensional fingerprint information pre-stored on the electronic device is determined. In this way, in the subsequent fingerprint comparison and liveness detection process, the target area is used for fingerprint comparison and liveness detection, and there is no need to compare and detect liveness for all information of the pre-stored three-dimensional fingerprint information, which can reduce the computational complexity and complexity of fingerprint verification.

[0134] S303: The electronic device compares the two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored in the electronic device.

[0135] In the embodiment of the present application, the electronic device can convert the two-dimensional fingerprint information of the finger to be verified into three-dimensional fingerprint information, and then compare the three-dimensional fingerprint information of the finger to be verified with the pre-stored three-dimensional fingerprint information. Figure 7 As shown, S303 can be implemented through S3031-S3034.

[0136] S3031. The electronic device performs three-dimensional reconstruction on the two-dimensional fingerprint information of the finger to be verified to obtain the three-dimensional fingerprint information of the finger to be verified.

[0137] For the description of step S3031, please refer to the detailed description of step S3021 above, which will not be repeated here.

[0138] Optionally, after the electronic device executes the above step 3021 to obtain the three-dimensional fingerprint information of the finger to be verified, the electronic device can save the three-dimensional fingerprint information of the finger to be verified. In this way, when the electronic device compares the three-dimensional fingerprint information of the finger to be verified with the pre-stored three-dimensional fingerprint information, the electronic device reads the saved three-dimensional fingerprint information of the finger to be verified.

[0139] S3032. The electronic device extracts the second feature of the three-dimensional fingerprint information of the finger to be verified.

[0140] S3033: The electronic device extracts a second feature of the fingerprint information of the target area from the pre-stored three-dimensional fingerprint information.

[0141] In an embodiment of the present application, the second feature of the three-dimensional fingerprint information of the finger to be verified and the second feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information may both include depth information, angle information, curvature information, edge information, ridge information and detail point information.

[0142] Optionally, the second feature may further include valley line information.

[0143] S3034. The electronic device calculates the similarity between the second feature of the three-dimensional fingerprint information of the finger to be verified and the second feature of the fingerprint information of the target area, and determines whether the comparison between the three-dimensional fingerprint information of the finger to be verified and the three-dimensional fingerprint information pre-stored on the electronic device is successful based on the similarity.

[0144] Among them, if the similarity between the second feature of the three-dimensional fingerprint information of the finger to be verified and the second feature of the fingerprint information of the target area is greater than or equal to the preset threshold, the comparison between the two-dimensional fingerprint information of the finger to be verified and the pre-stored three-dimensional fingerprint information is successful; otherwise, the comparison between the two-dimensional fingerprint information of the finger to be verified and the pre-stored three-dimensional fingerprint information fails.

[0145] Optionally, the above-mentioned method of comparing the second feature of the three-dimensional fingerprint information of the finger to be verified with the second feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information may include: inputting the second feature of the three-dimensional fingerprint information of the finger to be verified and the second feature of the target area of ​​the pre-stored fingerprint information into a preset twin network, and obtaining the similarity between the second feature of the three-dimensional fingerprint information of the finger to be verified and the second feature of the fingerprint information of the target area. Wherein, the twin network is composed of two identical neural networks, and the two share weights. The second feature of the three-dimensional fingerprint information of the finger to be verified and the second feature of the pre-stored three-dimensional fingerprint information can be mapped to low-dimensional features respectively through the twin network, and then the similarity between the two sets of low-dimensional features is calculated, thereby obtaining the similarity between the three-dimensional fingerprint information of the finger to be verified and the pre-stored three-dimensional fingerprint information to complete the fingerprint comparison.

[0146] In an embodiment of the present application, when the above-mentioned target area includes multiple areas, the electronic device calculates the similarity between the second feature of the three-dimensional fingerprint information of the finger to be verified and the second features of the fingerprint information of multiple target areas according to S3031-S3034, and obtains multiple similarities. If at least one of the multiple similarities is greater than or equal to a preset threshold, the two-dimensional fingerprint information of the finger to be verified is successfully compared with the pre-stored three-dimensional fingerprint information; otherwise, the two-dimensional fingerprint information of the finger to be verified is compared with the pre-stored three-dimensional fingerprint information. Failure.

[0147] In one implementation, the electronic device may also convert pre-stored three-dimensional fingerprint information into two-dimensional fingerprint information, and compare the two-dimensional fingerprint information with the two-dimensional fingerprint information of the finger to be verified to achieve fingerprint comparison.

[0148] In an embodiment of the present application, fingerprint verification is performed by the user pressing the fingerprint sensing area of ​​the electronic device with the finger to be verified, and there is no need to use a camera to collect fingerprint images of the finger to be verified at multiple angles for fingerprint verification. In this way, the time consumption of the fingerprint verification process can be reduced and the efficiency of fingerprint verification can be improved.

[0149] S304: Generate deformation information of the finger to be verified based on the two-dimensional fingerprint information of the finger to be verified.

[0150] The deformation information is used to indicate the shape change of the finger to be verified when the user presses the fingerprint sensing area of ​​the electronic device. When the user presses the fingerprint sensing area of ​​the electronic device, the finger will deform. For example, the shape change of the finger may be different when the user presses with different pressing postures (different pressing angles or different pressing forces).

[0151] Alternatively, as Figure 8 As shown, the above S304 can be implemented through S3041-S3044.

[0152] S3041. The electronic device performs three-dimensional reconstruction on the two-dimensional fingerprint information of the finger to be verified to obtain the three-dimensional fingerprint information of the finger to be verified.

[0153] For the description of step S3041, reference may be made to the above detailed description of step S3021, which will not be repeated here.

[0154] Optionally, after the electronic device executes the above step 3021 to obtain the three-dimensional fingerprint information of the finger to be verified, the electronic device can save the three-dimensional fingerprint information of the finger to be verified. In this way, when the electronic device compares the three-dimensional fingerprint information of the finger to be verified with the pre-stored three-dimensional fingerprint information, the electronic device reads the saved three-dimensional fingerprint information of the finger to be verified.

[0155] S3042. The electronic device extracts the third feature of the three-dimensional fingerprint information of the finger to be verified.

[0156] S3043: The electronic device extracts the third feature of the fingerprint information of the target area from the pre-stored three-dimensional fingerprint information.

[0157] In an embodiment of the present application, the third feature of the three-dimensional fingerprint information of the finger to be verified and the third feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information may include depth information, angle information, curvature information, edge information, ridge information and detail point information.

[0158] Optionally, the third feature mentioned above may further include valley line information.

[0159] It should be noted that, in the embodiment of the present application, the second feature of the fingerprint information may be the same as or different from the third feature of the fingerprint information, and the embodiment of the present application does not limit this.

[0160] S3044: The electronic device generates deformation information of the finger to be verified based on the third feature of the three-dimensional fingerprint information of the finger to be verified and the third feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information.

[0161] S305: The electronic device performs liveness detection on the finger to be verified based on the deformation information of the finger to be verified.

[0162] In the embodiment of the present application, liveness detection is to detect whether the fingerprint information of the finger to be verified is the counterfeit fingerprint information obtained by collecting the counterfeit finger.

[0163] Specifically, the electronic device inputs the deformation information of the finger to be verified into the target liveness detection model (i.e., the fingerprint liveness detection classifier) ​​and determines whether the liveness detection of the finger to be verified is successful based on the liveness detection probability output by the target liveness detection model. If the liveness detection probability is greater than a preset probability threshold, the liveness detection of the finger to be verified is successful; otherwise, the liveness detection of the finger to be verified is unsuccessful.

[0164] Similarly, when there are multiple target areas, for each target area, the electronic device can generate deformation information of the finger to be verified according to S3041-S3044, and then calculate the liveness detection probability through S305, thereby obtaining multiple liveness detection probabilities of the finger to be verified. If at least one of the multiple liveness detection probabilities is greater than or equal to the preset probability threshold, the liveness detection of the finger to be verified is successful; otherwise, the liveness detection of the finger to be verified fails.

[0165] In an embodiment of the present application, the above-mentioned target liveness detection model can be a neural network model, which includes multiple convolutional layers, activation layers, pooling layers and fully connected layers connected in sequence. The output value of the neural network model (for example, the liveness detection probability) is used to determine whether the fingerprint to be verified is a live fingerprint. The neural network model can be trained based on a deep learning algorithm.

[0166] Optionally, the neural network model used for liveness detection in the embodiments of the present application can be pre-trained and stored in the electronic device or other device (e.g., the cloud). When the electronic device executes the above-mentioned fingerprint verification method, the neural network model is loaded to calculate the liveness detection probability of the finger to be verified. Alternatively, the neural network model is obtained by executing a deep learning algorithm training on the electronic device.

[0167] In the embodiments of the present application, when training the aforementioned neural network model, first, the structural parameters of the neural network model are preconfigured, such as the structural parameters of the aforementioned convolutional layer, activation layer, pooling layer, and fully connected layer. For example, taking the convolutional layer as an example, the number of input channels, the number of output channels, the size of the convolution kernel, the step size of the convolution operation, the activation function, etc. of the convolutional layer need to be preconfigured.

[0168] Secondly, initialize the initial values ​​of the operation parameters of the neural network model. For example, the convolution kernel used in each convolution layer has an initial value. The embodiment of the present application does not limit the initial values ​​of each operation parameter. For example, they can be randomly generated. It can be understood that the process of training the neural network model can be considered as the process of obtaining the actual values ​​of the operation parameters of the neural network (such as the value of each element in the convolution kernel, etc.).

[0169] Then, the neural network model is trained for a set of training data sets (including deformation information of fingerprints of multiple fingers and the probability of liveness detection of these fingers). Specifically, the deformation information of the fingers in the training set is input into the neural network model, which outputs the probability of liveness detection of the fingers. The loss value of the neural network model is then calculated, and the parameters of the neural network model are updated based on the loss value, thus completing one iteration. According to the above training process, multiple iterations are performed until the neural network model converges on the training data, and finally a converged neural network model is obtained.

[0170] In an embodiment of the present application, the electronic device can generate deformation information of the finger to be verified based on the two-dimensional fingerprint information of the finger to be verified, and perform liveness detection on the finger to be verified based on the deformation information. Since the deformation information of the finger is not easy to be imitated, using the deformation information to perform liveness detection on the finger to be verified during the fingerprint verification process can effectively avoid attacks of forged fingerprints and improve the security of fingerprint verification.

[0171] It should be noted that the embodiment of the present application does not limit the execution order of the above-mentioned step S303 and steps S304-S305. For example, step S303 can be executed first and then steps S304-S305, or steps S304-S305 can be executed first and then step S303, or steps S303 and steps S304-S305 can be executed at the same time.

[0172] S306. If the two-dimensional fingerprint information of the finger to be verified is successfully compared with the three-dimensional fingerprint information pre-stored in the electronic device, and the liveness detection of the finger to be verified is successful, the electronic device determines that the finger to be verified has passed the fingerprint verification; otherwise, the finger to be verified has failed the fingerprint verification.

[0173] In summary, the embodiment of the present application provides a fingerprint verification method, after the finger to be verified presses the fingerprint sensing area of ​​the electronic device, the electronic device can obtain the two-dimensional fingerprint information of the finger to be verified; then, the electronic device compares the two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored on the electronic device; and the electronic device generates deformation information of the finger to be verified based on the two-dimensional fingerprint information to be verified, and performs a liveness detection on the finger to be verified based on the deformation information of the finger to be verified, obtaining a liveness detection result of the finger to be verified. If the two-dimensional fingerprint information of the finger to be verified is successfully compared with the pre-stored three-dimensional fingerprint information and the liveness detection of the finger to be verified is also successful, it is determined that the finger to be verified has passed the fingerprint verification; otherwise, the finger to be verified has failed the fingerprint verification. In the fingerprint verification method provided by the embodiment of the present application, when the fingerprint information pre-stored in the electronic device (i.e., the recorded fingerprint information) is three-dimensional fingerprint information, the user performs fingerprint verification by pressing the fingerprint sensing area of ​​the electronic device with the finger to be verified, without the need to use a camera to collect fingerprint images of the finger to be verified at multiple angles for fingerprint verification, thereby reducing the time consumption of the fingerprint verification process and improving the efficiency of fingerprint verification. In addition, the electronic device can generate deformation information of the finger to be verified based on the two-dimensional fingerprint information of the finger to be verified, and perform liveness detection on the finger to be verified based on the deformation information. Since the deformation information of the finger is not easy to be imitated, using the deformation information to perform liveness detection on the finger to be verified during the fingerprint verification process can effectively avoid attacks from forged fingerprints and improve the security of fingerprint verification.

[0174] Optionally, before the electronic device obtains the two-dimensional fingerprint information of the finger to be verified in response to the user's pressing operation in the fingerprint sensing area of ​​the electronic device, the fingerprint verification method provided in the embodiment of the present application further includes: the electronic device obtaining pre-stored three-dimensional fingerprint information of the finger. Specifically, through interaction between the user and the electronic device, the user's fingerprint information is recorded and stored in the electronic device.

[0175] For example, take a finger as an example. Figure 9 The above electronic device obtains the pre-stored three-dimensional fingerprint information of the finger, including S901-S903.

[0176] S901: The electronic device activates a camera of the electronic device in response to a user selecting a fingerprint entry option on a first interface of the electronic device.

[0177] refer to Figure 10 Taking the mobile phone 200 as an example, when the user enters the fingerprint in the mobile phone 200, the mobile phone 200 displays Figure 10 The first interface 1001 (also called the fingerprint entry interface) shown in (a) of FIG. 1001 has the following fingerprint entry options: Figure 10 In (a), the "New 3D Fingerprint" option 1002 is selected. The above-mentioned selection operation of the fingerprint entry option on the first interface can be an operation of clicking the "New 3D Fingerprint" option 1002 on the first interface 1001. In response to the click operation, the mobile phone 200 starts the camera of the mobile phone 200. Figure 10 In (b), the user is waiting to enter the fingerprint.

[0178] Alternatively, the user can activate fingerprint entry through voice control, causing the electronic device to activate its camera. For example, the user issues a voice control command "activate fingerprint entry" to the mobile phone 200. The mobile phone 200 responds to the user's voice control command and activates the camera of the mobile phone 200, waiting for the user to enter the fingerprint.

[0179] Optionally, before starting the camera of the electronic device, the fingerprint verification method provided in the embodiment of the present application further includes: the electronic device displays a second interface in response to the user's selection operation of the fingerprint entry option on the first interface of the electronic device, the second interface including a first option and a second option, wherein the first option is used to start the front camera and the second option is used to start the rear camera. Figure 11 In (a), the user clicks the "Create 3D Fingerprint" option 1002 on the first interface 1001 displayed on the mobile phone 200, and the mobile phone 200 responds to the click operation and displays Figure 11 The second interface 1003 shown in (b) of the figure includes an option 1004 for "turn on the front camera" (i.e., the first option) and an option 1005 for "turn on the rear camera" (i.e., the second option). Further, the user selects the option 1005 for "turn on the rear camera" in the second interface 1003 displayed on the mobile phone 200, and the mobile phone 200 turns on the rear camera of the mobile phone 200. Figure 11 In (c), the user is waiting to enter the fingerprint.

[0180] Optionally, after the camera of the electronic device is started, the user can manually switch in the shooting interface and use the front camera or the rear camera to enter the fingerprint.

[0181] Optionally, in the embodiment of the present application, the shooting mode of the electronic device can be a macro mode. In the macro mode, the fingerprint image captured is clearer and the fingerprint information is richer.

[0182] In one implementation, after the camera of the electronic device is started, the user can set the shooting mode of the electronic device to the macro mode.

[0183] In another implementation, after the camera of the electronic device is started, the electronic device automatically adjusts the shooting mode of the electronic device to the macro mode according to the distance between the camera and the finger to be recorded. For example, the electronic device detects that the distance between the camera and the finger to be recorded is within a preset distance range (for example, [2, 15] centimeters), and the electronic device automatically adjusts the shooting mode to the macro mode.

[0184] S902: When the preview image in the preview interface of the electronic device meets a preset condition, a camera of the electronic device is used to collect multiple images of the finger to be recorded at different angles.

[0185] Optionally, the above-mentioned preset condition includes at least one of the following conditions 1 to 3:

[0186] Condition 1: The preview interface of the electronic device includes the finger to be recorded.

[0187] Condition 2: The distance between the finger to be recorded in the preview interface of the electronic device and the camera of the electronic device is within a preset distance range.

[0188] Optionally, the preset distance interval may be [2, 15] centimeters. Of course, the preset distance interval may also be other intervals, which is not limited in the embodiment of the present application.

[0189] In an embodiment of the present application, a camera is used to capture the (fingerprint) image of the finger to be recorded, and the finger to be recorded is placed within the above-mentioned preset distance range, which has a better fingerprint shooting effect. In this way, the fingerprint information generated based on the captured fingerprint image is more accurate.

[0190] Condition 3: the finger to be entered in the preview interface of the electronic device includes only one finger.

[0191] Optionally, when the preview image in the preview interface of the electronic device does not meet the above-mentioned preset conditions, the electronic device may prompt the user to adjust the finger or adjust the electronic device through the above-mentioned text prompts and / or voice prompts so that the preview image in the preview interface of the electronic device meets the above-mentioned preset conditions.

[0192] For example, when the preset condition is the above condition 1, if the electronic device detects that there is a finger to be recorded in the preview interface, the electronic device collects multiple images of the finger to be recorded at different angles; if the electronic device detects that there is no finger to be recorded in the preview interface, the electronic device can display a first prompt message, which is used to prompt the user to move the finger to be recorded into the shooting area so that the finger to be recorded is displayed in the preview interface. For example, refer to Figure 12Taking the mobile phone 200 as an example, when there is no finger to be recorded in the preview interface 1201 of the mobile phone 200, the mobile phone 200 displays a first prompt message, and the content of the first prompt message may be "No finger is detected, please put your finger into the shooting area."

[0193] When the preset condition is the above condition 2, if the electronic device detects that the distance between the finger to be recorded and the camera of the electronic device is within the preset distance interval, the electronic device collects images of the finger to be recorded at multiple different angles; if the electronic device detects that the distance between the finger to be recorded and the camera of the electronic device is outside the preset distance interval, the electronic device can display a second prompt message, which is used to prompt the user to move the finger to be recorded or move the electronic device so that the distance between the finger to be recorded and the camera is within the preset distance interval. For example, refer to Figure 13 Taking the mobile phone 200 as an example, when the mobile phone 200 detects that the distance between the finger to be recorded and the camera of the mobile phone 200 is outside the preset distance range, if the distance between the finger to be recorded and the camera of the mobile phone 200 is too close (for example, less than 2 cm), the mobile phone 200 displays a second prompt message, and the content of the second prompt message may be "Please move the phone farther away, keep it 2-15 cm away from the finger"; if the distance between the finger to be recorded and the camera of the mobile phone 200 is too far (for example, greater than 15 cm), the mobile phone 200 displays a second prompt message, and the content of the second prompt message may be "Please move the phone closer, keep it 2-15 cm away from the finger".

[0194] When the preset condition is the above condition 3, if the electronic device detects that there is only one finger in the shooting area of ​​the electronic device, the electronic device collects multiple images of the finger to be recorded at different angles; if the electronic device detects that there are multiple fingers in the shooting area of ​​the electronic device, the electronic device can display a third prompt information, which is used to prompt the user to use a single finger for fingerprint recording. For example, refer to Figure 14 Still taking the mobile phone 200 as an example, when the mobile phone 200 detects that there are multiple fingers in the shooting area, the mobile phone 200 displays a third prompt message, and the content of the third prompt message may be "Multiple fingers detected, please use a single finger to enter."

[0195] In an embodiment of the present application, when the electronic device determines that the preview image in the preview interface of the electronic device satisfies the above-mentioned preset conditions (i.e., at least one of conditions 1, 2, or 3), the electronic device collects multiple images of the finger to be recorded at different angles through the camera of the electronic device. Specifically, the user interacts with the electronic device to collect fingerprint images of the finger to be recorded from multiple perspectives (i.e., multiple different angles). After the electronic device collects a fingerprint image, the electronic device may prompt the user to adjust the angle of the finger or adjust the shooting angle of the electronic device to complete the collection of fingerprint images at multiple different angles.

[0196] It should be noted that the embodiment of the present application does not limit the number and angles of images of the finger to be recorded, and the specific number can be determined according to actual needs. For example, 5 images corresponding to 5 angles can be collected.

[0197] For example, taking mobile phone 200 as an example, refer to Figure 15 , in the process of collecting the image of the finger to be recorded, Figure 15 The posture of the finger 1501 to be recorded in (a) is posture 1 (i.e., the left side of the finger 1501). At this time, the mobile phone 200 collects the image of the posture 1 of the finger 1501 to be recorded. After the collection is completed, the user is prompted to change the angle of the finger. For example, the mobile phone 200 displays a prompt message "Please slowly rotate your finger to the right"; the user slowly rotates the finger to the right according to the prompt message. When the user rotates the finger to the right until the posture of the finger to be recorded is Figure 15 In the figure (b), the mobile phone 200 captures the image of the posture 2 of the finger 1501 to be recorded, and continues to prompt the user to change the angle of the finger. For example, the mobile phone 200 displays a prompt message "Please slowly rotate your finger to the right again"; then the user continues to rotate his finger to the right according to the prompt message. When the user rotates his finger to the right until the posture of the finger to be recorded is Figure 15 In the posture 3 shown in (c) (i.e., the right side of the finger 1501), the mobile phone 200 collects the image of the posture 3 with the recorded finger. At this point, the mobile phone 200 completes the collection of images of different angles of the finger to be recorded, and obtains the images corresponding to the above-mentioned postures 1, 2 and 3 respectively.

[0198] Optionally, in the process of collecting the image of the finger to be recorded, the user can also adjust the shooting angle of the mobile phone 200, for example, prompting the user "Please slowly rotate the mobile phone 200 to the left" to collect the images corresponding to the posture 1, posture 2 and posture 3 of the finger to be recorded.

[0199] It should be noted that the above-mentioned collection of images corresponding to posture 1, posture 2 and posture 3 of the finger to be recorded is only an example. After the mobile phone 200 collects the image of posture 3 of the finger to be recorded 1501, the mobile phone 200 can continue to prompt the user to adjust the finger, so as to continue to collect images corresponding to other postures of the finger to be recorded, and obtain images of the finger to be recorded at multiple different angles.

[0200] Optionally, when the preview image in the preview interface of the electronic device meets a preset condition, before the electronic device collects multiple images of the finger to be recorded at different angles through the camera of the electronic device, the fingerprint verification method provided by the embodiment of the present application may also include: the electronic device determines whether the fingerprint information pre-stored in the electronic device includes three-dimensional fingerprint information of the finger to be recorded; if the fingerprint information pre-stored in the electronic device includes three-dimensional fingerprint information of the finger to be recorded, a fourth prompt message is displayed, and the fourth prompt message is used to prompt the user to change the finger to be recorded.

[0201] In an embodiment of the present application, when the preview image in the preview interface of the electronic device meets the preset conditions, the electronic device collects an image of the finger to be recorded, and performs three-dimensional reconstruction of the finger to be recorded based on the image to obtain the three-dimensional fingerprint information of the finger to be recorded. Then, the three-dimensional fingerprint information of the finger to be recorded is compared with the three-dimensional fingerprint information pre-stored in the electronic device (that is, the three-dimensional fingerprint information of the recorded finger) to determine whether the fingerprint information of the finger to be recorded has been recorded.

[0202] The above method of comparing the three-dimensional fingerprint information of the finger to be recorded with the three-dimensional fingerprint information pre-stored in the electronic device (that is, the three-dimensional fingerprint information of the recorded finger) is similar to the method of comparing the three-dimensional fingerprint information of the finger to be verified with the stored three-dimensional fingerprint information in the above embodiment. Please refer to the description of the above embodiment for details and will not be repeated here.

[0203] Exemplary, reference Figure 16 Still taking the mobile phone 200 as an example, when the fingerprint information pre-stored in the mobile phone 200 includes the three-dimensional fingerprint information of the finger to be recorded, the mobile phone 200 displays a fourth prompt message, and the content of the fourth prompt message may be "The fingerprint of this finger already exists, please use another finger to record."

[0204] S903: The electronic device generates three-dimensional fingerprint information of the finger to be recorded based on multiple images of the finger to be recorded at different angles.

[0205] In an embodiment of the present application, after the front camera / rear camera of the electronic device captures images of the finger to be recorded at multiple different angles, the images of the finger to be recorded at multiple different angles are processed based on a multi-view stereo reconstruction algorithm to obtain a three-dimensional point cloud of the surface of the finger to be recorded, and the multi-view stereo reconstruction of the finger to be recorded is completed. The three-dimensional point cloud of the finger to be recorded and the fingerprint information of the finger to be recorded are then fused into a stereo reconstruction model (i.e., a three-dimensional model of the finger to be recorded) to obtain the three-dimensional fingerprint information of the finger to be recorded, and the three-dimensional fingerprint information of the finger to be recorded is stored in the electronic device. The fingerprint information of the finger to be recorded includes but is not limited to the valley line information, ridge line information, and minutiae information of the fingerprint. It should be understood that the fingerprint information of the finger to be recorded is obtained based on images of the finger to be recorded at different angles.

[0206] In combination with the contents of the above embodiments, the following reference Figure 17 Taking the above preset conditions including condition 1, condition 2 and condition 3 as an example, the overall process of three-dimensional fingerprint entry is briefly described.

[0207] Step 1: In response to the user's fingerprint entry operation, start the camera.

[0208] Step 2: Adjust the camera's shooting mode to macro mode.

[0209] Step 3: Detect whether there is a finger in the preview interface.

[0210] If there is a finger in the preview interface, execute the following step 4; if there is no finger in the preview interface, prompt the user to adjust the finger so that the finger is within the shooting area.

[0211] Step 4: Detect the distance between the camera and the finger.

[0212] If the distance between the camera and the finger is detected to be within 2-15 cm, execute the following step 5; if the distance between the camera and the finger is detected to be outside 2-15 cm, prompt the user to adjust the finger or electronic device so that the distance between the camera and the finger is within 2-15 cm.

[0213] Step 5: Detect the number of fingers in the preview interface.

[0214] If it is detected that there is only one finger in the preview interface, execute the following step 6; if it is detected that there are multiple fingers in the preview interface, prompt the user to adjust so that the preview interface includes only one finger.

[0215] Step 6: Check whether the fingerprint information of the finger to be recorded has been recorded.

[0216] If it is detected that the fingerprint information of the finger to be recorded has not been recorded, execute the following step 7; if it is detected that the fingerprint information of the finger to be recorded has been recorded, prompt the user to change the finger.

[0217] Step 7: Collect multiple images of the finger to be recorded at different angles and generate three-dimensional fingerprint information.

[0218] Compared with the existing fingerprint registration process in which users collect the fingerprint information of the finger to be registered by pressing the fingerprint sensing area of ​​the mobile phone multiple times, in the embodiment of the present application, the electronic device captures images of the finger to be registered at different angles and generates three-dimensional fingerprint information of the finger to be registered based on the images at different angles. The fingerprint registration process has simple operation steps, short fingerprint registration time, and high user experience.

[0219] Accordingly, an embodiment of the present application provides an electronic device for executing each step in the above-mentioned fingerprint verification method. The embodiment of the present application can divide the functional modules of the electronic device according to the above-mentioned method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. The division of modules in the embodiment of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation.

[0220] In the case of dividing each functional module into corresponding functional modules, Figure 18 FIG. 1 shows a possible structural diagram of the electronic device involved in the above embodiment. Figure 18 As shown, the electronic device includes an acquisition module 1801 , a comparison module 1802 , a generation module 1803 , a living body detection module 1804 and a determination module 1805 .

[0221] The acquisition module 1801 is configured to acquire two-dimensional fingerprint information of the finger to be verified in response to a user's pressing operation in the fingerprint sensing area of ​​the electronic device, for example, by executing step S301 in the above method embodiment.

[0222] The comparison module 1802 is used to compare the two-dimensional fingerprint information of the finger to be verified with the three-dimensional fingerprint information pre-stored on the electronic device, for example, executing step S303 in the above method embodiment.

[0223] The generating module 1803 generates deformation information of the finger to be verified based on the two-dimensional fingerprint information of the finger to be verified, for example, by executing step S304 in the above method embodiment.

[0224] The liveness detection module 1804 is configured to perform liveness detection on the finger to be verified based on the deformation information of the finger to be verified, for example, executing step S305 in the above method embodiment.

[0225] The determination module 1805 is used to determine that the finger to be verified has passed the fingerprint verification if the two-dimensional fingerprint information of the finger to be verified is successfully compared with the three-dimensional fingerprint information pre-stored in the electronic device and the liveness detection of the finger to be verified is successful; otherwise, the finger to be verified has not passed the fingerprint verification, for example, executing step S306 in the above method embodiment.

[0226] Optionally, the electronic device provided in the embodiment of the present application also includes a registration module 1806, which is used to align the two-dimensional fingerprint information of the finger to be verified with the pre-stored three-dimensional fingerprint information, and determine the target area corresponding to the two-dimensional fingerprint information in the three-dimensional fingerprint information, for example, executing step S302 in the above method embodiment.

[0227] Optionally, the electronic device provided in the embodiment of the present application further includes a 3D reconstruction module 1807 and a feature extraction module 1808. The 3D reconstruction module 1807 is configured to perform 3D reconstruction on the 2D fingerprint information of the finger to be verified to obtain the 3D fingerprint information of the finger to be verified, for example, by executing step S3021 in the above method embodiment.

[0228] The feature extraction module 1808 is used to extract the first feature of the 3D fingerprint information of the finger to be verified and the first feature of the 3D fingerprint information pre-stored in the electronic device, for example, executing steps S3022 to S3023 in the above method embodiment.

[0229] The above-mentioned registration module 1806 is specifically used to align the first feature of the three-dimensional fingerprint information of the finger to be verified with the first feature of the pre-stored three-dimensional fingerprint information, and determine the target area in the pre-stored three-dimensional fingerprint information corresponding to the two-dimensional fingerprint information of the finger to be verified, for example, executing step S3024 in the above-mentioned method embodiment.

[0230] Optionally, the feature extraction module 1808 is further configured to extract the second feature of the three-dimensional fingerprint information of the finger to be verified and the second feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information, for example, by executing steps S3032 to S3033 in the above method embodiment.

[0231] The above-mentioned comparison module 1802 is specifically used to calculate the similarity between the second feature of the three-dimensional fingerprint information of the finger to be verified and the second feature of the fingerprint information of the target area, and determine whether the comparison between the three-dimensional fingerprint information of the finger to be verified and the three-dimensional fingerprint information pre-stored on the electronic device is successful based on the similarity, for example, executing step S3034 in the above-mentioned method embodiment.

[0232] Optionally, the feature extraction module 1808 is further configured to extract the third feature of the three-dimensional fingerprint information of the finger to be verified and the third feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information, for example, by executing steps S3042 to S3043 in the above method embodiment.

[0233] The above-mentioned generation module 1803 is also used to generate deformation information of the finger to be verified based on the third feature of the three-dimensional fingerprint information of the finger to be verified and the third feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information, for example, executing step S3044 in the above-mentioned method embodiment.

[0234] Optionally, the acquisition module 1801 is further configured to acquire three-dimensional fingerprint information pre-stored on the electronic device.

[0235] Optionally, the above-mentioned acquisition module 1801 is specifically used to start the camera of the electronic device in response to the user's selection operation of the fingerprint entry option on the first interface of the electronic device; and when the preview image in the preview interface of the electronic device meets the preset conditions, collect images of the finger to be entered at multiple different angles through the camera; and generate pre-stored three-dimensional fingerprint information based on the images of the finger to be entered at multiple different angles, for example, executing steps S901 to S903 in the above-mentioned method embodiment.

[0236] Optionally, the electronic device provided in the embodiment of the present application further includes a display module 1809; the above-mentioned determination module 1805 is further used to determine whether the fingerprint information pre-stored in the electronic device includes the three-dimensional fingerprint information of the finger to be recorded.

[0237] The display module 1809 is configured to display first prompt information when the fingerprint information pre-stored in the electronic device includes the three-dimensional fingerprint information of the finger to be recorded. The first prompt information is configured to prompt the user to change the finger to be recorded.

[0238] The various modules of the above electronic device can also be used to perform other actions in the above method embodiment. All relevant contents of the various steps involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0239] In the case of using an integrated unit, the structural diagram of the electronic device provided in the embodiment of the present application is as follows Figure 19 As shown. Figure 19In the embodiment, the electronic device includes: a processing module 1901 and a communication module 1902. The processing module 1901 is used to control and manage the actions of the electronic device, for example, executing the steps performed by the acquisition module 1801, the comparison module 1802, the generation module 1803, the liveness detection module 1804, the determination module 1805, the registration module 1806, the 3D reconstruction module 1807, the feature extraction module 1808 and the display module 1809, and / or other processes for executing the technology described herein. The communication module 1902 is used to support the interaction between the electronic device and other devices. Figure 19 As shown, the electronic device may further include a storage module 1903, which is used to store program codes of the electronic device, recorded three-dimensional fingerprint information, two-dimensional fingerprint information of the finger to be verified, and the like.

[0240] The processing module 1901 may be a processor or a controller, for example Figure 2 The communication module 1902 may be a transceiver, an RF circuit or a communication interface, for example Figure 2 The mobile communication module 250 and / or wireless communication module 260 in the storage module 1903 can be a memory, such as Figure 2 The internal memory 221 in.

[0241] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using a software program, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions in accordance with the embodiments of the present application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (eg, a floppy disk, a magnetic disk, a magnetic tape), an optical medium (eg, a digital video disc (DVD)), or a semiconductor medium (eg, a solid state drive (SSD)).

[0242] Through the description of the above embodiments, those skilled in the art will clearly understand that for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working processes of the above-described systems, devices, and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0243] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0244] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0245] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0246] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk.

[0247] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A fingerprint verification method, characterized in that: Applied to electronic equipment, the method includes: In response to a user pressing a fingerprint sensing area of ​​the electronic device, acquiring two-dimensional fingerprint information of the finger to be verified; Performing three-dimensional reconstruction on the two-dimensional fingerprint information to obtain three-dimensional fingerprint information of the finger to be verified; Extracting a first feature of the three-dimensional fingerprint information of the finger to be verified, and extracting a first feature of the three-dimensional fingerprint information pre-stored on the electronic device; wherein the first feature includes curvature information, depth information, angle information, and edge information of the three-dimensional fingerprint information; registering the first feature of the three-dimensional fingerprint information of the finger to be verified with the first feature of the pre-stored three-dimensional fingerprint information, and determining a target area in the pre-stored three-dimensional fingerprint information corresponding to the two-dimensional fingerprint information of the finger to be verified; Comparing the two-dimensional fingerprint information with the fingerprint information of the target area in the three-dimensional fingerprint information pre-stored on the electronic device; Based on the two-dimensional fingerprint information, generating deformation information of the finger to be verified; wherein the deformation information of the finger to be verified is used to indicate the state of the shape change of the finger to be verified when the user presses the fingerprint sensing area of ​​the electronic device; Performing liveness detection on the finger to be verified based on the deformation information of the finger to be verified; If the two-dimensional fingerprint information is successfully compared with the pre-stored three-dimensional fingerprint information and the liveness detection of the finger to be verified is successful, it is determined that the finger to be verified has passed the fingerprint verification; otherwise, it is determined that the finger to be verified has not passed the fingerprint verification.

2. The method according to claim 1, characterized in that Comparing the two-dimensional fingerprint information with the three-dimensional fingerprint information pre-stored on the electronic device includes: Performing three-dimensional reconstruction on the two-dimensional fingerprint information to obtain three-dimensional fingerprint information of the finger to be verified; Extracting a second feature of the three-dimensional fingerprint information of the finger to be verified, and extracting a second feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information; wherein the second feature includes depth information, angle information, curvature information, edge information, ridge information, and minutiae information; Calculating a similarity between a second feature of the three-dimensional fingerprint information of the finger to be verified and a second feature of the fingerprint information of the target area, and determining whether a comparison between the two-dimensional fingerprint information and the three-dimensional fingerprint information pre-stored on the electronic device is successful based on the similarity; Wherein, if the similarity is greater than or equal to a preset threshold, the comparison between the two-dimensional fingerprint information and the pre-stored three-dimensional fingerprint information is successful; otherwise, the comparison between the two-dimensional fingerprint information and the pre-stored three-dimensional fingerprint information fails.

3. The method according to claim 1 or 2, characterized in that The step of generating the deformation information of the finger to be verified based on the two-dimensional fingerprint information includes: Performing three-dimensional reconstruction on the two-dimensional fingerprint information to obtain three-dimensional fingerprint information of the finger to be verified; Extracting a third feature of the three-dimensional fingerprint information of the finger to be verified, and extracting a third feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information; wherein the third feature includes depth information, angle information, curvature information, edge information, ridge information, and minutiae information; Deformation information of the finger to be verified is generated based on the third feature of the three-dimensional fingerprint information of the finger to be verified and the third feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information.

4. The method according to claim 3, characterized in that Performing liveness detection on the finger to be verified based on the deformation information of the finger to be verified, including: Inputting the deformation information of the finger to be verified into a target liveness detection model, and determining whether the liveness detection of the finger to be verified is successful based on the liveness detection probability output by the target liveness detection model; Wherein, when the liveness detection probability is greater than a preset probability threshold, the liveness detection of the finger to be verified is successful; otherwise, the liveness detection of the finger to be verified fails.

5. The method according to claim 4, characterized in that Before acquiring the two-dimensional fingerprint information of the finger to be verified in response to the user's pressing operation in the fingerprint sensing area of ​​the electronic device, the method further includes: The pre-stored three-dimensional fingerprint information is obtained.

6. The method according to claim 5, characterized in that The obtaining of the pre-stored three-dimensional fingerprint information includes: In response to a user selecting a fingerprint entry option on a first interface of the electronic device, activating a camera of the electronic device; When the preview image in the preview interface of the electronic device meets a preset condition, the camera collects images of the finger to be recorded at multiple different angles; The pre-stored three-dimensional fingerprint information is generated according to the multiple images of the finger to be recorded at different angles.

7. The method according to claim 6, characterized in that The preset conditions include at least one of the following: The preview interface of the electronic device includes the finger to be recorded; The distance between the finger to be recorded and the camera in the preview interface of the electronic device is within a preset distance range; The finger to be entered in the preview interface of the electronic device includes only one finger.

8. The method according to claim 7, characterized in that The preset distance interval is [2, 15] centimeters.

9. The method according to claim 8, characterized in that The method further comprises: Determining whether the fingerprint information pre-stored in the electronic device includes the three-dimensional fingerprint information of the finger to be recorded; If the fingerprint information pre-stored in the electronic device includes the three-dimensional fingerprint information of the finger to be recorded, a prompt message is displayed, where the prompt message is used to prompt the user to change the finger to be recorded.

10. The method according to claim 9, characterized in that The shooting mode of the electronic device is macro mode.

11. An electronic device, characterized in that: It includes acquisition module, comparison module, generation module, living body detection module, determination module, registration module, 3D reconstruction module and feature extraction module; The acquisition module is configured to acquire two-dimensional fingerprint information of the finger to be verified in response to a user pressing the fingerprint sensing area of ​​the electronic device; The three-dimensional reconstruction module is used to perform three-dimensional reconstruction on the two-dimensional fingerprint information to obtain the three-dimensional fingerprint information of the finger to be verified; The feature extraction module is configured to extract a first feature of the three-dimensional fingerprint information of the finger to be verified, and to extract a first feature of the three-dimensional fingerprint information pre-stored on the electronic device; wherein the first feature includes curvature information, depth information, angle information, and edge information of the three-dimensional fingerprint information; The registration module is specifically configured to register the first feature of the three-dimensional fingerprint information of the finger to be verified with the first feature of the pre-stored three-dimensional fingerprint information, and determine the target area corresponding to the two-dimensional fingerprint information in the pre-stored three-dimensional fingerprint information; The comparison module is configured to compare the two-dimensional fingerprint information with the fingerprint information of the target area in the three-dimensional fingerprint information pre-stored on the electronic device; The generating module is configured to generate deformation information of the finger to be verified based on the two-dimensional fingerprint information, wherein the deformation information of the finger to be verified is used to indicate a state of morphological change of the finger to be verified when the user performs a pressing operation on the fingerprint sensing area of ​​the electronic device; The liveness detection module is configured to perform liveness detection on the finger to be verified based on the deformation information of the finger to be verified; The determination module is configured to determine that the finger to be verified has passed fingerprint verification if the two-dimensional fingerprint information is successfully compared with the pre-stored three-dimensional fingerprint information and the liveness detection of the finger to be verified is successful; otherwise, determine that the finger to be verified has failed fingerprint verification.

12. The electronic device according to claim 11, wherein: The three-dimensional reconstruction module is used to perform three-dimensional reconstruction on the two-dimensional fingerprint information to obtain the three-dimensional fingerprint information of the finger to be verified; The feature extraction module is configured to extract a second feature of the three-dimensional fingerprint information of the finger to be verified, and to extract a second feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information; wherein the second feature includes depth information, angle information, curvature information, edge information, ridge information, and minutiae information; The comparison module is specifically configured to calculate a similarity between the second feature of the three-dimensional fingerprint information of the finger to be verified and the second feature of the fingerprint information of the target area, and determine whether the comparison between the two-dimensional fingerprint information and the three-dimensional fingerprint information pre-stored on the electronic device is successful based on the similarity; Wherein, if the similarity is greater than or equal to a preset threshold, the comparison between the two-dimensional fingerprint information and the pre-stored three-dimensional fingerprint information is successful; otherwise, the comparison between the two-dimensional fingerprint information and the pre-stored three-dimensional fingerprint information fails.

13. The electronic device according to claim 12, wherein: The three-dimensional reconstruction module is used to perform three-dimensional reconstruction on the two-dimensional fingerprint information to obtain the three-dimensional fingerprint information of the finger to be verified; The feature extraction module is configured to extract a third feature of the three-dimensional fingerprint information of the finger to be verified, and to extract a third feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information; wherein the third feature includes depth information, angle information, curvature information, edge information, ridge information, and minutiae information; The generating module is further configured to generate deformation information of the finger to be verified based on the third feature of the three-dimensional fingerprint information of the finger to be verified and the third feature of the fingerprint information of the target area in the pre-stored three-dimensional fingerprint information.

14. The electronic device according to claim 13, wherein: a liveness detection module, specifically configured to input the deformation information of the finger to be verified into a target liveness detection model, and determine whether liveness detection of the finger to be verified is successful based on the liveness detection probability output by the target liveness detection model; Wherein, when the liveness detection probability is greater than a preset probability threshold, the liveness detection of the finger to be verified is successful; otherwise, the liveness detection of the finger to be verified fails.

15. The electronic device according to claim 14, characterized in that The acquisition module is further configured to acquire the pre-stored three-dimensional fingerprint information.

16. The electronic device according to claim 15, characterized in that The acquisition module is specifically configured to activate a camera of the electronic device in response to a user selecting a fingerprint entry option on a first interface of the electronic device; and to capture images of the finger to be entered at multiple different angles through the camera when a preview image in a preview interface of the electronic device meets a preset condition; and to generate the pre-stored three-dimensional fingerprint information based on the images of the finger to be entered at multiple different angles.

17. The electronic device according to claim 16, wherein: The preset conditions include at least one of the following: The preview interface of the electronic device includes the finger to be recorded; The distance between the finger to be recorded and the camera in the preview interface of the electronic device is within a preset distance range; The finger to be entered in the preview interface of the electronic device includes only one finger.

18. The electronic device according to claim 17, characterized in that: The preset distance interval is [2, 15] centimeters.

19. The electronic device according to claim 18, wherein: The electronic device further includes a display module; The determining module is further configured to determine whether the fingerprint information pre-stored in the electronic device includes the three-dimensional fingerprint information of the finger to be recorded; The display module is configured to display first prompt information when the fingerprint information pre-stored in the electronic device includes the three-dimensional fingerprint information of the finger to be recorded, wherein the first prompt information is configured to prompt the user to change the finger to be recorded.

20. The electronic device according to claim 19, wherein The shooting mode of the electronic device is macro mode.

21. An electronic device, characterized in that: The electronic device comprises a memory and a processor, wherein the memory is coupled to the processor; the memory is used to store computer program code, and the computer program code includes computer instructions; when the computer instructions are executed by the processor, the electronic device executes the method as described in any one of claims 1 to 10.

22. A chip system, characterized in that: The chip system is applied to an electronic device; the chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through lines; the interface circuit is used to receive a signal from the memory of the electronic device and send the signal to the processor, the signal including computer instructions stored in the memory; when the processor executes the computer instructions, the electronic device executes the method as described in any one of claims 1 to 10.

23. A computer storage medium, characterized in that The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method according to any one of claims 1 to 10.

24. A computer program product, characterized in that When the computer program product is run on a computer, the computer is caused to perform the method according to any one of claims 1 to 10.

Images