Fingerprint Information Processing Method and Apparatus, Terminal, and Storage Medium

By detecting the pressure of finger pressing and selecting the corresponding fingerprint template image comparison, the problem of slow recognition or low accuracy in fingerprint recognition technology due to environmental and operation uncertainty is solved, and the accuracy of fingerprint recognition and unlocking success rate is improved.

CN114821678BActive Publication Date: 2025-07-04BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202110080480.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-01-21
Publication Date
2025-07-04
Estimated Expiration
2041-01-21

AI Technical Summary

Technical Problem

The existing fingerprint recognition technology causes slow recognition or low accuracy due to uncertainty in the environment and operation factors when touching the finger, especially in the dry finger state.

Method used

By detecting the pressure of finger pressing, selecting the corresponding fingerprint template image for comparison, and setting different fingerprint template images with different pressure pressing, improve matching accuracy and efficiency.

Benefits of technology

It improves the accuracy and unlocking success rate of fingerprint recognition, reduces the low recognition rate and error rate caused by the randomness of the pressing method, and improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114821678B_ABST
    Figure CN114821678B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a fingerprint information processing method, apparatus, terminal, and storage medium. The fingerprint information processing method is applied to a terminal and includes: when a first user pressing operation is received, detecting a first pressing force corresponding to the first user pressing operation, and detecting a first fingerprint image generated corresponding to the first user pressing operation; comparing the first fingerprint image with a fingerprint template image corresponding to the first pressing force to obtain a matching result. Through the technical solution of the embodiments of the present disclosure, in the process of fingerprint detection, it is combined with the pressing force, and different fingerprint template images are used for matching according to different pressing forces, which improves the matching accuracy and matching efficiency and enhances the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to electronic technologies, and in particular, to a fingerprint information processing method, apparatus, terminal, and storage medium. Background Art

[0002] With the wide application of fingerprint recognition technology, in various application scenarios of a terminal, identity verification can be performed through fingerprint recognition. On the one hand, it is convenient for users to use, with simple, convenient, and fast operations. On the other hand, compared with verification methods such as passwords, the cracking difficulty is increased, thereby improving the security performance of identity verification. However, since the fingerprint recognition process requires rapid and accurate scanning and verification of finger fingerprints, and the uncertainty caused by various factors such as the environment and operations during finger touch often leads to problems such as slow fingerprint recognition or low fingerprint recognition accuracy. Summary of the Invention

[0003] The present disclosure provides a fingerprint information processing method, apparatus, terminal, and storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided a fingerprint information processing method applied to a terminal, including:

[0005] When receiving a first user pressing operation, detecting a first pressing force corresponding to the first user pressing operation, and detecting a first fingerprint image generated corresponding to the first user pressing operation;

[0006] Comparing the first fingerprint image with a fingerprint template image corresponding to the first pressing force to obtain a matching result.

[0007] In some embodiments, the method further includes:

[0008] Determining the fingerprint template image according to a predetermined force range to which the first pressing force belongs; where the predetermined force range includes at least two; fingerprint template images corresponding to different predetermined force ranges are different.

[0009] In some embodiments, the method further includes:

[0010] Responding to the matching result being a first matching result that meets the verification condition, and outputting a matching success message; or

[0011] Responding to the matching result being a second matching result that does not meet the verification condition, switching to a fingerprint template image that has not been compared; comparing the first fingerprint image with the switched fingerprint template image to obtain a re-matching result;

[0012] Wherein, the verification condition includes: the similarity obtained by comparing the first fingerprint image with the fingerprint template image is greater than or equal to a first similarity threshold.

[0013] In some embodiments, the method further includes:

[0014] In response to the re - matching result being the first matching result that meets the verification condition, outputting a matching success message; or

[0015] In response to the re - matching result being the second matching result that does not meet the verification condition and the number of comparison times being greater than or equal to a predetermined number of times, outputting a matching failure message.

[0016] In some embodiments, the method further includes:

[0017] In the case of receiving a second user's pressing operation, detecting a second pressing force corresponding to the second user's pressing operation, and detecting a second fingerprint image generated corresponding to the second user's pressing operation;

[0018] Determining that the second fingerprint image is a fingerprint template image corresponding to the second pressing force.

[0019] In some embodiments, the determining that the second fingerprint image is a fingerprint template image corresponding to the second pressing force includes:

[0020] Determining a predetermined force range to which the second pressing force belongs;

[0021] Determining that the second fingerprint image is a fingerprint template image corresponding to the predetermined force range to which the second pressing force belongs.

[0022] According to a second aspect of the embodiments of the present disclosure, there is provided a fingerprint information processing device, which is applied to a terminal and includes:

[0023] A first detection module, configured to detect a first pressing force corresponding to the first user's pressing operation when receiving the first user's pressing operation, and

[0024] A second detection module, configured to detect a first fingerprint image generated corresponding to the first user's pressing operation;

[0025] A first comparison module, configured to compare the first fingerprint image with a fingerprint template image corresponding to the first pressing force to obtain a matching result.

[0026] In some embodiments, the device further includes:

[0027] A first determination module, configured to determine the fingerprint template image according to a predetermined force range to which the first pressing force belongs; wherein, the predetermined force range includes at least two; fingerprint template images corresponding to different predetermined force ranges are different.

[0028] In some embodiments, the device further includes:

[0029] A first output module, configured to output a matching success message in response to the matching result being a first matching result that satisfies a first verification condition; or

[0030] A switching module, configured to, in response to the matching result being a second matching result that does not satisfy the first verification condition, switch to a fingerprint template image that has not been compared; compare the first fingerprint image with the switched fingerprint template image to obtain a re-matching result;

[0031] Wherein, the first verification condition includes: the similarity obtained by comparing the first fingerprint image with the fingerprint template image is greater than or equal to a first similarity threshold.

[0032] In some embodiments, the apparatus further includes:

[0033] A second output module, configured to output a matching success message in response to the re-matching result being a third matching result that satisfies a second verification condition; wherein, the second verification condition includes: the similarity obtained by comparing the first fingerprint image with the fingerprint template image is greater than or equal to a second similarity threshold; or

[0034] A third output module, configured to output a matching failure message in response to the re-matching result being a fourth matching result that does not satisfy the second verification condition and the number of comparison times is greater than or equal to a predetermined number of times.

[0035] In some embodiments, the apparatus further includes:

[0036] A third detection module, configured to detect a second pressing force corresponding to the second user's pressing operation when receiving the second user's pressing operation, and

[0037] A fourth detection module, configured to detect a second fingerprint image generated corresponding to the second user's pressing operation;

[0038] A second determination module, configured to determine that the second fingerprint image is a fingerprint template image corresponding to the second pressing force.

[0039] In some embodiments, the second determination module includes:

[0040] A first determination sub-module, configured to determine a predetermined force range to which the second pressing force belongs;

[0041] A second determination sub-module, configured to determine that the second fingerprint image is a fingerprint template image of the predetermined force range to which the second pressing force belongs.

[0042] According to a fourth aspect of the embodiments of the present disclosure, there is provided a terminal, which at least includes: a processor and a memory for storing executable instructions that can run on the processor, wherein:

[0043] When the processor is used to run the executable instructions, the executable instructions execute the steps in the fingerprint information processing method provided in any one of the above.

[0044] According to a fifth aspect of the embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, in which computer-executable instructions are stored, and when the computer-executable instructions are executed by a processor, the steps in the fingerprint information processing method provided in any one of the above are implemented.

[0045] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects: During the fingerprint detection process, corresponding fingerprint templates are used for fingerprint image comparison according to the detection of the finger pressing force, which improves the accuracy of the comparison, reduces problems such as low recognition rate and high error rate caused by the randomness of the finger pressing method during the pressing process, and thus improves the user experience.

[0046] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] The drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present invention, and are used together with the specification to explain the principles of the present invention.

[0048] Figure 1 is a flowchart of a fingerprint information processing method shown according to an exemplary embodiment Figure 1 ;

[0049] Figure 2 is a flowchart of a fingerprint information processing method shown according to an exemplary embodiment Figure 2 ;

[0050] Figure 3 is a flowchart of a fingerprint information processing method shown according to an exemplary embodiment Figure 3 ;

[0051] Figure 4 is a flowchart of a fingerprint information processing method shown according to an exemplary embodiment Figure 4 ;

[0052] Figure 5 is a structural block diagram of a display screen shown according to an exemplary embodiment;

[0053] Figure 6It is a structural block diagram of a fingerprint information processing device shown according to an exemplary embodiment;

[0054] Figure 7 It is an entity structural block diagram of a terminal shown according to an exemplary embodiment. Detailed implementation manners

[0055] Here, the exemplary embodiments will be described in detail, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present invention. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0056] Fingerprint recognition is widely applied to the verification scenarios of various devices. The accuracy of fingerprint recognition mainly depends on the fingerprint recognition feature algorithm or the detection accuracy of the sensor. However, due to individual differences and the influence of environmental conditions, etc., the improvement of accuracy has great limitations.

[0057] When a finger presses on the touch screen, when the pressing force is large, the area of the fingerprint ridges in contact with the surface of the display screen is large; when the pressing force is small, the area of the fingerprint ridges in contact with the surface of the display screen is small. That is to say, different finger pressing forces will result in a large gap in the proportion of fingerprint ridges and valleys in the collected fingerprint image. Therefore, only using the fingerprint detection method will be affected by the changes in conditions such as the pressing force, thus affecting the detection accuracy.

[0058] In the related art, the unlocking rate of dry fingers is generally low. In this regard, the applicant found that in the state of dry fingers, the ridges are not in close contact with the screen glass (fingerprint image acquisition surface), there are gaps, some ridges become valleys, and the image contrast between the ridges and valleys becomes low. If the normal humidity fingerprint template is used, the dry finger image quality cannot reach the target value and the matching will fail. The applicant found through research that due to the non-close contact between the finger and the screen glass under low pressing force, the collected image is somewhat similar to the dry finger image. Therefore, setting different fingerprint matching templates according to different pressures and calling the unlocking template according to the user's real-time fingerprint quality can improve the fingerprint unlocking rate compared with a single fixed matching threshold.

[0059] Figure 1 It is a flowchart of a fingerprint information processing method shown according to an exemplary embodiment. This method is applied to a terminal, such as Figure 1 shown, and includes:

[0060] Step S101: When receiving a pressing operation of a first user, detect a first pressing force corresponding to the pressing operation of the first user, and detect a first fingerprint image generated correspondingly under the pressing operation of the first user.

[0061] Step S102: Compare the first fingerprint image with a fingerprint template image corresponding to the first pressing force to obtain a matching result.

[0062] In the embodiments of the present disclosure, the terminal can be any device with a fingerprint detection function, such as a mobile phone, a tablet computer, a laptop computer, a vehicle-mounted device, a smart wearable device, and various smart home devices, etc.

[0063] In the embodiments of the present disclosure, the situation of receiving a pressing operation of a first user can be a user pressing operation during fingerprint detection, and can include the first user pressing operations detected in various scenarios such as unlocking, verification, and authentication. For example, when the terminal is in a locked screen state, if the display screen is triggered to light up, the display screen is still in the locked screen state. At this time, the fingerprint detection scenario can be entered to detect the pressing operation of the first user for fingerprint verification, and then the screen can be unlocked. Another example is in the scenario of logging in to an application. If the application triggers fingerprint detection for logging in, the fingerprint detection scenario is entered to detect the pressing operation of the first user, and then the user of the application can be logged in according to the result of the fingerprint detection. Another example is in the scenario of payment or transaction. Authorization needs to be performed through fingerprint detection. Therefore, the fingerprint detection scenario can be entered to detect the pressing operation of the first user, and then the payment or transaction can be completed according to the result of the fingerprint detection, and so on.

[0064] In the embodiments of the present disclosure, in the above fingerprint detection scenario for detecting the pressing operation of the first user, on the one hand, fingerprint detection needs to be performed, and on the other hand, pressing force detection also needs to be performed. That is, the finger pressing operation is detected from two dimensions. Based on the first pressing force, a corresponding fingerprint template image is selected, and then the first fingerprint image is compared based on this fingerprint template image.

[0065] Here, the first pressing force refers to the pressing force of the finger within the fingerprint detection area during the fingerprint detection process. That is to say, if there are multiple fingers pressing the screen at this time, only the pressing force of the finger within the fingerprint detection area can be detected, and the pressing forces at other positions are not considered.

[0066] It should be noted that the above steps of detecting the first pressing force and detecting the first fingerprint image do not have a time sequence, and can be performed simultaneously; or the first pressing force can be detected first, and then the first fingerprint image can be detected; or the first fingerprint image can be detected first, and then the first pressing force can be detected, as long as the time for detecting the force and the time for detecting the fingerprint are within the same time range interval (indicating that the data detected is generated by the same finger pressing operation), for example, within 1 s (second), within 5 s, etc.

[0067] In the embodiments of the present disclosure, different pressing forces correspond to different fingerprint template images. For example, when the pressing force is within a relatively light range, the proportion of the ridges of the fingerprint in the corresponding fingerprint template image is less than the proportion of the valleys of the fingerprint; while when the pressing force is within a relatively heavy range, the proportion of the ridges of the fingerprint in the corresponding fingerprint template image may be greater than the proportion of the valleys of the fingerprint. Also, for example, when the pressing force is within a relatively light range, the area occupied by the fingerprint in the corresponding fingerprint template image is smaller; while when the pressing force is within a relatively heavy range, the area occupied by the fingerprint in the corresponding fingerprint template image is larger.

[0068] In this way, different pressing forces may correspond to different fingerprint template images. During the fingerprint detection process, the corresponding fingerprint template image is used for fingerprint image comparison according to the detected pressing force of the finger, which improves the accuracy of the comparison and reduces problems such as low recognition rate and high error rate caused by the randomness of the finger pressing method during the pressing process, thereby enhancing the user experience.

[0069] In some embodiments, the method further includes:

[0070] Determine the fingerprint template image according to the predetermined force range to which the first pressing force belongs; wherein, the predetermined force range includes at least two; and the fingerprint template images corresponding to different predetermined force ranges are different.

[0071] In the embodiments of the present disclosure, different predetermined force ranges may correspond to different fingerprint template images. For example, the force range that can be detected by the sensor for force detection is divided into n ranges, and each range corresponds to a fingerprint template image. Also, for example, during the generation of the fingerprint template image, n adjacent force ranges are divided with the image of n fingerprint entries and their corresponding force values as the mid-values.

[0072] In the scenario of fingerprint detection for detecting the pressing operation of the first user, according to the detected first pressing force, determine the predetermined force range to which it belongs, and find the corresponding fingerprint template image, so as to perform the comparison of the first fingerprint image.

[0073] In this way, during the fingerprint comparison process, the fingerprint template image used is more in line with the actual pressing finger situation of the current fingerprint detection, so as to achieve a more accurate detection result.

[0074] In some embodiments, as Figure 2 shown, the method further includes:

[0075] Step S201, in response to the first matching result that the matching result satisfies the first verification condition, output a matching success message; or

[0076] Step S202: In response to the second matching result that the matching result does not meet the first verification condition, switch to a fingerprint template image that has not been compared.

[0077] Step S203: Compare the first fingerprint image with the switched fingerprint template image to obtain a re-matching result.

[0078] Wherein, the first verification condition includes: the similarity obtained by comparing the first fingerprint image with the fingerprint template image is greater than or equal to the first similarity threshold.

[0079] In the embodiment of the present disclosure, a first verification condition can be set for fingerprint detection to determine whether the first fingerprint image matches the fingerprint template image. Here, it can be determined whether they match by the similarity between the first fingerprint image and the fingerprint template image. If the first verification condition is met, it means they match, that is, the matching result is the first matching result that meets the first verification condition. At this time, a matching success message can be output, and subsequent operations can be performed.

[0080] Here, outputting the matching success message can include sending the matching success message to the server, so that the server can determine that the identity verification or authentication result is a result that allows the next operation, and then provide corresponding services, or determine to conduct transactions, payments, etc. Outputting the matching success message can also include outputting a verification success notification message to the output components of the terminal, such as a display screen, a speaker, and earphones, so that the user can determine that the current fingerprint has passed the verification. In addition, operations such as unlocking can be further performed.

[0081] It can be understood that if the matching result does not meet the first verification condition, there are two possibilities. One is that the current fingerprint is a fingerprint that has not been entered, that is, an illegal fingerprint; the other is that the current fingerprint pressing gesture and the moisture level of the finger are quite different from those when the fingerprint was entered, so the similarity is lower than the first similarity threshold. If it is the second case, if the verification failure result is directly output, it will cause the user to need to press repeatedly, verify multiple times, and always have a low recognition rate, reducing the usage experience. For example, when the finger is relatively dry, even if the pressing force is large, it may be difficult to fully contact the fingerprint detection area, resulting in the first fingerprint image collected being closer to the fingerprint template image corresponding to a smaller pressing force.

[0082] Therefore, in the embodiments of the present disclosure, if the matching result does not meet the first verification condition, the fingerprint template image for comparison is switched, and the first fingerprint image that has been collected is compared with the switched fingerprint template image again. That is to say, the fingerprint template image used for the first comparison is the fingerprint template image corresponding to the first pressing force detected currently. If the first verification condition is still not met, the fingerprint template image corresponding to other ranges of pressing force is replaced.

[0083] In one embodiment, the fingerprint template image can be first replaced with the next fingerprint template image whose pressing force is less than the current pressing force range, and the comparison is carried out again. The principle of replacing the fingerprint template image can include: replacing it with a fingerprint template image that has not been compared during the current fingerprint detection process, so as to reduce repeated comparisons and improve the detection efficiency. Of course, if all fingerprint template images have been switched and compared, the switching can be stopped and the comparison can be stopped from continuing.

[0084] In this way, on the one hand, the most similar fingerprint template image is selected for comparison in combination with the pressing force, which improves the success rate of the first comparison. On the other hand, considering the uncertainty of the finger during actual detection, further comparison is carried out when the first comparison does not meet the first verification condition, thereby greatly improving the success rate of fingerprint detection, improving the detection accuracy while realizing a faster comparison, and improving the robustness of the fingerprint detection algorithm as a whole.

[0085] In some embodiments, as Figure 2 shown, the method further includes:

[0086] Step S204, in response to the third matching result that the re-matching result meets the second verification condition, output a matching success message; wherein, the second verification condition includes: the similarity obtained by comparing the first fingerprint image with the fingerprint template image is greater than or equal to the second similarity threshold; or

[0087] Step S205, in response to the fourth matching result that the re-matching result does not meet the second verification condition and the number of comparisons is greater than or equal to the predetermined number, output a matching failure message.

[0088] Here, the second verification condition may be the same as or different from the first verification condition. That is, the first similarity threshold corresponding to the first verification condition and the second similarity threshold corresponding to the second verification condition may be the same or different. For example, the first similarity threshold is greater than the second similarity threshold. In this way, when comparing for the first time, the fingerprint template image corresponding to the first pressing force is compared with the first fingerprint image, and it is less than the first similarity threshold, resulting in not meeting the first verification condition. At this time, switch to the fingerprint template image corresponding to another pressing force and perform another comparison. At this time, considering that there may be a large difference in the finger posture during the actual acquisition of the first fingerprint image and the fingerprint template image during input, a lower second similarity threshold can be used for the second comparison.

[0089] Of course, the above-mentioned first verification condition and its corresponding first similarity threshold, second verification condition and its corresponding second similarity threshold can all be adjusted according to the requirements of different scenarios, applications, terminal types or user settings, etc. Their size relationships and ranges are not limited here, and are not limited to the case where the first similarity threshold is greater than the second similarity threshold as described above.

[0090] In the embodiment of the present disclosure, during the process of re-comparing after switching the fingerprint template image, there may still be different results of meeting the verification condition and not meeting the verification condition. If the re-detection result meets the verification condition, it means that the detected first fingerprint image belongs to a legal fingerprint image. Therefore, a matching success message can be output to perform subsequent operations, and at the same time, stop continuing the comparison.

[0091] If the result of the second comparison is a third matching result that does not meet the second verification condition, there are still two possibilities. First: The first fingerprint image is indeed an illegal fingerprint; Second: The first fingerprint image belongs to a legal fingerprint, but due to the still existing differences in posture and humidity between the currently used fingerprint template image and the first fingerprint image during acquisition, the similarity for comparison is low. Therefore, at this time, the fingerprint template image can be switched again and another comparison can be performed.

[0092] It should be noted that in the embodiment of the present disclosure, the fingerprint template image can be switched multiple times for comparison, but this does not mean that the comparison will stop until any verification condition is met, because the first fingerprint image may not be a legal fingerprint image itself and cannot meet the verification condition no matter how it is compared. Therefore, conditions for stopping continuing the comparison need to be set here.

[0093] In some embodiments, the predetermined number of times may be less than or equal to the total number of fingerprint template images.

[0094] In the embodiments of the present disclosure, when switching fingerprint template images for re-comparison, the fingerprint template images that have not been compared are used. Therefore, if all the existing fingerprint template images have been compared, that is, the number of comparison times has reached the above-mentioned predetermined number, there are no fingerprint template images that can continue to be compared. At this time, the continuous comparison can be stopped.

[0095] If there are many existing fingerprint template images and the comparison is not stopped until all are compared, the comparison duration will be greatly reduced, resulting in the fingerprint detection result not being obtained for a long time. In addition, considering that during a fingerprint detection process, if no matching result that meets the verification conditions can be obtained after comparing 2 to 3 different fingerprint template images, it is highly likely that the first fingerprint image itself is an illegal image. Therefore, the number of times of switching fingerprint template images for repeated comparison can be set, such as 2 to 3 times, etc.

[0096] Of course, the above-mentioned number of times of switching fingerprint template images for repeated comparison needs to be less than or equal to the total number of fingerprint template images, because setting more times does not have fingerprint template images that can be compared, and in essence, the maximum number of comparison times is only the total number of fingerprint template images.

[0097] Therefore, when the number of comparison times is greater than or equal to the predetermined number, that is, the above-mentioned number of times of switching fingerprint template images for repeated comparison, it is determined that the first fingerprint image is an illegal image, and thus a matching failure message is output.

[0098] In some embodiments, as Figure 3 shown, the method further includes the following fingerprint entry process:

[0099] Step S301: When receiving the pressing operation of the second user, detect the second pressing force corresponding to the pressing operation of the second user, and detect the second fingerprint image generated corresponding to the pressing operation of the second user;

[0100] Step S302: Determine that the second fingerprint image is the fingerprint template image corresponding to the second pressing force.

[0101] Here, the pressing operation of the second user is the user pressing operation detected in the specified fingerprint template entry scenario. The terminal obtains the fingerprint template image in the embodiments of the present disclosure by detecting the pressing operation of the second user. For example, enter the fingerprint template entry scenario through setting options such as settings, security, and login password, and then guide the user to perform a pressing operation through a prompt message, and detect the second pressing force while detecting the pressing operation of the second user. And after detecting the second pressing force and the second fingerprint image, the two can be associated, that is, the second fingerprint image is the fingerprint template image corresponding to the second pressing force.

[0102] Therefore, when performing the first user pressing operation in subsequent fingerprint detection scenarios, if a first pressing force matching the second pressing force is detected, the second fingerprint image can be used as the fingerprint template image and compared with the detected first fingerprint image.

[0103] Here, the second pressing force can represent a pressing force value or a pressing force range. Therefore, in the above fingerprint detection scenario, if a first pressing force equal to or within the range of the second pressing force is detected, the corresponding second fingerprint image can be determined as the fingerprint template image.

[0104] In the embodiments of the present disclosure, in the scenario of fingerprint template entry for detecting the second user pressing operation, fingerprints of the same finger can be entered multiple times, and different second pressing forces detected during multiple entries are respectively corresponding to different second fingerprint images, thereby forming a dataset in which fingerprint template images correspond to pressing forces.

[0105] During the collection process, the terminal can output text through the display screen or remind the user to press multiple times with different forces, gestures, pressing angles, etc. by inputting audio, etc., so as to collect multiple sets of data of pressing forces and fingerprint images.

[0106] In some embodiments, determining the second fingerprint image as the fingerprint template image corresponding to the second pressing force includes:

[0107] Determining the predetermined force range to which the second pressing force belongs;

[0108] Determining the second fingerprint image as the fingerprint template image corresponding to the predetermined force range to which the second pressing force belongs.

[0109] In the embodiments of the present disclosure, during the process of collecting fingerprint template images, different predetermined force ranges can be pre-divided, and the range to which the second pressing force is detected is associated with its fingerprint template image. For example, the force range that can be detected by the force detection sensor is divided into n ranges, and by prompting the user to press multiple times with different forces, finally, one fingerprint template image is collected for each range.

[0110] It is also possible to divide multiple force ranges by using the second pressing force obtained separately during multiple acquisition processes as the intermediate value. For example, within the range between the force value of the i-th press and the force value of the (i + 1)-th press, the boundary value of a force range is determined, and within the range between the force value of the (i - 1)-th press and the force value of the i-th press, the boundary of another force range is determined. The range between the above two boundary values is used as a predetermined force range. Then, the force value of the i-th press belongs to the force range where the above two boundary values are located, and the second fingerprint image collected during the i-th press is used as the fingerprint template image corresponding to this force range.

[0111] In this way, in the fingerprint template entry scenario, different fingerprint template images corresponding to different predetermined force ranges can be obtained, which is convenient for accurate matching during detection.

[0112] The embodiments of the present disclosure also provide the following examples:

[0113] The embodiments of the present disclosure provide a solution for improving the success rate of optical fingerprint detection by using a pressure sensor, which is mainly supported by two parts: hardware and software. Compared with the structural design of fingerprint detection in the related art, a pressure sensor is added. When entering the template, fingerprint images of the user under different pressing pressures are collected and set as different fingerprint template images. When unlocking and matching, according to the quality of the user's finger image, the appropriate fingerprint template image is called, thereby improving the success rate of fingerprint unlocking under different pressing forces or different finger moisture levels.

[0114] Considering that the success rate of unlocking is low when the finger is dry, the reason is as follows: When the finger is in a dry state, the ridges of the fingerprint are not in close contact with the screen glass (the fingerprint image acquisition surface), there are relatively large gaps, some ridges become valleys, and the image contrast between the ridges and valleys becomes lower. If a normal humidity fingerprint template is used, the image quality of the dry finger cannot reach the target value and the matching will fail.

[0115] Under low pressing force, due to the non-close contact between the finger and the screen glass, the collected fingerprint image is somewhat similar to the fingerprint image collected when the finger is dry. Therefore, different fingerprint template images are set according to different pressures. By calling the fingerprint template image according to the user's real-time fingerprint quality (including pressing force and matching degree), the fingerprint unlocking rate can be effectively improved compared with a single fixed fingerprint template image and matching threshold.

[0116] During fingerprint entry, multiple fingerprint templates of each finger are entered under different pressing forces; when fingerprint unlocking is performed, as Figure 4 shown, when a user's pressing operation is received, the received fingerprint is compared with the multiple fingerprint templates entered above. In this way, even when the user's finger is a dry finger, because the dry finger is very close to the fingerprint when the user presses lightly, the accuracy of unlocking the dry finger can be improved.

[0117] Hardware design of the embodiments of the present disclosure: A pressure sensor is added under the existing fingerprint sensor (the pressure sensing can use types such as MEMS, capacitance, or any other available material with higher sensitivity). The pressure is detected through the pressure sensing, and fingerprints are collected under different pressure states. Different fingerprint templates are set in the chip during matching, and the template matching is selected according to the fingerprint state of the user for unlocking.

[0118] Figure 5 It is a schematic structural diagram of a display screen shown according to an exemplary embodiment. The display screen 500 is applied to a terminal, such as Figure 5 as shown, and includes:

[0119] A display component 510; the display component includes: a touch sensing unit 511;

[0120] A fingerprint detection component 520, located on the back of the display surface of the display component, for performing fingerprint detection;

[0121] A pressure sensing component 530, located adjacent to the fingerprint detection component on the back of the display surface of the display component, for detecting the pressing force when the fingerprint detection component performs fingerprint detection.

[0122] Here, the display component can be an LCD (Liquid Crystal Display), or an OLED (Organic Light-Emitting Diode) display screen, etc. The touch sensing unit is a touch sensing circuit covering the surface of the display component or embedded inside the display component. For example, an On-cell touch panel, an In-cell capacitive touch detection circuit, etc. When the user's finger touches or presses the surface of the display component, the touch sensing unit can detect the position where the finger touches or presses, and then implement the corresponding control operation.

[0123] In the embodiments of the present disclosure, the display screen adopts an in-screen fingerprint recognition technology, and the fingerprint recognition component is arranged on the back of the display surface of the display component. The display surface is the side where the display component outputs the display screen, and it is also the contact surface for finger touch.

[0124] The fingerprint detection component can be an optical detection component, which realizes the acquisition of the fingerprint image by detecting the reflected light of the finger when the finger touches the display surface. It can also be a capacitive detection component, which obtains the fingerprint image according to the change of capacitance when the finger touches the display surface. It can also be an ultrasonic detection component, which obtains the fingerprint image by reflecting ultrasonic waves when the finger touches the display surface.

[0125] In the embodiments of the present disclosure, a pressure sensing component is further disposed at an adjacent position of the fingerprint detection component. For example, the pressure sensing component is located around the fingerprint detection component or at an adjacent position on one side. If the fingerprint detection component is composed of multiple detection units, the pressure sensing component may also have multiple pressure detection units and can be alternately arranged with the multiple detection units, so as to achieve accurate pressure detection during the fingerprint detection process.

[0126] It should be noted that in the embodiments of the present disclosure, the pressure sensing component is at least used for pressure detection during the fingerprint detection process, but the embodiments of the present disclosure are not limited to the pressure sensing component being able to perform pressure detection alone in other scenarios. For example, during a touch operation, pressure detection of a touch gesture is performed, such as, for example, a 3D touch function.

[0127] Through the display screen provided in the embodiments of the present disclosure, the fingerprint information processing method provided in any of the above embodiments can be performed.

[0128] Figure 6 is a schematic structural diagram of a fingerprint information processing device 600 shown according to an exemplary embodiment. The device is applied to a terminal, such as Figure 6 as shown, and includes:

[0129] A first detection module 601, configured to detect a first pressing force corresponding to the first user's pressing operation when receiving the first user's pressing operation, and

[0130] A second detection module 602, configured to detect a first fingerprint image generated corresponding to the first user's pressing operation;

[0131] A first comparison module 603, configured to compare the first fingerprint image with a fingerprint template image corresponding to the first pressing force to obtain a matching result.

[0132] In some embodiments, the device further includes:

[0133] A first determination module, configured to determine the fingerprint template image according to a predetermined force range to which the first pressing force belongs; wherein, the predetermined force range includes at least two; the fingerprint template images corresponding to different predetermined force ranges are different.

[0134] In some embodiments, the device further includes:

[0135] A first output module, configured to output a matching success message in response to the matching result being a first matching result that satisfies a first verification condition; or

[0136] A switching module, configured to switch to a fingerprint template image that has not been compared in response to a second matching result indicating that the matching result does not satisfy the first verification condition; compare the first fingerprint image with the switched fingerprint template image to obtain a re-matching result;

[0137] Wherein, the first verification condition includes: the similarity obtained by comparing the first fingerprint image with the fingerprint template image is greater than or equal to a first similarity threshold.

[0138] In some embodiments, the apparatus further includes:

[0139] A second output module, configured to output a matching success message in response to a third matching result indicating that the re-matching result satisfies the second verification condition; wherein, the second verification condition includes: the similarity obtained by comparing the first fingerprint image with the fingerprint template image is greater than or equal to a second similarity threshold; or

[0140] A third output module, configured to output a matching failure message in response to a fourth matching result indicating that the re-matching result does not satisfy the second verification condition and the number of comparison times is greater than or equal to a predetermined number of times.

[0141] In some embodiments, the apparatus further includes:

[0142] A third detection module, configured to detect a second pressing force corresponding to the second user's pressing operation when receiving the second user's pressing operation, and

[0143] A fourth detection module, configured to detect a second fingerprint image generated corresponding to the second user's pressing operation;

[0144] A second determination module, configured to determine that the second fingerprint image is a fingerprint template image corresponding to the second pressing force.

[0145] In some embodiments, the second determination module includes:

[0146] A first determination sub-module, configured to determine a predetermined force range to which the second pressing force belongs;

[0147] A second determination sub-module, configured to determine that the second fingerprint image is a fingerprint template image corresponding to the predetermined force range to which the second pressing force belongs.

[0148] Regarding the apparatus in the above embodiments, the specific manners in which each module performs operations have been described in detail in the embodiments related to the method, and will not be elaborated herein.

[0149] Figure 7It is a block diagram of a terminal 700 shown according to an exemplary embodiment. For example, the terminal 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0150] Referring to Figure 7 , the terminal 700 may include one or more of the following components: a processing component 701, a memory 702, a power component 703, a multimedia component 704, an audio component 705, an input / output (I / O) interface 706, a sensor component 707, and a communication component 708.

[0151] The processing component 701 generally controls the overall operation of the terminal 700, such as operations associated with display, telephone calls, data communication, camera operations, and recording operations. The processing component 701 may include one or more processors 710 to execute instructions to complete all or part of the steps of the above methods. In addition, the processing component 701 may further include one or more modules to facilitate the interaction between the processing component 701 and other components. For example, the processing component 701 may include a multimedia module to facilitate the interaction between the multimedia component 704 and the processing component 701.

[0152] The memory 710 is configured to store various types of data to support the operation of the terminal 700. Examples of such data include instructions for any application or method operating on the terminal 700, contact data, phone book data, messages, pictures, videos, etc. The memory 702 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0153] The power component 703 provides power to various components of the terminal 700. The power component 703 may include: a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the terminal 700.

[0154] The multimedia component 704 includes a screen that provides an output interface between the terminal 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of the touch or swipe actions, but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 704 includes a front camera and / or a rear camera. When the terminal 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and / or rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0155] The audio component 705 is configured to output and / or input audio signals. For example, the audio component 705 includes a microphone (MIC) that is configured to receive external audio signals when the terminal 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be stored in the memory 710 or transmitted via the communication component 708. In some embodiments, the audio component 705 further includes a speaker for outputting audio signals.

[0156] The I / O interface 706 provides an interface between the processing component 701 and a peripheral interface module, and the peripheral interface module can be a keyboard, a click wheel, buttons, etc. These buttons can include, but are not limited to: a home button, a volume button, a power button, and a lock button.

[0157] The sensor component 707 includes one or more sensors for providing status assessments of various aspects of the terminal 700. For example, the sensor component 707 can detect the on / off state of the terminal 700, the relative positioning of components, such as the display and keypad of the terminal 700. The sensor component 707 can also detect a change in the position of the terminal 700 or a component of the terminal 700, the presence or absence of user contact with the terminal 700, the orientation or acceleration / deceleration of the terminal 700, and the temperature change of the terminal 700. The sensor component 707 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 707 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 707 can further include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0158] The communication component 708 is configured to facilitate communication between the terminal 700 and other devices in a wired or wireless manner. The terminal 700 can access a wireless network based on communication standards, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 708 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 708 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, or other technologies.

[0159] In an exemplary embodiment, the terminal 700 can be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above method.

[0160] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 702 including instructions, and the above instructions can be executed by a processor 710 of the terminal 700 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0161] An embodiment of the present disclosure also provides a non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by a processor of a mobile terminal, enabling the mobile terminal to execute the method provided in any of the above embodiments.

[0162] Those skilled in the art will readily conceive of other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present invention, which follow the general principles of the present invention and include common general knowledge or conventional technical means in the technical field not disclosed in this disclosure. The specification and embodiments are only to be considered as exemplary, and the true scope and spirit of the present invention are pointed out by the following claims.

[0163] It should be understood that the present invention is not limited to the exact structures already described and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present invention is only limited by the appended claims.

Claims

1. A fingerprint information processing method, characterized in that, Applied to a terminal, including: When receiving a first user's pressing operation, detecting a first pressing force corresponding to the first user's pressing operation, and detecting a first fingerprint image generated correspondingly under the first user's pressing operation; According to a predetermined force range to which the first pressing force belongs, determining a fingerprint template image corresponding to the predetermined force range; wherein, the predetermined force range includes at least two; fingerprint template images corresponding to different predetermined force ranges are different; Comparing the first fingerprint image with the fingerprint template image corresponding to the first pressing force to obtain a matching result; In response to the matching result not satisfying a first verification condition, switching to a fingerprint template image that has not been compared, and comparing the first fingerprint image with the switched fingerprint template image to obtain a re-matching result; wherein, the first verification condition includes: the similarity obtained by comparing the first fingerprint image with the fingerprint template image is greater than or equal to a first similarity threshold; The switching to a fingerprint template image that has not been compared includes: When there is a target predetermined force range in which the pressing force is less than the predetermined force range to which the first pressing force belongs among at least two of the predetermined force ranges, first switching the fingerprint template image corresponding to the target predetermined force range.

2. The method according to claim 1, wherein The method further includes: In response to the matching result being a first matching result that satisfies the first verification condition, outputting a matching success message.

3. The method according to claim 1, wherein The method further includes: In response to the re-matching result being a third matching result that satisfies a second verification condition, outputting a matching success message; wherein, the second verification condition includes: the similarity obtained by comparing the first fingerprint image with the fingerprint template image is greater than or equal to a second similarity threshold; or In response to the re-matching result being a fourth matching result that does not satisfy the second verification condition, and the number of comparison times being greater than or equal to a predetermined number, outputting a matching failure message.

4. The method according to any one of claims 1 to 3, characterized in that, The method further includes: When receiving a second user's pressing operation, detecting a second pressing force corresponding to the second user's pressing operation, and detecting a second fingerprint image generated correspondingly under the second user's pressing operation; Determining the second fingerprint image as the fingerprint template image corresponding to the second pressing force.

5. The method according to claim 4, characterized in that The determining the second fingerprint image as the fingerprint template image corresponding to the second pressing force includes: Determining the predetermined force range to which the second pressing force belongs; Determining the second fingerprint image as the fingerprint template image corresponding to the predetermined force range to which the second pressing force belongs.

6. A fingerprint information processing device, characterized in that, Applied to a terminal, including: A first detection module, configured to, when receiving a first user's pressing operation, detect a first pressing force corresponding to the first user's pressing operation, and A second detection module, configured to detect a first fingerprint image generated correspondingly under the first user's pressing operation; A first determination module, configured to determine a fingerprint template image corresponding to the predetermined force range according to the predetermined force range to which the first pressing force belongs; wherein, the predetermined force range includes at least two; fingerprint template images corresponding to different predetermined force ranges are different; A first comparison module, configured to compare the first fingerprint image with the fingerprint template image corresponding to the first pressing force, and obtain a matching result; A switching module, configured to, in response to the matching result not satisfying the first verification condition, switch to a fingerprint template image that has not been compared, compare the first fingerprint image with the switched fingerprint template image, and obtain a re-matching result; wherein, the first verification condition includes: the similarity obtained by comparing the first fingerprint image with the fingerprint template image is greater than or equal to a first similarity threshold; The switching module is specifically configured to, when there is a target predetermined force range in which the pressing force is less than the predetermined force range to which the first pressing force belongs among at least two of the predetermined force ranges, first switch the fingerprint template image corresponding to the target predetermined force range.

7. The device according to claim 6, characterized in that The apparatus further includes: A first output module, configured to output a matching success message in response to the matching result being a first matching result that satisfies the first verification condition.

8. The device according to claim 7, characterized in that, The apparatus further includes: A second output module, configured to output a matching success message in response to the re-matching result being a third matching result that satisfies the second verification condition; wherein, the second verification condition includes: the similarity obtained by comparing the first fingerprint image with the fingerprint template image is greater than or equal to a second similarity threshold; or A third output module, configured to output a matching failure message in response to the re-matching result being a fourth matching result that does not satisfy the second verification condition and the number of comparison times being greater than or equal to a predetermined number of times.

9. The device according to any one of claims 6 to 8, characterized in that The apparatus further includes: A third detection module, configured to detect a second pressing force corresponding to the second user's pressing operation when receiving the second user's pressing operation, and A fourth detection module, configured to detect a second fingerprint image generated corresponding to the second user's pressing operation; A second determination module, configured to determine that the second fingerprint image is the fingerprint template image corresponding to the second pressing force.

10. The device according to claim 9, characterized in that The second determination module includes: A first determination sub-module, configured to determine the predetermined force range to which the second pressing force belongs; A second determination sub-module, configured to determine that the second fingerprint image is the fingerprint template image corresponding to the predetermined force range to which the second pressing force belongs.

11. A terminal, characterized in that, The terminal at least includes: a processor and a memory for storing executable instructions that can run on the processor, wherein: When the processor is used to run the executable instructions, the executable instructions execute the steps in the fingerprint information processing method provided in any one of claims 1 to 5 above.

12. A non-transitory computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by the processor, the steps in the fingerprint information processing method provided in any one of claims 1 to 5 above are implemented.

Citation Information

Patent Citations

  • Fingerprint unlocking method and mobile terminal

    CN106096361A

  • Fingerprint acquisition and identification method and device

    CN110414440A

  • Fingerprint picture input device

    JP1990191083A