Fingerprint input method, electronic device, and storage medium

Abstract

Embodiments of the present application disclose a fingerprint input method, an electronic device and a storage medium. The method comprises: in a current sliding fingerprint input process, controlling a fingerprint collection module to collect a fingerprint image, performing first image processing on the fingerprint image to obtain a fingerprint intermediate image, wherein the first image processing comprises image quality processing; performing second image processing on a plurality of fingerprint intermediate images generated in the current sliding fingerprint input process to obtain a target fingerprint island image, wherein a time length of the first image processing is less than a time length of the second image processing.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of biometric identification, and in particular to a fingerprint input method, an electronic device, and a storage medium. BACKGROUND

[0002] With the continuous development of fingerprint identification technology and the upgrade of electronic device hardware configuration, fingerprint identification technology based on capacitive image sensors and optical image sensors is widely used on electronic devices, providing reliable protection for the information security of electronic devices. At the same time, users pay more and more attention to the success rate of fingerprint identification of electronic devices, especially within 1-2 weeks after the user has just input the fingerprint, the success rate of fingerprint identification directly affects the user's experience evaluation of this function. In order to improve the success rate of fingerprint identification of electronic devices, major manufacturers are trying to use various methods to make the area of the fingerprint input by the user as large as possible to cover the commonly used unlocking area of the electronic device.

[0003] In related technologies, the user is mainly prompted to input the fingerprint by pressing the finger multiple times, for example, the electronic device pre-sets the number of successful presses for input as 15 or 20, and then prompts the user to press the fingerprint input area on the electronic device multiple times until the number of successful presses for input by the user reaches the pre-set number of successful presses.

[0004] However, although the pre-set number of successful presses is 15 or 20, the actual number of presses completed by the user in the entire fingerprint input process usually needs to be 30-50, which is much more than the pre-set number of successful presses, resulting in a relatively cumbersome and time-consuming fingerprint input operation. SUMMARY

[0005] The embodiments of the present application provide a fingerprint input method, an electronic device, and a storage medium to solve the technical problem of a relatively cumbersome and time-consuming fingerprint input operation in related technologies.

[0006] According to a first aspect of the present application, a fingerprint input method is disclosed, the method comprising:

[0007] In the current sliding fingerprint input process, a fingerprint collection module is controlled to collect a fingerprint image, a first image processing is performed on the fingerprint image to obtain a fingerprint intermediate image, wherein the first image processing includes image quality processing.

[0008] A second image processing is performed on a plurality of fingerprint intermediate images generated in the current sliding fingerprint input process to obtain a target fingerprint island image, wherein the time length of the first image processing is less than the time length of the second image processing.

[0009] According to a second aspect of the present application, an electronic device is disclosed, comprising a memory, a processor and a computer program stored in the memory, the processor executes the computer program to implement the fingerprint input method as in the first aspect.

[0010] According to a third aspect of the present application, a computer readable storage medium is disclosed, having stored thereon a computer program / instructions which, when executed by a processor, implement the fingerprint input method as in the first aspect.

[0011] According to a fourth aspect of the present application, a computer program product is disclosed, comprising a computer program / instructions which, when executed by a processor, implement the fingerprint input method as in the first aspect.

[0012] In the present application, in the current sliding fingerprint input process, the fingerprint collection module collects a fingerprint image, and the first image processing is performed on the fingerprint image to obtain a fingerprint intermediate image, wherein the first image processing includes image quality processing; the second image processing is performed on a plurality of fingerprint intermediate images generated in the current sliding fingerprint input process to obtain a target fingerprint island image, and the time length of the first image processing is less than that of the second image processing.

[0013] Compared with the related art in which the fingerprint on the finger can only be partially in contact with the fingerprint collection module when the finger is pressed to input the fingerprint, the present application can support the user to input the fingerprint by sliding the finger. Since the fingerprint on the finger can be fully and sufficiently in contact with the fingerprint collection module in the process of sliding the finger, the fingerprint information input by sliding the finger once is more than that input by pressing the finger once. In the process of inputting the fingerprint by sliding the finger once, at least necessary image quality processing is performed after each fingerprint image is collected, and then the second image processing is performed on a plurality of fingerprint intermediate images obtained by the image quality processing to obtain a target fingerprint island image. Since the time length of the first image processing of each fingerprint image is short, and the fingerprint intermediate image obtained by the processing meets the quality requirement of fingerprint input, it can be ensured that the number of fingerprint images collected in the process of sliding the finger is sufficient, the fingerprint images collected before and after can be spliced together, and the splicing speed is faster, so that the user can complete the input of the fingerprint with relatively high quality only by a few times of sliding, and the operation is relatively simple and time-saving, and the operation cost and time cost of the user for fingerprint input are reduced. BRIEF DESCRIPTION OF DRAWINGS

[0014] Figure 1 is a flowchart of a fingerprint input method provided by the present application;

[0015] Figure 2 is an example diagram of the first image processing provided by the present application;

[0016] Figure 3 is an example diagram of a second image processing provided by an embodiment of the present application;

[0017] Figure 4 is a structural schematic diagram of a fingerprint input device provided by an embodiment of the present application;

[0018] Figure 5 is a structural block diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0019] In order to make the above objectives, characteristics and advantages of the present application more apparent, more comprehensible, the present application will be further described in detail below with reference to the drawings and specific embodiments.

[0020] It should be noted that, for the method embodiments, in order to simply describe, they are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited to the order of the actions described, because according to the present application, certain steps can be performed in other order or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification all belong to preferred embodiments, and the actions involved are not necessarily the necessary of the present application.

[0021] Biometric technologies have been widely applied to various terminal devices or electronic devices. Biometric recognition technologies include, but are not limited to, fingerprint recognition, palmprint recognition, vein recognition, iris recognition, face recognition, living body recognition, anti-counterfeiting recognition, and the like. Among them, fingerprint recognition usually includes optical fingerprint recognition, capacitive fingerprint recognition, and ultrasonic fingerprint recognition. With the rise of full-screen technology, a fingerprint recognition module can be arranged in a partial area or an entire area under a display screen, thereby forming under-display optical fingerprint recognition; or, part or all of an optical fingerprint recognition module can be integrated into a display screen of an electronic device, thereby forming in-display optical fingerprint recognition. The display screen can be an organic light emitting diode (OLED) display screen or a liquid crystal display (LCD), and the like. A fingerprint recognition method usually includes steps of acquiring, preprocessing, feature extraction, and feature matching of a fingerprint image. Part or all of the above steps can be implemented by a traditional computer vision (CV) algorithm or a deep learning algorithm based on artificial intelligence (AI). Fingerprint recognition technology can be applied to portable or mobile terminals such as smartphones, tablet computers, and game devices, and other electronic devices such as smart door locks, cars, and bank automatic teller machines, for fingerprint unlocking, fingerprint payment, fingerprint attendance, identity authentication, and the like.

[0022] Embodiments of the present application provide a fingerprint entry method, an electronic device, and a storage medium.

[0023] For ease of understanding, the application scenarios and some concepts involved in the embodiments of the present application are introduced first as follows.

[0024] The entire fingerprint entry process: the user usually needs to enter the fingerprint multiple times in the entire fingerprint entry process until the fingerprint entered by the user meets the quality requirements of the fingerprint database. For ease of understanding, each time of entering the fingerprint in the entire fingerprint entry process is referred to as "one fingerprint entry process", that is, the entire fingerprint entry process includes at least one fingerprint entry process.

[0025] For example, for the way of pressing a finger to enter a fingerprint, the user presses and lifts the finger multiple times in the entire fingerprint entry process, and each finger pressing-lifting is referred to as one pressing fingerprint entry process, and at this time, the entire fingerprint entry process includes at least one pressing fingerprint entry process.

[0026] For example, for the way of sliding finger to enter fingerprint, the user presses, slides, and lifts the finger for multiple times in the whole fingerprint entering process. Each finger pressing-sliding-lifting is called a sliding fingerprint entering process. At this time, the whole fingerprint entering process includes at least one sliding fingerprint entering process.

[0027] In the related art, the user enters fingerprint by pressing the finger, i.e., pressing finger entering fingerprint. Specifically, the electronic device will pre-set the number of successful pressing entering as 15 times or 20 times, that is, the user needs to successfully press the entering fingerprint 15 times or 20 times in the whole fingerprint entering process. However, although the pre-set number of successful times is 15 times or 20 times, the actual number of pressing times completed by the user in the whole fingerprint entering process usually needs to be 30-50 times, which is far more than the pre-set number of successful times, resulting in that the fingerprint entering operation is relatively cumbersome and time-consuming. In addition, for the capacitive image sensor or optical image sensor, although the number of entered fingerprints reaches the requirement, the area of the fingerprint entered in the base library is actually small, and the gap between the fingerprint images cannot be well and completely covered, resulting in that the image splicing is difficult, and the quality of the entered fingerprint is poor. Although the base library quality can be improved through learning strategy in the later stage, the recognition rate of the just entered base library is generally low and prone to recognition off-target problem through large amount of user use of big data.

[0028] In the embodiment of the present application, the user can enter fingerprint by sliding the finger, i.e., sliding finger entering fingerprint. Compared with the pressing finger entering fingerprint in the related art, the fingerprint on the finger can only be partially in contact with the fingerprint collection module. In the embodiment of the present application, the fingerprint on the finger can be fully and sufficiently in contact with the fingerprint collection module in the process of sliding the finger. Therefore, the fingerprint information of one sliding finger entering fingerprint is more, and the user only needs to slide a few times to complete high-quality fingerprint entering.

[0029] A sliding fingerprint entering process: also called single sliding fingerprint entering, which can include two cases: one is defined from the user's perspective, which is the process from pressing the finger to sliding the finger to lifting the finger by the user, which constitutes a single sliding fingerprint entering. The other is defined from the machine's perspective, which is that the user presses the finger, the finger is always in contact with the fingerprint collection module, and there is no lifting of the finger, but the number of images collected by the fingerprint collection module reaches the upper limit of sliding image collection, for example, 60 images, which constitutes a single sliding fingerprint entering.

[0030] The whole fingerprint input flow in the case of sliding fingerprint input: through containing multiple sliding fingerprint input processes, for example, the user first performs first sliding fingerprint input to input a fingerprint; after the first sliding fingerprint input ends, the user performs second sliding fingerprint input to continue inputting the fingerprint, and so on, until the input fingerprint meets the quality requirement, and the fingerprint input flow ends.

[0031] Fingerprint splicing: after the feature points extracted according to the model are aligned, if overlapping feature points reaching a set threshold are found, the two images can be spliced in texture to form a new fingerprint image, and this process is referred to as fingerprint splicing.

[0032] Fingerprint island image: after a series of fingerprint images are subjected to fingerprint splicing processing, a new large image generated is referred to as a fingerprint island image.

[0033] Fingerprint database: after a series of fingerprint island images formed after the collected fingerprint images are spliced in the fingerprint input process are sequenced, the images are stored in a file, which is used as a template for subsequent fingerprint unlocking comparison. The file used to store the fingerprint island images is referred to as a fingerprint database.

[0034] Next, a fingerprint input method provided in an embodiment of the present application is introduced.

[0035] It should be noted that in the embodiment of the present application, the user's fingerprint input behavior can be continuously detected, for example, the user's pressing fingerprint input and sliding fingerprint input. In the case of detecting the user's pressing fingerprint input, the fingerprint input algorithm in the related art is called to perform fingerprint input processing. In the case of detecting the user's sliding fingerprint input, the fingerprint input algorithm in the embodiment of the present application is called to perform fingerprint input processing, so as to support or be compatible with multiple different fingerprint input modes.

[0036] Figure 1 is a flowchart of a fingerprint input method provided in the embodiment of the present application. In the embodiment of the present application, taking a sliding fingerprint input process in the whole fingerprint input flow as an example, as shown in Figure 1 the method can include the following steps: step 101 and step 102.

[0037] In step 101, in the current sliding fingerprint input process, the fingerprint collection module is controlled to collect a fingerprint image, and the first image processing is performed on the fingerprint image to obtain a fingerprint intermediate image, wherein the first image processing includes image quality processing.

[0038] In some embodiments, the user can be guided to input a fingerprint by sliding a finger. Accordingly, the following step: step 100 can be added before step 101.

[0039] In step 100, a first prompt is output, wherein the first prompt is used to instruct the user to enter a fingerprint by sliding a finger.

[0040] In actual applications, the first prompt can be a screen prompt message or a voice prompt message.

[0041] In the embodiments of the present application, the fingerprint collection module can be a capacitive image sensor or an optical image sensor of the electronic device.

[0042] Considering the side capacitive sensor and some optical image sensors, parallel execution of image collection operations and image algorithm processing operations cannot be achieved in a Trusted Execution Environment (TEE) of the electronic device, and in order to reduce the time length of image algorithm processing in a single fingerprint entry process, in the embodiments of the present application, one sliding fingerprint entry process can be divided into two stages: a first stage of image collection and necessary image quality processing (i.e., first image processing); and a second stage of generating a target fingerprint island map based on a fingerprint intermediate image generated in the first stage (i.e., second image processing), wherein the time length of the first stage is less than that of the second stage.

[0043] In the embodiments of the present application, the image quality processing can include the following types of processing: removing bottom lines, removing residual images, improving definition, and correcting press bias to improve the quality of fingerprints in images.

[0044] In the embodiments of the present application, the image processing module for performing image quality processing on a fingerprint image can be a Digital Signal Processing (DSP), a Graphics Processing Unit (GPU), or a Central Processing Unit (CPU).

[0045] In the embodiments of the present application, by performing first image processing on the fingerprint image collected by the fingerprint collection module, a high-quality fingerprint intermediate image can be obtained, thereby ensuring that the quality of the fingerprint entered into the fingerprint database this time is high, and improving the success rate of subsequent fingerprint authentication.

[0046] In step 102, second image processing is performed on a plurality of fingerprint intermediate images generated in the current sliding fingerprint entry process to obtain a target fingerprint island map, wherein the time length of the first image processing is less than that of the second image processing.

[0047] In the embodiments of the present application, the second image processing can include splicing processing, and accordingly, image splicing processing is performed on the plurality of intermediate fingerprint images generated in the current sliding fingerprint input process to obtain the target fingerprint island image; or, the second image processing can include screening processing, and accordingly, the target fingerprint island image is screened from the plurality of intermediate fingerprint images generated in the current sliding fingerprint input process.

[0048] In the embodiments of the present application, the type of the second image processing can be selected according to the area of the intermediate fingerprint image, for example, for the case that the area of the intermediate fingerprint image is relatively small, the second image processing is splicing processing; for the case that the area of the intermediate fingerprint image is relatively large, the second image processing is screening processing.

[0049] In the embodiments of the present application, the time length of the first image processing is less than the time length of the second image processing, so as to ensure that the number of images collected in the process of sliding the finger is sufficient.

[0050] As can be seen from the above embodiments, in the current sliding fingerprint input process, the fingerprint collection module is controlled to collect one fingerprint image, the first image processing is performed on the one fingerprint image to obtain an intermediate fingerprint image, wherein the first image processing includes image quality processing; the second image processing is performed on the plurality of intermediate fingerprint images generated in the current sliding fingerprint input process to obtain a target fingerprint island image, wherein the time length of the first image processing is less than the time length of the second image processing.

[0051] Compared with the related art in which the fingerprint on the finger can only be partially in contact with the fingerprint collection module when the finger is pressed to input the fingerprint, in the embodiments of the present application, the user can input the fingerprint by sliding the finger. Since the fingerprint on the finger can be fully and sufficiently in contact with the fingerprint collection module in the process of sliding the finger, compared with one pressing of the finger, more fingerprint information can be input by one sliding of the finger. In the process of one sliding of the finger, after each collection of one fingerprint image, at least necessary image quality processing is performed, and then the second image processing is performed on the plurality of intermediate fingerprint images obtained by the image quality processing to obtain a target fingerprint island image. Since the time length of the first image processing of each fingerprint image is relatively short, and the intermediate fingerprint image obtained by the processing meets the quality requirement of fingerprint input, it can be ensured that the number of fingerprint images collected in the process of sliding the finger is sufficient, the fingerprint images collected before and after can be spliced together, and the splicing speed is faster, so that the user can complete the input of the entire fingerprint with relatively high quality by only a few times of sliding, the operation is relatively simple and time-saving, and the operation cost and time cost of the user for fingerprint input are reduced.

[0052] The above is a fingerprint input process of one-time sliding fingerprint input, from image acquisition, to first image processing, to second image processing, to obtain a target fingerprint island image. The whole sliding fingerprint input process usually includes multiple sliding fingerprint input processes.

[0053] In another embodiment provided in the present application, for the first image processing, the step 101 can include the following steps: step 1011 and step 1012.

[0054] In step 1011, the control of the fingerprint acquisition module pauses image acquisition after each fingerprint image is acquired, and performs first image processing on the fingerprint image to obtain a fingerprint intermediate image.

[0055] In step 1012, after the first image processing of a fingerprint image is completed, the control of the fingerprint acquisition module continues to acquire the next fingerprint image.

[0056] In the embodiments of the present application, the step 1011 and the step 1012 are both the first stage in the process of one-time sliding fingerprint input. In this stage, during the sliding process, the fingerprint acquisition module performs first image processing on each fingerprint image after the acquisition of the fingerprint image. The processing time of the first image processing should not be too long, otherwise it will affect the acquisition frame rate and cause the failure of image splicing. After the first image processing of the acquired fingerprint image is completed, the fingerprint acquisition module continues to acquire the next fingerprint image, and the above image acquisition, first image processing, image acquisition, and first image processing are repeated. That is, the acquisition of a fingerprint image and the first image processing of a fingerprint image are performed in series and alternately.

[0057] In the embodiments of the present application, for the first stage, since the processing time of each fingerprint image is short, it can be regarded as a parallel processing of “sliding and acquiring image, and sending algorithm for inputting” simultaneously. The electronic device completes the image acquisition and the quality processing of the acquired image during the sliding process of the user's finger. For the second stage, since it may involve image splicing, and the algorithm involved in the image splicing is complex and time-consuming, the complex image splicing can be performed after the fingerprint acquisition module completes the acquisition of all images. That is, during the period from the termination of the image acquisition of the current sliding fingerprint input by the fingerprint acquisition module to the start of the image acquisition of the next sliding fingerprint input by the fingerprint acquisition module, the complex image splicing processing is performed. Since the image quality processing has been performed on the image acquired by the fingerprint acquisition module in the first stage, the image splicing is directly based on the image processed in the first stage, and the splicing speed is faster.

[0058] In another embodiment provided in the present application, for the first image processing, as Figure 2As shown, the first image processing can include at least one of the following in addition to the image quality processing: behavior judgment, first splicing processing, living body detection, and pressing detection.

[0059] The behavior judgment, the first splicing processing, the living body detection, and the pressing detection are introduced in sequence.

[0060] In some embodiments, the first image processing can further include: abnormal sliding judgment and / or state information statistics, etc. The abnormal sliding judgment is used to judge whether there is fast sliding, slow sliding, and pressing in the current sliding fingerprint input process according to at least one fingerprint image. The state information statistics is used to count the number of pressing and sliding in the current sliding fingerprint input process according to at least one fingerprint image.

[0061] In the embodiments of the present application, it is considered that many users may have been accustomed to inputting fingerprints by pressing, and it is difficult to input fingerprints by sliding through prompting or guiding. Therefore, it is necessary to be compatible with the two different input modes.

[0062] In order to be compatible with the two different input modes, in the embodiments of the present application, behavior judgment is performed according to the fingerprint images collected in the sliding process to determine the actual fingerprint input mode of the user.

[0063] In the embodiments of the present application, three threshold values can be set: splicing threshold < slow sliding threshold < repetition threshold, and some sliding statistical counts are initialized: fast sliding count, slow sliding count, and pressing count.

[0064] For the adjacent two fingerprint images collected by the fingerprint collection module, the overlapping area of the current collected fingerprint image and the fingerprint image collected before it is calculated. If the overlapping area is less than the splicing threshold, the two fingerprint images cannot be spliced together, it is determined that the current sliding is too fast, and the fast sliding count is increased by 1 accordingly. If the overlapping area is greater than the slow sliding threshold and less than the repetition threshold, it is determined that the current sliding is too slow, and the slow sliding count is increased by 1 accordingly. If the overlapping area is greater than the repetition threshold, the two images are repeated, it is determined that the current is a pressing behavior, and the pressing count is increased by 1 accordingly.

[0065] For the fingerprint image generated by fast sliding, it can be saved as an island first, and when other fingerprint images are collected subsequently, it is tried to splice the other fingerprint images with the island. For the fingerprint image with an overlapping area greater than the splicing threshold, the fingerprint image is spliced with the fingerprint island image obtained by the last splicing, or it is tried to be spliced with the largest island image.

[0066] In some embodiments, the first image processing can further include: first splicing processing; wherein the first splicing processing is configured to splice the image quality processed fingerprint image with the last spliced fingerprint intermediate image and / or at least one largest area fingerprint intermediate image to obtain a new fingerprint intermediate image.

[0067] For example, in the current sliding fingerprint input process, the image capturing upper limit of the fingerprint collection module is 60, and thus the first fingerprint image P1 and the second fingerprint image P2 collected by the fingerprint collection module are spliced to obtain a fingerprint intermediate image P 12 , and then the third fingerprint image P3 is collected, P3 and P 12 are spliced to obtain P 123 , and so on.

[0068] In the embodiments of the present application, considering that the splicing between two adjacent images is relatively simple and time-consuming, after the image quality processing is completed in the first stage, simple image splicing processing can be further performed, for example, the current image quality processed fingerprint image is spliced with the last spliced fingerprint intermediate image, or the largest area fingerprint intermediate image is spliced. In the second stage, the fingerprint intermediate images that are not spliced in the first stage and the spliced fingerprint intermediate images are spliced again, and this splicing process is relatively complex and time-consuming.

[0069] In some embodiments, no splicing processing is performed in the first stage, and all splicing processing is performed in the second stage.

[0070] In some embodiments, the first image processing can further include: performing living body detection according to one fingerprint image, and ending the entire fingerprint input process in the case of detecting a non-living body; wherein the entire fingerprint input process includes at least one sliding fingerprint input process.

[0071] In the embodiments of the present application, in the single sliding fingerprint input process, if a living body attack behavior is detected, the entire fingerprint input process is ended in advance to avoid resource waste caused by continuous image collection of the fingerprint collection module.

[0072] In the embodiments of the present application, in order to improve the accuracy of living body detection, living body detection can also be performed according to multiple fingerprint images, at this time, a living body attack count can be initialized, and the count is incremented by 1 in the case of screening out one fingerprint image containing a living body attack object, and when the count reaches a certain threshold, it is considered that there is a living body attack, and the entire fingerprint input process is ended in advance.

[0073] In some embodiments, the first image processing can further include: press detection, and ending the current sliding fingerprint input process in the case of detecting a press.

[0074] In the embodiments of the present application, in the case that it is detected that the continuous N fingerprint images are all overlapping images, or the proportion of the overlapping images in the collected fingerprint images exceeds a first threshold, it is determined that the pressing is detected, N is an integer greater than 1; wherein in the case that the area overlap ratio of the adjacent two fingerprint images is greater than a second threshold, the two fingerprint images are determined as overlapping images.

[0075] In the embodiments of the present application, since the overlapping degree of the fingerprint images collected during pressing is relatively high, the calculation resources will be wasted if these images are spliced in the splicing process. Therefore, in the single sliding fingerprint input process, if the pressing is detected, the single sliding fingerprint input process is ended in advance to avoid the waste of calculation resources caused by splicing the repeated images. In addition, by collecting limited images, the pressing input mode is judged, and the single input process is ended in advance to achieve the purpose of compatibility with the pressing input.

[0076] In another embodiment provided by the present application, for the second image processing, the step 102 can include the following step: step 1021.

[0077] In step 1021, image splicing processing is performed according to the plurality of fingerprint intermediate images generated in the current sliding fingerprint input process to obtain a target fingerprint island map.

[0078] In some embodiments, all image splicing processing in the single sliding fingerprint input process can be placed in the second stage processing, at this time, the step 1021 includes the following steps:

[0079] The current fingerprint intermediate image is spliced with the fingerprint island map obtained by the last splicing and / or at least one largest fingerprint island map to obtain a new fingerprint island map.

[0080] The fingerprint island maps generated in the entire fingerprint input process are sorted according to the area, and the fingerprint island maps exceeding the storage upper limit and the remaining other fingerprint island maps are spliced to obtain a target fingerprint island map, wherein the area of the fingerprint island map exceeding the storage upper limit is smaller than the area of the other fingerprint island maps.

[0081] In the embodiments of the present application, since the storage space of the electronic device is limited, all fingerprint island maps cannot be saved, and some small-area fingerprint island maps need to be deleted, therefore, before deleting the small-area fingerprint island maps, the large-area fingerprint island maps can be screened according to the island map area sorting, and the small-area fingerprint island maps are spliced with the large-area fingerprint island maps to be retained.

[0082] In some embodiments, simple image splicing processing can be placed in the first stage, and complex image splicing processing can be placed in the second stage, at this time, the step 1021 includes the following steps:

[0083] The fingerprint intermediate images generated in the whole fingerprint input process are sorted according to area, and the fingerprint intermediate images exceeding the storage upper limit are spliced with the remaining other fingerprint intermediate images to obtain a target fingerprint island map.

[0084] It can be seen that in the embodiments of the present application, the image splicing processing of different complexities can be placed in different stages, and the user can select different processing modes according to actual needs, and the flexibility is high.

[0085] In another embodiment provided by the present application, for the second image processing, as shown in the following table, the second image processing can further include, in addition to the image splicing processing, the same finger detection. Figure 3

[0086] In order to avoid resource waste caused by repeated input, the same finger detection needs to be performed before the image splicing processing of the multiple fingerprint intermediate images.

[0087] Specifically, the second image processing can further include: detecting whether there is a fingerprint intermediate image matching the fingerprint island map template features of the input fingerprint in the multiple fingerprint intermediate images generated in the current sliding fingerprint input process, and if so, ending the whole fingerprint input process; otherwise, performing image splicing processing on the multiple fingerprint intermediate images generated in the current sliding fingerprint input process to obtain a target fingerprint island map.

[0088] In the embodiments of the present application, if there is a fingerprint intermediate image matching the fingerprint island map template features of the input fingerprint in the multiple fingerprint intermediate images generated in the current sliding fingerprint input process, it indicates that the finger used in the current sliding fingerprint input process has been successfully input before, and at this time, image splicing is not needed, and there is no need to continue to input fingerprint, that is, the user does not need to perform the next sliding fingerprint input.

[0089] In the embodiments of the present application, if there is no fingerprint intermediate image matching the fingerprint island map template features of the input fingerprint in the multiple fingerprint intermediate images generated in the current sliding fingerprint input process, it indicates that the finger used in the current sliding fingerprint input process has not been input before, and at this time, image splicing is needed, and the previously sliding input fingerprint intermediate images are spliced into a fingerprint island map with larger area.

[0090] It can be seen that in the embodiments of the present application, in the single sliding fingerprint input process, the finger can be checked based on the fingerprint input this time, and if the finger has been successfully input before, it is not allowed to input again, thereby avoiding resource waste caused by repeated input.

[0091] ​In another embodiment provided in the present application, for the entire fingerprint enrollment process, the fingerprint enrollment method provided in the embodiment of the present application can further include the following step after step 102: step 103.

[0092] In step 103, according to the target fingerprint island map or state information statistical result obtained in the entire fingerprint enrollment process, it is detected whether the enrollment end condition is met, and if so, the entire fingerprint enrollment process is ended.

[0093] The enrollment end condition includes any one of the following: the total area of the target fingerprint island map or the area of the largest target fingerprint island map reaches a third threshold value, the number of sliding reaches a fourth threshold value, and the number of pressing reaches a fifth threshold value; the fourth threshold value is less than the fifth threshold value.

[0094] In the embodiment of the present application, if the area of the target fingerprint island map obtained by splicing reaches a good enough threshold value, the entire fingerprint enrollment process can be ended in advance to save the software and hardware resources of the electronic device.

[0095] In the embodiment of the present application, if the number of times of successful sliding fingerprint enrollment of the user in the entire fingerprint enrollment process reaches a set upper limit value, the entire fingerprint enrollment process is normally ended. For example, if the fourth threshold value is 10, when it is detected that the number of times of successful sliding fingerprint enrollment of the user in the entire fingerprint enrollment process reaches 10, the entire fingerprint enrollment process is ended.

[0096] In the embodiment of the present application, if the number of times of successful pressing fingerprint enrollment of the user in the entire fingerprint enrollment process reaches a set upper limit value, the entire fingerprint enrollment process is normally ended. For example, if the fifth threshold value is 16, when it is detected that the number of times of successful pressing fingerprint enrollment of the user in the entire fingerprint enrollment process reaches 16, the entire fingerprint enrollment process is ended.

[0097] As can be seen, in the embodiment of the present application, the end condition of the fingerprint enrollment process can be set from multiple dimensions, and different end conditions are set for different fingerprint enrollment behaviors to meet the different enrollment needs of different users.

[0098] As can be seen, in the embodiment of the present application, for the fingerprint enrollment scene in which the capacitive image sensor and the optical image sensor cannot realize parallel processing of image acquisition and algorithm in the TEE environment of the electronic device, the enrollment strategy of preferentially prompting sliding enrollment and compatible pressing enrollment is proposed, which not only can take into account the user who is used to pressing enrollment to maintain the original habit, but also can guide the user to perform sliding enrollment, so that the user who actually performs sliding enrollment can complete the enrollment of the entire relatively high-quality fingerprint database through a few times of sliding, and the fingerprint image of the actual enrollment database is good enough to reduce the probability of actual unlocking miss.

[0099] Figure 4 is a structural schematic diagram of a fingerprint input device provided by an embodiment of the present application, as shown in Figure 4 The fingerprint input device 400 can include a first processing module 410 and a second processing module 420.

[0100] The first processing module 410 is configured to, in a current sliding fingerprint input process, control a fingerprint collection module to collect one fingerprint image, perform first image processing on the one fingerprint image, and obtain a fingerprint intermediate image, wherein the first image processing includes image quality processing.

[0101] The second processing module 420 is configured to perform second image processing on a plurality of fingerprint intermediate images generated in the current sliding fingerprint input process, and obtain a target fingerprint island image, wherein a time length of the first image processing is less than a time length of the second image processing.

[0102] As can be seen from the above embodiment, in the current sliding fingerprint input process, one fingerprint image is collected, first image processing is performed on the one fingerprint image, and a fingerprint intermediate image is obtained, wherein the first image processing includes image quality processing; second image processing is performed on a plurality of fingerprint intermediate images generated in the current sliding fingerprint input process, and a target fingerprint island image is obtained, wherein a time length of the first image processing is less than a time length of the second image processing.

[0103] Compared with the related art, in which the fingerprint on the finger can only be partially in contact with the fingerprint collection module when the finger is pressed to input the fingerprint, in the present application, the user can input the fingerprint by sliding the finger. Since the fingerprint on the finger can be fully and sufficiently in contact with the fingerprint collection module during the sliding of the finger, the fingerprint information input by one sliding of the finger is more than that input by one pressing of the finger. In the process of inputting the fingerprint by one sliding of the finger, after each fingerprint image is collected, at least necessary image quality processing is performed, and then second image processing is performed on a plurality of fingerprint intermediate images obtained by the image quality processing, and a target fingerprint island image is obtained. Since the time length of the first image processing of each fingerprint image is short, and the fingerprint intermediate image obtained by the processing meets the quality requirement of the fingerprint input, it can be ensured that the number of fingerprint images collected during the sliding of the finger is sufficient, the fingerprint images collected before and after can be spliced together, and the splicing speed is faster, so that the user can complete the input of the fingerprint of relatively high quality by only a few times of sliding, the operation is relatively simple and time-saving, and the operation cost and time cost of the user for the fingerprint input are reduced.

[0104] Optionally, as one embodiment, the first processing module 410 is specifically configured to:

[0105] controlling the fingerprint collection module to pause image collection after each time a fingerprint image is collected, performing first image processing on the fingerprint image to obtain a fingerprint intermediate image;

[0106] controlling the fingerprint collection module to continue collecting a next fingerprint image after the first image processing on the fingerprint image is completed.

[0107] Optionally, as an embodiment, the first processing module 410 is further configured to perform abnormal sliding judgment and / or state information statistics.

[0108] The abnormal sliding judgment is configured to determine whether there is fast sliding, slow sliding, and pressing in the current sliding fingerprint input process according to the fingerprint image.

[0109] The state information statistics is configured to count the number of pressing and sliding in the current sliding fingerprint input process according to the fingerprint image.

[0110] Optionally, as an embodiment, the first processing module 410 is further configured to perform first splicing processing.

[0111] The first splicing processing is configured to splice the fingerprint image after image quality processing with a fingerprint intermediate image obtained by last splicing and / or at least one fingerprint intermediate image with the largest area to obtain a new fingerprint intermediate image.

[0112] Optionally, as an embodiment, the first processing module 410 is further configured to perform living body detection according to the fingerprint image.

[0113] In a case where it is detected that the living body is not alive, the entire fingerprint input process is ended, and the entire fingerprint input process includes at least one sliding fingerprint input process.

[0114] Optionally, as an embodiment, the first processing module 410 is further configured to perform pressing detection, and in a case where pressing is detected, the current sliding fingerprint input process is ended.

[0115] In a case where it is detected that N continuous fingerprint images are all overlapping images, or the proportion of overlapping images in the collected fingerprint images exceeds a first threshold, it is determined that pressing is detected, and N is an integer greater than 1.

[0116] In a case where the area overlap ratio of two adjacent fingerprint images is greater than a second threshold, the two fingerprint images are determined to be overlapping images.

[0117] Optionally, as an embodiment, the second processing module 420 is specifically configured to:

[0118] According to the image splicing processing on the plurality of intermediate fingerprint images generated in the current sliding fingerprint input process, the target fingerprint island image is obtained.

[0119] Optionally, as an embodiment, the second processing module 420 is specifically configured to:

[0120] splicing the current intermediate fingerprint image with the fingerprint island image obtained by the last splicing and / or at least one maximum fingerprint island image to obtain a new fingerprint island image;

[0121] sorting the fingerprint island images generated in the entire fingerprint input process according to areas, splicing the fingerprint island image exceeding the storage upper limit with the remaining other fingerprint island images to obtain the target fingerprint island image, wherein the area of the fingerprint island image exceeding the storage upper limit is smaller than the areas of the other fingerprint island images;

[0122] or

[0123] sorting the intermediate fingerprint images generated in the entire fingerprint input process according to areas, splicing the intermediate fingerprint image exceeding the storage upper limit with the remaining other intermediate fingerprint images to obtain the target fingerprint island image.

[0124] Optionally, as an embodiment, the second processing module 420 is further configured to: detecting whether there is an intermediate fingerprint image matching the template features of the input fingerprint island image in the plurality of intermediate fingerprint images generated in the current sliding fingerprint input process;

[0125] if yes, ending the entire fingerprint input process; otherwise, according to the image splicing processing on the plurality of intermediate fingerprint images generated in the current sliding fingerprint input process, the target fingerprint island image is obtained.

[0126] Optionally, as an embodiment, the fingerprint input device 400 can further include:

[0127] a third processing module configured to detect whether the input end condition is met according to the target fingerprint island image or the state information statistical result obtained in the entire fingerprint input process, and if yes, ending the entire fingerprint input process.

[0128] The input end condition includes any one of the following: the total area of the target fingerprint island image or the area of the maximum target fingerprint island image reaches a third threshold value, the number of sliding reaches a fourth threshold value, and the number of pressing reaches a fifth threshold value; the fourth threshold value is less than the fifth threshold value.

[0129] Any one of the steps in the embodiments of the fingerprint input method provided in the present application and the specific operations in any one of the steps can be completed by the corresponding modules in the fingerprint input device. The processes of the corresponding operations completed by the modules in the fingerprint input device are referred to the processes of the corresponding operations described in the embodiments of the fingerprint input method.

[0130] For the apparatus embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts are referred to the part of the method embodiment.

[0131] Figure 5 is a structural block diagram of an electronic device provided by an embodiment of the present application. The electronic device includes a processing component 522, which further includes one or more processors, and a memory resource represented by a memory 532, used to store instructions, such as an application program, executable by the processing component 522. The application program stored in the memory 532 can include one or more than one module each corresponding to a set of instructions. In addition, the processing component 522 is configured to execute the instructions to perform the method described above.

[0132] The electronic device can further include a power supply component 526 configured to perform power management of the electronic device, a wired or wireless network interface 550 configured to connect the electronic device to a network, and an input / output (I / O) interface 558. The electronic device can operate based on an operating system stored in the memory 532, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, or the like.

[0133] According to still another embodiment of the present application, the present application further provides a computer readable storage medium, having stored thereon a computer program / instructions, which, when executed by a processor, implement the steps of the fingerprint input method according to any one of the above embodiments.

[0134] According to still another embodiment of the present application, the present application further provides a computer program product, including a computer program / instructions, which, when executed by a processor, implement the steps of the fingerprint input method according to any one of the above embodiments.

[0135] Each of the embodiments in the present specification is described in a progressive manner, and each embodiment focuses on the difference from other embodiments, and the same and similar parts between the embodiments can be referred to each other.

[0136] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, apparatus, or computer program product. Therefore, the embodiments of the present application can adopt a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present application can adopt the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer usable program code.

[0137] The embodiments of the present application are described with reference to the flowchart and / or block diagram of the method, the terminal device (system) and the computer program product according to the embodiments of the present application. It is understood that each block of the flowchart and / or block diagram, and combinations of blocks in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processing unit or other programmable data processing terminal devices to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal devices, create means for implementing the functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks.

[0138] These computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal devices to function in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture including instructions means that implement the function specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart and / or block diagram block or blocks.

[0139] Although the preferred embodiments of the present application have been described, those skilled in the art will be able to make additional changes and modifications to these embodiments once they grasp the fundamental inventive concepts. Therefore, the appended claims are intended to encompass all the changes and modifications within the scope of the embodiments of the present application.

[0140] Finally, it should be noted that, in the description of the present application, the terms such as first and second, and the like are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between such entities or operations. Moreover, the terms "comprising", "including", or any other variant thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or terminal device that comprises a list of elements does not include only those elements in the list, but can also include other elements not expressly listed or inherent to such process, method, article or terminal device. Without further limitation, an element preceded by "comprises a" does not, without more constraints, foreclose the existence of additional identical elements in the process, method, article or terminal device that includes the element.

[0141] The above provides a kind of fingerprint entry method, electronic equipment and storage medium provided by the present application, which are described in detail in the present application.The principles and implementation modes of the present application are described in the examples above.The above examples are only used to help understand the method and its core idea of the present application;At the same time, for those skilled in the art, according to the idea of the present application, the specific implementation mode and application range will be changed;Therefore, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A method of fingerprint enrollment, the method comprising: The method comprises: In the current sliding fingerprint input process, the fingerprint acquisition module acquires a fingerprint image, and performs first image processing on the fingerprint image to obtain a fingerprint intermediate image, wherein the first image processing comprises image quality processing to improve the fingerprint quality of the fingerprint intermediate image; The second image processing is performed on a plurality of fingerprint intermediate images generated in the current sliding fingerprint input process to obtain a target fingerprint island image, wherein the time length of the first image processing is less than that of the second image processing; The control of the fingerprint acquisition module to acquire a fingerprint image and perform first image processing on the fingerprint image to obtain a fingerprint intermediate image comprises: After the fingerprint acquisition module completes the acquisition of each fingerprint image, the image acquisition is paused, and the first image processing is performed on the fingerprint image to obtain a fingerprint intermediate image; After the first image processing of the fingerprint image is completed, the fingerprint acquisition module continues to acquire the next fingerprint image; The second image processing performed on a plurality of fingerprint intermediate images generated in the current sliding fingerprint input process to obtain a target fingerprint island image comprises: The image splicing processing is performed on a plurality of fingerprint intermediate images generated in the current sliding fingerprint input process to obtain a target fingerprint island image.

2. The method of claim 1, wherein, The first image processing further comprises abnormal sliding judgment and / or state information statistics; The abnormal sliding judgment is used to judge at least whether there is fast sliding, slow sliding and pressing in the current sliding fingerprint input process according to the fingerprint image; The state information statistics is used to count at least the number of pressing and sliding in the current sliding fingerprint input process according to the fingerprint image.

3. The method of claim 1, wherein, The first image processing further comprises first splicing processing; The first splicing processing is used to splice the fingerprint image after the image quality processing with the fingerprint intermediate image obtained by the last splicing and / or at least one fingerprint intermediate image with the largest area to obtain a new fingerprint intermediate image.

4. The method of claim 1, wherein, The first image processing further comprises living body detection according to the fingerprint image, and the entire fingerprint input process is ended in the case of detecting a non-living body; the entire fingerprint input process comprises at least one sliding fingerprint input process.

5. The method of claim 1, wherein, The first image processing further comprises pressing detection, and the current sliding fingerprint input process is ended in the case of detecting pressing; In the case that N consecutive fingerprint images are all overlapping images, or the proportion of overlapping images in the acquired fingerprint images exceeds a first threshold, it is determined that pressing is detected, N is an integer greater than 1; In the case that the area overlap ratio of adjacent two fingerprint images is greater than a second threshold, the two fingerprint images are determined to be overlapping images.

6. The method of claim 1, wherein, The image splicing processing performed on a plurality of fingerprint intermediate images generated in the current sliding fingerprint input process to obtain a target fingerprint island image comprises: The current fingerprint intermediate image is spliced with the fingerprint island image obtained by the last splicing and / or at least one largest fingerprint island image to obtain a new fingerprint island image; The fingerprint island maps generated in the whole fingerprint input process are sorted according to areas, and the fingerprint island map exceeding the storage upper limit and the remaining other fingerprint island maps are spliced to obtain a target fingerprint island map, wherein the area of the fingerprint island map exceeding the storage upper limit is smaller than the area of the other fingerprint island maps. Or The fingerprint intermediate images generated in the whole fingerprint input process are sorted according to areas, and the fingerprint intermediate image exceeding the storage upper limit and the remaining other fingerprint intermediate images are spliced to obtain a target fingerprint island map.

7. The method of claim 1, wherein, The second image processing further includes: detecting whether there is a fingerprint intermediate image matching the input fingerprint island map template feature in the plurality of fingerprint intermediate images generated in the current sliding fingerprint input process, and if yes, ending the whole fingerprint input process; otherwise, performing image splicing processing on the plurality of fingerprint intermediate images generated in the current sliding fingerprint input process to obtain a target fingerprint island map.

8. The method of claim 1, wherein, After the image splicing processing on the plurality of fingerprint intermediate images generated in the current sliding fingerprint input process to obtain a target fingerprint island map, the method further includes: According to the target fingerprint island map or the state information statistical result obtained in the whole fingerprint input process, it is detected whether the input end condition is met, and if yes, the whole fingerprint input process is ended. The input end condition includes any one of the following: the total area of the target fingerprint island map or the area of the largest target fingerprint island map reaches a third threshold value, the sliding number reaches a fourth threshold value, and the pressing number reaches a fifth threshold value; the fourth threshold value is smaller than the fifth threshold value.

9. An electronic device comprising a memory, a processor, and a computer program stored on the memory, wherein the computer program, when executed by the processor, is arranged to perform the method of any one of claims 1 to 8. The processor executes the computer program to implement the method of any one of claims 1-8.

10. A computer readable storage medium having stored thereon computer programs / instructions, characterized in that, The computer program / instruction is executed by the processor to implement the method of any one of claims 1-8.

11. A computer program product comprising computer programs / instructions, characterized in that, The computer program / instruction is executed by the processor to implement the method of any one of claims 1-8.

Images