Fingerprint image processing method and device, equipment, medium and product
By collecting, stitching and cropping fingerprint images in electronic devices, and generating a larger area of reference fingerprint images, the low recognition rate problem caused by the small-area fingerprint acquisition area is solved, and the speed and success rate of fingerprint recognition are improved.
Patent Information
- Application Number
- CN202411548966.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-31
- Publication Date
- 2025-02-07
AI Technical Summary
In electronic devices, due to the small area of the fingerprint acquisition area, the success rate and efficiency of fingerprint recognition are low.
By collecting multiple small fingerprint images, stitching and cropping, a larger area of reference fingerprint images are generated to improve the success rate and efficiency of fingerprint recognition.
By reducing the number of reference fingerprint images and increasing the area of each image, the speed and success rate of fingerprint recognition are improved.
Smart Images

Figure CN119399800A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of image processing technology, and specifically relates to a fingerprint image processing method, device, equipment, medium and product. Background Art
[0002] Fingerprint recognition is a common biometric recognition technology. Because each user's fingerprint pattern is unique and relatively stable, it is widely used in the security field.
[0003] Considering the cost factor, the area used to collect user fingerprints in current electronic devices is relatively small, which results in the area of the single fingerprint template image entered by the user and the fingerprint image actually collected in subsequent applications being relatively small, and the characteristic information of the fingerprint is relatively small, which will affect the success rate of fingerprint recognition. In addition, since the area of a single fingerprint template image is small, more fingerprint template images are required to save more fingerprint information, and the increase in the number of fingerprint template images will lead to a longer fingerprint recognition time. Summary of the invention
[0004] The purpose of the embodiments of the present application is to provide a fingerprint image processing method, device, equipment, medium and product, which can solve the technical problem of low success rate and efficiency of fingerprint recognition when the fingerprint collection area of the electronic device is small in the related art.
[0005] In a first aspect, an embodiment of the present application provides a method for processing a fingerprint image, comprising:
[0006] Collecting multiple first fingerprint images belonging to the same object through a fingerprint collection area, where the area of the fingerprint collection area is smaller than a reference area threshold;
[0007] According to the fingerprint features of the first fingerprint images, the first fingerprint images are spliced to obtain a second fingerprint image, wherein the fingerprint information contained in the second fingerprint image is the same as the total fingerprint information contained in the first fingerprint images;
[0008] Cropping the second fingerprint image to obtain a plurality of reference fingerprint images, the number of the reference fingerprint images being less than the number of the first fingerprint images, the total fingerprint information contained in each reference fingerprint image being the same as the fingerprint information contained in the second fingerprint image, and the area of a single reference fingerprint image being greater than the area of a single first fingerprint image;
[0009] Each reference fingerprint image is stored.
[0010] In a second aspect, an embodiment of the present application provides a fingerprint image processing device, comprising:
[0011] A receiving module, used for collecting a plurality of first fingerprint images belonging to the same object through a collection area, the area of the fingerprint collection area being smaller than a reference area threshold;
[0012] A splicing module, used for splicing the first fingerprint images according to the fingerprint features of the first fingerprint images to obtain a second fingerprint image, wherein the fingerprint information contained in the second fingerprint image is the same as the total fingerprint information contained in the first fingerprint images;
[0013] a cropping module, used to crop the second fingerprint image to obtain a plurality of reference fingerprint images, the number of the reference fingerprint images is less than the number of the first fingerprint images, the total fingerprint information contained in each reference fingerprint image is the same as the fingerprint information contained in the second fingerprint image, and the area of a single reference fingerprint image is greater than the area of a single first fingerprint image;
[0014] The storage module is used to store each reference fingerprint image.
[0015] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
[0016] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0017] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the steps of the method described in the first aspect.
[0018] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the steps of the method described in the first aspect.
[0019] The embodiment of the present application is aimed at an electronic device with a small fingerprint collection area. According to the fingerprint features of multiple first fingerprint images of the same object collected, each first fingerprint image can be spliced to obtain a second fingerprint image, and the fingerprint information contained in the second fingerprint image is the same as the total fingerprint information contained in each first fingerprint image; then the second fingerprint image is cropped to obtain multiple reference fingerprint images. While ensuring that the total fingerprint information contained in each reference fingerprint image is the same as the fingerprint information contained in the second fingerprint image, the number of reference fingerprint images is reduced. Therefore, when the fingerprint image actually collected is subsequently matched with each reference fingerprint image, the fingerprint recognition speed can be improved. Moreover, since the area of a single reference fingerprint image is larger than the area of a single first fingerprint image, the fingerprint information contained in a single reference fingerprint image will also be increased relative to the first fingerprint image. In this way, when fingerprint recognition is performed, the success rate of fingerprint recognition can be improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 A schematic diagram of a fingerprint image processing method provided in an embodiment of the present application;
[0021] Figure 2 A flowchart of a fingerprint image processing method provided in an embodiment of the present application;
[0022] Figure 3 A schematic diagram of a fingerprint collection area provided in an embodiment of the present application;
[0023] Figure 4 A flowchart of another fingerprint image processing method provided in an embodiment of the present application;
[0024] Figure 5 A flowchart of another fingerprint image processing method provided in an embodiment of the present application;
[0025] Figure 6 A schematic diagram of a candidate fingerprint image provided in an embodiment of the present application;
[0026] Figure 7 A schematic diagram of a combined fingerprint image provided in an embodiment of the present application;
[0027] Figure 8 A schematic diagram of the final position of a candidate fingerprint image provided in an embodiment of the present application;
[0028] Fig. 9 A schematic diagram of a reference fingerprint image provided in an embodiment of the present application;
[0029] Fig.10 A flowchart of another fingerprint image processing method provided in an embodiment of the present application;
[0030] Fig.11a A flowchart of another fingerprint image processing method provided in an embodiment of the present application;
[0031] Fig.11b A schematic diagram of another fingerprint image processing method provided in an embodiment of the present application;
[0032] Fig.12 A schematic diagram of the structure of a fingerprint image processing device provided in an embodiment of the present application;
[0033] Fig.13 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0034] Fig.14 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0035] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0036] The terms "first", "second", etc. in the specification of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are usually a class, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0037] When performing identity recognition or unlocking based on fingerprints, the actual collected fingerprints need to be matched with the stored fingerprint templates. Considering the cost issue, the area used to collect user fingerprints in current electronic devices is relatively small, which results in the area of the single fingerprint template image entered by the user and the fingerprint image actually collected in subsequent applications being relatively small, and the fingerprint feature information is relatively small, which will affect the success rate of fingerprint recognition. Moreover, since the area of a single fingerprint template image is small, more fingerprint template images are required to save more fingerprint information, and the increase in the number of fingerprint template images will result in longer fingerprint recognition time.
[0038] To this end, the present application embodiment provides a fingerprint image processing method, such as Figure 1As shown, a large fingerprint image 102 is obtained by splicing multiple small fingerprint images 101 entered by a user, and then the large fingerprint image 102 is cropped to obtain multiple medium fingerprint images 103, wherein the areas of the large fingerprint image 102, the medium fingerprint image 103, and the small fingerprint image 101 are successively reduced, and the number of medium fingerprint images 103 is less than the number of small fingerprint images 101. In this way, the technical problem of low success rate and efficiency of fingerprint recognition in related technologies when the area of the fingerprint collection area of the electronic device is small can be solved.
[0039] The fingerprint image processing method provided by the embodiment of the present application is described in detail below through specific embodiments and application scenarios in conjunction with the accompanying drawings.
[0040] The fingerprint image processing method provided in the embodiment of the present application can be applied to an electronic device with a fingerprint recognition function, in which the area for collecting fingerprints is small, that is, only part of the user's fingerprint information can be collected at a time.
[0041] The fingerprint image processing method provided in the embodiment of the present application can be applied to application scenarios such as identity recognition and unlocking.
[0042] Figure 2 A flowchart of a fingerprint image processing method provided in an embodiment of the present application is shown in FIG. Figure 2 As shown, the fingerprint image processing method may include the following steps:
[0043] S210: Collect multiple first fingerprint images belonging to the same object through the fingerprint collection area.
[0044] The area of the fingerprint collection area is smaller than the reference area threshold.
[0045] S220: According to the fingerprint features of the first fingerprint images, the first fingerprint images are spliced to obtain a second fingerprint image.
[0046] The fingerprint information included in the second fingerprint image is the same as the total fingerprint information included in each first fingerprint image.
[0047] S230: Crop the second fingerprint image to obtain multiple reference fingerprint images.
[0048] The number of reference fingerprint images is less than the number of first fingerprint images, the total fingerprint information contained in each reference fingerprint image is the same as the fingerprint information contained in the second fingerprint image, and the area of a single reference fingerprint image is larger than the area of a single first fingerprint image.
[0049] S240: Store each reference fingerprint image.
[0050] The embodiment of the present application is aimed at an electronic device with a small fingerprint collection area. According to the fingerprint features of multiple first fingerprint images of the same object collected, each first fingerprint image can be spliced to obtain a second fingerprint image, and the fingerprint information contained in the second fingerprint image is the same as the total fingerprint information contained in each first fingerprint image; then the second fingerprint image is cropped to obtain multiple reference fingerprint images. While ensuring that the total fingerprint information contained in each reference fingerprint image is the same as the fingerprint information contained in the second fingerprint image, the number of reference fingerprint images is reduced. Therefore, when the fingerprint image actually collected is subsequently matched with each reference fingerprint image, the fingerprint recognition speed can be improved. Moreover, since the area of a single reference fingerprint image is larger than the area of a single first fingerprint image, the fingerprint information contained in a single reference fingerprint image will also be increased relative to the first fingerprint image. In this way, when fingerprint recognition is performed, the success rate of fingerprint recognition can be improved.
[0051] The above steps are described in detail below:
[0052] In S210, the object here can be a person or an animal. The embodiment of the present application takes a person as an example.
[0053] The fingerprint collection area may be an area on the electronic device. The embodiment of the present application does not specifically limit the location of the fingerprint collection area. For example, the fingerprint collection area may be located on the side of the electronic device, or on the side of the electronic device facing the user, or on the side facing away from the user. A fingerprint sensor is provided in the fingerprint collection area, and the fingerprint sensor is used to collect the user's fingerprint. For example, the fingerprint sensor may be a capacitive fingerprint sensor, and the user may record the fingerprint by scratching or pressing the fingerprint collection area.
[0054] Figure 3 A schematic diagram of a fingerprint collection area is exemplarily listed, where the fingerprint collection area 302 is located at the side edge 301 of the electronic device 300. In the embodiment of the present application, the area of the fingerprint collection area 302 is smaller than the reference area threshold, that is, the fingerprint collection area 302 is a small-area fingerprint area, and the fingerprint image collected by the electronic device 300 through the fingerprint collection area 302 at a single time contains less feature information. The reference area threshold can be the area corresponding to most or all of the fingerprint information of the user that can be collected at a single time.
[0055] Since the fingerprint collection area 302 is a small fingerprint area, it is necessary to collect multiple fingerprint images of the user for subsequent fingerprint feature matching. Generally, it is necessary to collect about 20 fingerprint images.
[0056] The first fingerprint image is a fingerprint image entered by the user, also called a small fingerprint image. There are multiple first fingerprint images, and the multiple first fingerprint images belong to the same finger of the same user. Exemplarily, when the fingerprint entry process is started, the user can enter fingerprints of different areas of the same finger through the fingerprint collection area 302, so that the electronic device 300 can obtain multiple small fingerprint images entered by the user through the fingerprint collection area 302. The areas of the multiple small fingerprint images can be the same or different.
[0057] The embodiment of the present application does not limit the starting conditions of the fingerprint entry process. For example, the user can start the fingerprint entry process through voice, gesture, control, etc.
[0058] In S220, the second fingerprint image is a fingerprint image obtained by splicing the first fingerprint images and removing duplications. The second fingerprint image is also called a large fingerprint image. The fingerprint information contained in the second fingerprint image is the same as the total fingerprint information contained in the first fingerprint images. In this way, it can be ensured that the fingerprint information entered by the user is not lost, thereby improving the success rate of subsequent fingerprint recognition.
[0059] Since there are overlaps between the multiple first fingerprint images entered by the user, therefore, splicing the first fingerprint images while ensuring that the total fingerprint information is not lost is equivalent to deduplicating the first fingerprint images, that is, the area of the second fingerprint image is smaller than the total area obtained by directly adding all the first fingerprint images, which provides a basis for the subsequent re-cropping of the reference fingerprint image.
[0060] The embodiment of the present application does not limit the stitching process of each first fingerprint image. For example, the fingerprint features of each first fingerprint image can be extracted according to the feature point matching algorithm to obtain the feature points of each first fingerprint image, and then the first fingerprint images are matched according to the positions of the feature points to obtain the corresponding feature points in each first fingerprint image. Finally, the first fingerprint images are stitched together according to the matching results of the feature points, and finally, multiple first fingerprint images with scattered fingerprint features are stitched together according to the physical position relationship to obtain a second fingerprint image.
[0061] The feature point matching algorithm may adopt, for example, a Scale-Invariant Feature Transform (SIFT) algorithm, a Speeded Up Robust Features (SURF) algorithm, a feature detector and descriptor (Oriented FAST and Rotated BRIEF, ORB) algorithm, and the like.
[0062] In S230, considering that the second fingerprint image has high requirements on storage space and the processing capability of the electronic device for the fingerprint image, the second fingerprint image needs to be re-cropped.
[0063] The reference fingerprint image is a fingerprint image obtained by re-cropping the second fingerprint image. The reference fingerprint image can be used as a fingerprint template for subsequent fingerprint recognition. The reference fingerprint image is also called a middle fingerprint image, that is, the area of a single reference fingerprint image is larger than the area of a single first fingerprint image, but smaller than the area of the second fingerprint image.
[0064] The number of reference fingerprint images is less than the number of first fingerprint images, that is, the number of fingerprint templates is reduced, so that when the fingerprint image actually collected is subsequently matched with the fingerprint template for fingerprint recognition, the fingerprint recognition speed can be improved. The areas of different reference fingerprint images can be the same or different, and the embodiment of the present application does not limit the shape of the reference fingerprint image, for example, it can be an ellipse, a rectangle, etc.
[0065] The area of a single reference fingerprint image is larger than the area of a single first fingerprint image, that is, a single reference fingerprint image contains more fingerprint information, so that when the actual collected fingerprint image is subsequently matched with the fingerprint template, the success rate of fingerprint recognition can be improved.
[0066] The total fingerprint information contained in each reference fingerprint image is the same as the fingerprint information contained in the second fingerprint image, that is, each reference fingerprint image is the same as the total fingerprint information contained in multiple first fingerprint images entered by the user. In this way, the loss of fingerprint information entered by the user can be avoided and the quality of the reference fingerprint image is guaranteed.
[0067] The embodiment of the present application does not limit the specific cropping process, as long as it can be ensured that the number of reference fingerprint images is less than the number of first fingerprint images, and the total fingerprint information contained in each reference fingerprint image is the same as the fingerprint information contained in the second fingerprint image, and the area of a single reference fingerprint image is larger than the area of a single first fingerprint image.
[0068] In S240, after the electronic device obtains the reference fingerprint image, it can associate the reference fingerprint image with the identity of the user and save it. For example, multiple reference fingerprint images can be stored in a template library to provide a basis for subsequent fingerprint recognition.
[0069] After obtaining multiple small fingerprint images entered by the user, the embodiment of the present application can first splice the multiple small fingerprint images into a single large fingerprint image, and then re-crop them into multiple medium fingerprint images in a reasonable manner. While ensuring that the total fingerprint information remains unchanged, the number of medium fingerprint images is reduced and the fingerprint information of the medium fingerprint images is increased, which can improve the recognition speed and success rate of subsequent fingerprints.
[0070] Figure 4 A flowchart of another fingerprint image processing method provided in an embodiment of the present application, Figure 4 and Figure 2 The difference is that Figure 2 The S230 in the Figure 4 S410-S420 in.
[0071] S410: Obtain a space capacity threshold of a storage space occupied by a reference fingerprint image and a fingerprint recognition speed threshold of the reference fingerprint image.
[0072] The space capacity threshold here can be the maximum value of the total storage space that the electronic device allows the reference fingerprint image to occupy. The maximum value is related to the size of the total storage space of the electronic device, processing performance, etc. Different models of electronic devices may allow different total storage spaces for reference fingerprint images to occupy.
[0073] The fingerprint recognition speed threshold of the reference fingerprint image may be the minimum speed for successful fingerprint recognition, that is, when fingerprint recognition is performed subsequently, the speed at which the electronic device successfully recognizes the user's fingerprint cannot be less than the fingerprint recognition speed threshold.
[0074] The fingerprint recognition speed threshold can be flexibly determined according to the user. For example, the electronic device can obtain the user's acceptable recognition speed of the electronic device in advance, set the minimum recognition speed according to the user's acceptable recognition speed, and obtain the fingerprint recognition speed threshold. For another example, the electronic device can also obtain multiple user-accepted recognition speeds through big data, determine the recognition speed that meets the needs of most users based on the multiple recognition speeds, and then set the minimum recognition speed according to the recognition speed that meets the needs of most users to obtain the fingerprint recognition speed threshold.
[0075] The spatial capacity threshold and the fingerprint recognition speed threshold jointly determine the number and area of subsequent reference fingerprint images.
[0076] S420: Crop the second fingerprint image according to the space capacity threshold and the fingerprint recognition speed threshold to obtain a plurality of reference fingerprint images.
[0077] Exemplarily, the second fingerprint image and the acquired space capacity threshold and fingerprint recognition speed threshold may be input into an image cropping model to output a plurality of reference fingerprint images. The image cropping model may be a deep learning model.
[0078] Exemplarily, the number of reference fingerprint images and the area of a single reference fingerprint image can be determined based on the space capacity threshold and the fingerprint recognition speed threshold, and then the second fingerprint image can be cropped based on the number of reference fingerprint images and the area of a single reference fingerprint image to obtain multiple reference fingerprint images.
[0079] Taking the space capacity threshold as M and the fingerprint recognition speed threshold as V as an example, the number of reference fingerprint images and the area of a single reference fingerprint image can be determined according to the following two inequalities:
[0080] S*N≤M Formula (1)
[0081] N*k*S≥V Formula (2)
[0082] Among them, S is the area of a single reference fingerprint image, N is the number of reference fingerprint images, and the matching speed between a single reference fingerprint image and the subsequent actual collected fingerprint image is proportional to the area of the single reference fingerprint image, denoted as k*S, where k is the coefficient.
[0083] According to formula (1) and formula (2), appropriate S and N can be obtained, that is, the appropriate number of reference fingerprint images and the area of a single reference fingerprint image can be obtained.
[0084] The second fingerprint image can be cropped according to the number of reference fingerprint images determined above and the area of a single reference fingerprint image, as long as the total fingerprint information contained in the cropped reference fingerprint image is the same as the fingerprint information contained in the second fingerprint image.
[0085] The embodiment of the present application crops the second fingerprint image based on the space capacity threshold occupied by the reference fingerprint image and the fingerprint recognition speed threshold, thereby improving the fingerprint recognition speed and success rate while taking into account the storage performance of the electronic device and the user's requirements for fingerprint recognition speed.
[0086] Figure 5 A flowchart of another fingerprint image processing method provided in an embodiment of the present application, Figure 5 and Figure 4 The difference is that Figure 4 The S420 in can be refined into Figure 5 S510-S530 in.
[0087] S510: Determine the number of reference fingerprint images and the area of a single reference fingerprint image according to a space capacity threshold and a fingerprint recognition speed threshold.
[0088] The process of determining the number of reference fingerprint images and the area of a single reference fingerprint image can be found in Figure 4 For the sake of brevity, the illustrated embodiments are not described in detail here.
[0089] S520: Crop the second fingerprint image according to the number of reference fingerprint images and the area of a single reference fingerprint image to obtain a plurality of candidate fingerprint images.
[0090] The total fingerprint information included in each candidate fingerprint image is the same as the fingerprint information included in the second fingerprint image.
[0091] The candidate fingerprint image is a fingerprint image obtained by performing a primary cropping on the second fingerprint image, and the reference fingerprint image is a fingerprint image obtained by performing a secondary cropping on the second fingerprint image based on the candidate fingerprint image. In the embodiment of the present application, the number of candidate fingerprint images is the same as the number of reference fingerprint images, and the area of a single candidate fingerprint image is the same as the area of a corresponding single reference fingerprint image.
[0092] The fingerprint information contained in two adjacent candidate fingerprint images can be partially the same, that is, the two adjacent candidate fingerprint images can partially overlap. Of course, during actual cropping, the two adjacent candidate fingerprint images can also be made non-overlapping, in which case the fingerprint information contained in the two adjacent candidate fingerprint images is completely different.
[0093] Figure 6 Four schematic diagrams of candidate fingerprint images are listed as examples, namely Figure 6 Taking the example of cropping the second fingerprint image into four candidate fingerprint images, namely 601, 602, 603 and 604, and two adjacent candidate fingerprint images do not overlap, in actual application, the second fingerprint image can also be cropped into fewer or more candidate fingerprint images, and two adjacent candidate fingerprint images can also overlap.
[0094] S530: According to the fingerprint information of the second fingerprint image and the fingerprint information of each candidate fingerprint image, a reference fingerprint image corresponding to each candidate fingerprint image is cropped from the second fingerprint image.
[0095] Among them, the reference fingerprint image contains more fingerprint information than the corresponding candidate fingerprint image. Considering that adjacent candidate fingerprint images partially overlap during actual cropping, that is, there is part of the same fingerprint information between adjacent candidate fingerprint images, in order to maximize the fingerprint information of each reference fingerprint image, that is, to make each reference fingerprint image have as much fingerprint information as possible, and to improve the recognition speed of subsequent fingerprints, the embodiment of the present application can further re-crop the second fingerprint image according to the fingerprint information of the second fingerprint image and the fingerprint information of each candidate fingerprint image, and obtain a reference fingerprint image corresponding to each candidate fingerprint image, which can further improve the success rate of fingerprint recognition.
[0096] Exemplarily, the second fingerprint image and each candidate fingerprint image may be input into an image cropping model, and a re-cropped fingerprint image may be output as a reference fingerprint image.
[0097] Exemplarily, the second fingerprint image may also be re-cropped in the following manner:
[0098] Combining the candidate fingerprint images to obtain a combined fingerprint image, the area of the combined fingerprint image being the same as the total area of the candidate fingerprint images;
[0099] aligning the second fingerprint image with the combined fingerprint image according to the fingerprint information;
[0100] For each candidate fingerprint image in the aligned combined fingerprint image, the position of the candidate fingerprint image is updated based on the position information of the aligned second fingerprint image until the fingerprint position information of the candidate fingerprint image matches the fingerprint position information in the second fingerprint image; a fingerprint image containing the fingerprint information of the candidate fingerprint image and having the same area as the candidate fingerprint image is cropped from the aligned second fingerprint image as a reference fingerprint image corresponding to the candidate fingerprint image.
[0101] Exemplarily, the candidate fingerprint images may be combined according to the area maximization principle, that is, when combining two adjacent candidate fingerprint images, it is ensured that there is no overlap between the areas of the two adjacent candidate fingerprint images, and whether the fingerprint information in the two candidate fingerprint images overlaps is temporarily not considered. Figure 7 A schematic diagram of a combined fingerprint image is exemplified as follows: Figure 6 Taking the candidate fingerprint images shown as an example, the candidate fingerprint images are combined according to the principle of maximizing the area to obtain a combined fingerprint image 700. For ease of observation, the edges of the combined fingerprint image 700 are moved outward by a certain step length. In actual application, there is no gap between two adjacent candidate fingerprint images.
[0102] If the two cropped candidate fingerprint images contain part of the same fingerprint information, the area of the combined fingerprint image 700 obtained by the above combination method is larger than the area of the second fingerprint image. If any two cropped candidate fingerprint images do not contain the same fingerprint information, and the shapes are regular, and the areas of the candidate fingerprint images are the same, similar to Figure 6 For each fingerprint image shown, the area of the combined fingerprint image 700 obtained by the above combination method is equal to the area of the second fingerprint image.
[0103] In order to take into account the above situations, illustratively, after the combined fingerprint image 700 is obtained, the second fingerprint image and the combined fingerprint image 700 may be aligned according to the fingerprint information.
[0104] Then, based on the position information of the aligned second fingerprint image, the position of each candidate fingerprint image is moved until the fingerprint position information of the candidate fingerprint image matches the fingerprint position information in the second fingerprint image. At this time, a fingerprint image containing the fingerprint information of the candidate fingerprint image and having the same area as the candidate fingerprint image can be cropped from the aligned second fingerprint image as a reference fingerprint image corresponding to the candidate fingerprint image.
[0105] Among them, the fingerprint position information of the candidate fingerprint image matches the fingerprint position information in the second fingerprint image, which means that the fingerprint position information of the candidate fingerprint image is the same as the fingerprint position information in the second fingerprint image, and the fingerprint position information of the aligned second fingerprint image is exactly the same as that of the second fingerprint image before alignment.
[0106] Figure 8 The schematic diagram exemplarily lists the final positions of each candidate fingerprint image, wherein position A is the final position of candidate fingerprint image 601, position B is the final position of candidate fingerprint image 602, position C is the final position of candidate fingerprint image 603, and position D is the final position of candidate fingerprint image 604.
[0107] Crop the second fingerprint image according to the final position to get Fig. 9 The reference fingerprint image 901, the reference fingerprint image 902, the reference fingerprint image 903 and the reference fingerprint image 904 are shown, wherein the reference fingerprint image 901 has the same area as the candidate fingerprint image 601, the reference fingerprint image 902 has the same area as the candidate fingerprint image 602, the reference fingerprint image 903 has the same area as the candidate fingerprint image 603, and the reference fingerprint image 904 has the same area as the candidate fingerprint image 604. The total fingerprint information contained in the reference fingerprint image 901, the reference fingerprint image 902, the reference fingerprint image 903 and the reference fingerprint image 904 is the same as the fingerprint information contained in the second fingerprint image.
[0108] It can be seen from the reference fingerprint image 901 and the candidate fingerprint image 601 that the embodiment of the present application maximizes the fingerprint information of a single reference fingerprint image while ensuring that the total fingerprint information of each reference fingerprint image is not lost, thereby improving the matching success rate between a single reference fingerprint image and the actual collected fingerprint image.
[0109] When cropping the second fingerprint image, the embodiment of the present application first performs a preliminary cropping on the second fingerprint image according to the predetermined number of reference fingerprint images and the area of a single reference fingerprint image to obtain a candidate fingerprint image, and then re-crops the second fingerprint image based on the fingerprint information of the second fingerprint image and each candidate fingerprint image. While ensuring that the total fingerprint information is not lost, the fingerprint information of a single reference fingerprint image is maximized, thereby improving the success rate of fingerprint recognition.
[0110] Combine the following Figure 1 and one A specific example is used to illustrate the fingerprint image processing process provided in the embodiment of the present application.
[0111] Assume that the electronic device collects 20 fingerprint images of different areas of the right index finger of user A, that is, Figure 1 There are 20 small fingerprint images 101 in the image, and the 20 small fingerprint images 101 are spliced according to their fingerprint features to obtain a large fingerprint image 102. The fingerprint information contained in the large fingerprint image 102 is the same as the total fingerprint information contained in the 20 small fingerprint images 101.
[0112] Under the condition that the fingerprint information is not lost, the large fingerprint image 102 is cropped to obtain four medium fingerprint images 103 , the area of each medium fingerprint image 103 is larger than the area of each small fingerprint image 101 , and each medium fingerprint image 103 contains more fingerprint information than the single small fingerprint image 101 .
[0113] That is, by splicing and re-cropping, the originally collected 20 small fingerprint images 101 can be processed into 4 medium fingerprint images 103. In this way, the number of fingerprint templates is greatly reduced while ensuring that the fingerprint information is not lost, and the subsequent fingerprint recognition speed is improved. At the same time, the area of a single fingerprint template becomes larger, the fingerprint information increases, and the success rate of fingerprint recognition is significantly improved.
[0114] After obtaining the reference fingerprint image, feature extraction can be performed on the reference fingerprint image, and the fingerprint information of the reference fingerprint image can be extracted and saved to facilitate subsequent fingerprint recognition.
[0115] In some embodiments, fingerprint recognition can be applied to unlocking scenarios, that is, if fingerprint recognition is successful, the corresponding electronic device or an application in the electronic device is unlocked.
[0116] Fig.10 A flowchart of another fingerprint image processing method provided in an embodiment of the present application, Fig.10 and Figure 2 The difference is that Fig.10 Also includes S1001-S1003.
[0117] S1001: When the electronic device is in a locked state, the electronic device collects a third fingerprint image through a fingerprint collection area.
[0118] The third fingerprint image is a small-area fingerprint image collected by the electronic device.
[0119] S1002: The electronic device matches the third fingerprint image with a plurality of stored reference fingerprint images.
[0120] When performing fingerprint image matching, illustratively, fingerprint information of the third fingerprint image may be extracted, and then the fingerprint information may be matched one by one with the fingerprint information of the reference fingerprint image.
[0121] Exemplarily, the similarities between the third fingerprint image and each reference fingerprint image may be calculated respectively. The process of determining the similarities may refer to the related art and will not be described in detail here.
[0122] S1003: When the matching is successful, the electronic device performs an unlocking operation.
[0123] Exemplarily, if the fingerprint information of the third fingerprint image matches that of a reference fingerprint image for the most part, or the similarity between the third fingerprint image and a reference fingerprint image is greater than or equal to a similarity threshold, it is considered that the match is successful.
[0124] If the match is successful, the fingerprint recognition is considered successful, and the electronic device can perform an unlocking operation to release the lock state of the electronic device. For example, the lock state of the electronic device screen or the lock state of an application in the electronic device can be released.
[0125] Since the number of reference fingerprint images is reduced and the fingerprint information contained in a single reference fingerprint image is increased, the fingerprint recognition speed and success rate can be improved during fingerprint recognition, thereby improving the efficiency and success rate of unlocking.
[0126] Fig.11a A flowchart of another fingerprint image processing method provided in an embodiment of the present application, Fig.11a and Fig.10 The difference is that Fig.11a Also includes S1101-S1102.
[0127] S1101. Combine a third fingerprint image with a plurality of stored reference fingerprint images to obtain a fourth fingerprint image.
[0128] Considering that part of the fingerprint information contained in the third fingerprint image actually collected is not included in the reference fingerprint image, in order to maximize the fingerprint recognition speed and success rate, the electronic device can splice the successfully unlocked third fingerprint image with the stored multiple reference fingerprint images after each successful unlocking to obtain a fourth fingerprint image. The specific splicing process can be referred to the above embodiment, and for the sake of brevity, it will not be repeated here.
[0129] S1102: Crop the fourth fingerprint image to obtain a plurality of new reference fingerprint images.
[0130] The number of new reference fingerprint images is less than the number of first fingerprint images, the total fingerprint information contained in each new reference fingerprint image is the same as the fingerprint information contained in the fourth fingerprint image, and the area of a single new reference fingerprint image is greater than the area of a single first fingerprint image.
[0131] Similarly, after obtaining the fourth fingerprint image, the fourth fingerprint image can be cropped into multiple new reference fingerprint images for subsequent fingerprint recognition due to the storage performance and processing performance of the electronic device. The specific cropping process can be referred to the above embodiment, and will not be repeated here for the sake of brevity.
[0132] In the embodiment of the present application, after each successful unlocking, the small fingerprint image of the successful unlocking can be spliced with the stored reference fingerprint image, and the spliced fingerprint image can be re-cropped to obtain a new reference fingerprint image, thereby realizing dynamic updating of the reference fingerprint image and maximizing the fingerprint recognition speed and success rate.
[0133] For example, Fig.11b As shown, the template library stores four middle fingerprint images 103 corresponding to the right index finger of user A, where the middle fingerprint image 103 is also the reference fingerprint image obtained in the above embodiment. The third fingerprint image 1103 is the third fingerprint image corresponding to the successful unlocking, also called the small fingerprint image.
[0134] In actual applications, user A can unlock the electronic device with the index finger of his right hand. After successful unlocking, the electronic device can splice the collected third fingerprint image 1103 of user A with the four medium fingerprint images 103 in the template library to obtain a new large fingerprint image 1104, that is, the fourth fingerprint image. The specific splicing process can refer to the above embodiment.
[0135] The new large fingerprint image 1104 can be re-cropped to obtain a new medium fingerprint image 1105. At this time, the medium fingerprint image 103 in the template library can be updated to the new medium fingerprint image 1105 to save storage space of the electronic device. The number and area of the new medium fingerprint image 1105 can be the same as the number and area of the medium fingerprint image 103. The re-cropping process can refer to the above embodiment.
[0136] It should be noted that the fingerprint image processing method provided in the embodiment of the present application can be executed by a fingerprint image processing device, or a processing module in the fingerprint image processing device for executing the fingerprint image processing method. In the embodiment of the present application, the fingerprint image processing device provided in the embodiment of the present application is described by taking the fingerprint image processing method executed by the fingerprint image processing device as an example.
[0137] Fig.12 A schematic diagram of the structure of a fingerprint image processing device provided in an embodiment of the present application.
[0138] like Fig.12 As shown, the fingerprint image processing device 1200 may include:
[0139] A collection module 1201 is used to collect multiple first fingerprint images belonging to the same object through a fingerprint collection area, and the area of the fingerprint collection area is smaller than a reference area threshold;
[0140] A splicing module 1202, configured to splice the first fingerprint images according to the fingerprint features of the first fingerprint images to obtain a second fingerprint image, wherein the fingerprint information contained in the second fingerprint image is the same as the total fingerprint information contained in the first fingerprint images;
[0141] A cropping module 1203 is used to crop the second fingerprint image to obtain multiple reference fingerprint images, the number of the reference fingerprint images is less than the number of the first fingerprint images, the total fingerprint information contained in each reference fingerprint image is the same as the fingerprint information contained in the second fingerprint image, and the area of a single reference fingerprint image is greater than the area of a single first fingerprint image;
[0142] The storage module 1204 is used to store each reference fingerprint image.
[0143] The embodiment of the present application is aimed at an electronic device with a small fingerprint collection area. According to the fingerprint features of multiple first fingerprint images of the same object collected, each first fingerprint image can be spliced to obtain a second fingerprint image, and the fingerprint information contained in the second fingerprint image is the same as the total fingerprint information contained in each first fingerprint image; then the second fingerprint image is cropped to obtain multiple reference fingerprint images. While ensuring that the total fingerprint information contained in each reference fingerprint image is the same as the fingerprint information contained in the second fingerprint image, the number of reference fingerprint images is reduced. Therefore, when the fingerprint image actually collected is subsequently matched with each reference fingerprint image, the fingerprint recognition speed can be improved. Moreover, since the area of a single reference fingerprint image is larger than the area of a single first fingerprint image, the fingerprint information contained in a single reference fingerprint image will also be increased relative to the first fingerprint image. In this way, when fingerprint recognition is performed, the success rate of fingerprint recognition can be improved.
[0144] In some possible implementations of the embodiments of the present application, the fingerprint image processing device 1200 may further include:
[0145] An acquisition module, used to acquire a space capacity threshold of a storage space occupied by a reference fingerprint image and a fingerprint recognition speed threshold of the reference fingerprint image;
[0146] The cutting module 1203 is specifically used for:
[0147] The second fingerprint image is cropped according to the space capacity threshold and the fingerprint recognition speed threshold to obtain a plurality of reference fingerprint images.
[0148] In some possible implementations of the embodiments of the present application, the cropping module 1203 is specifically configured to:
[0149] Determine the number of reference fingerprint images and the area of a single reference fingerprint image according to the capacity threshold and the fingerprint recognition speed threshold;
[0150] According to the number of reference fingerprint images and the area of a single reference fingerprint image, the second fingerprint image is cropped to obtain a plurality of candidate fingerprint images, wherein the total fingerprint information contained in each candidate fingerprint image is the same as the fingerprint information contained in the second fingerprint image;
[0151] According to the fingerprint information of the second fingerprint image and the fingerprint information of each candidate fingerprint image, a reference fingerprint image corresponding to each candidate fingerprint image is cropped from the second fingerprint image, and the reference fingerprint image contains more fingerprint information than the fingerprint information of the corresponding candidate fingerprint image.
[0152] In some possible implementations of the embodiments of the present application, the cropping module 1203 is specifically configured to:
[0153] Combining the candidate fingerprint images to obtain a combined fingerprint image, the area of the combined fingerprint image being the same as the total area of the candidate fingerprint images;
[0154] aligning the second fingerprint image with the combined fingerprint image according to the fingerprint information;
[0155] For each candidate fingerprint image in the aligned combined fingerprint image, the position of the candidate fingerprint image is updated based on the position information of the aligned second fingerprint image until the fingerprint position information contained in the candidate fingerprint image matches the fingerprint position information in the second fingerprint image; a fingerprint image containing the fingerprint information of the candidate fingerprint image and having the same area as the candidate fingerprint image is cropped from the aligned second fingerprint image as a reference fingerprint image corresponding to the candidate fingerprint image.
[0156] In some possible implementations of the embodiments of the present application, the acquisition module 1201 is further configured to acquire a third fingerprint image through the fingerprint acquisition area when the electronic device is in a locked state after the storage module 1204 stores each reference fingerprint image;
[0157] The fingerprint image processing device 1200 may further include:
[0158] a matching module, configured to match the third fingerprint image with a plurality of stored reference fingerprint images;
[0159] The unlocking module is used to perform the unlocking operation when the matching is successful.
[0160] In some possible implementations of the embodiments of the present application, the stitching module 1202 is further configured to stitch the third fingerprint image with the plurality of stored reference fingerprint images to obtain a fourth fingerprint image after the unlocking module performs the unlocking operation;
[0161] The cropping module 1203 is further used to crop the fourth fingerprint image to obtain multiple new reference fingerprint images, the number of new reference fingerprint images is less than the number of first fingerprint images, the total fingerprint information contained in each new reference fingerprint image is the same as the fingerprint information contained in the fourth fingerprint image, and the area of a single new reference fingerprint image is larger than the area of a single first fingerprint image.
[0162] After obtaining multiple small fingerprint images entered by the user, the embodiment of the present application can first splice the multiple small fingerprint images into a single large fingerprint image, and then reasonably crop them into multiple medium fingerprint images. While ensuring that the total fingerprint information remains unchanged, the number of medium fingerprint images is reduced and the fingerprint information of the medium fingerprint images is increased, which can improve the recognition speed and success rate of subsequent fingerprints. Moreover, during the unlocking process, the reference fingerprint image can also be dynamically updated according to the fingerprint image that is successfully unlocked, maximizing the recognition speed and success rate of fingerprints.
[0163] The fingerprint image processing device in the embodiment of the present application can be a device, or a component in an electronic device, such as an integrated circuit or a chip. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a user computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.
[0164] The electronic device in the embodiment of the present application may be a terminal with an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0165] The fingerprint image processing device provided in the embodiment of the present application can achieve Figures 1 to 11b The various processes in the fingerprint image processing method embodiment can achieve the same technical effect, and to avoid repetition, they will not be described here.
[0166] like Fig.13 As shown, the embodiment of the present application also provides an electronic device 1300, including a processor 1301 and a memory 1302, the memory 1302 stores a program or instruction that can be executed on the processor 1301, and when the program or instruction is executed by the processor 1301, the various steps of the above-mentioned fingerprint image processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0167] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile terminals and non-mobile terminals.
[0168] Fig.14 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.
[0169] The electronic device 1400 includes but is not limited to: a radio frequency unit 1401, a network module 1402, an audio output unit 1403, an input unit 1404, a sensor 1405, a display unit 1406, a user input unit 1407, an interface unit 1408, a memory 1409, and a processor 1410 and other components.
[0170] Those skilled in the art will appreciate that the electronic device 1400 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1410 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.14 The structure of the electronic device 1400 shown in the figure does not constitute a limitation on the electronic device 1400. The electronic device 1400 may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0171] The processor 1410 is used to collect multiple first fingerprint images belonging to the same object through the fingerprint collection area, and the area of the fingerprint collection area is smaller than the reference area threshold;
[0172] According to the fingerprint features of the first fingerprint images, the first fingerprint images are spliced to obtain a second fingerprint image, wherein the fingerprint information contained in the second fingerprint image is the same as the total fingerprint information contained in the first fingerprint images;
[0173] Cropping the second fingerprint image to obtain a plurality of reference fingerprint images, the number of the reference fingerprint images being less than the number of the first fingerprint images, the total fingerprint information contained in each reference fingerprint image being the same as the fingerprint information contained in the second fingerprint image, and the area of a single reference fingerprint image being greater than the area of a single first fingerprint image;
[0174] Each reference fingerprint image is stored.
[0175] The embodiment of the present application is aimed at an electronic device with a small fingerprint collection area. According to the fingerprint features of multiple first fingerprint images of the same object collected, each first fingerprint image can be spliced to obtain a second fingerprint image, and the fingerprint information contained in the second fingerprint image is the same as the total fingerprint information contained in each first fingerprint image; then the second fingerprint image is cropped to obtain multiple reference fingerprint images. While ensuring that the total fingerprint information contained in each reference fingerprint image is the same as the fingerprint information contained in the second fingerprint image, the number of reference fingerprint images is reduced. Therefore, when the fingerprint image actually collected is subsequently matched with each reference fingerprint image, the fingerprint recognition speed can be improved. Moreover, since the area of a single reference fingerprint image is larger than the area of a single first fingerprint image, the fingerprint information contained in a single reference fingerprint image will also be increased relative to the first fingerprint image. In this way, when fingerprint recognition is performed, the success rate of fingerprint recognition can be improved.
[0176] In some possible implementations of the embodiments of the present application, the processor 1410 is specifically configured to:
[0177] Obtaining a space capacity threshold of a storage space occupied by a reference fingerprint image and a fingerprint recognition speed threshold of the reference fingerprint image;
[0178] The second fingerprint image is cropped according to the space capacity threshold and the fingerprint recognition speed threshold to obtain a plurality of reference fingerprint images.
[0179] In some possible implementations of the embodiments of the present application, the processor 1410 is specifically configured to:
[0180] Determine the number of reference fingerprint images and the area of a single reference fingerprint image according to the space capacity threshold and the fingerprint recognition speed threshold;
[0181] According to the number of reference fingerprint images and the area of a single reference fingerprint image, the second fingerprint image is cropped to obtain a plurality of candidate fingerprint images, wherein the total fingerprint information contained in each candidate fingerprint image is the same as the fingerprint information contained in the second fingerprint image;
[0182] According to the fingerprint information of the second fingerprint image and the fingerprint information of each candidate fingerprint image, a reference fingerprint image corresponding to each candidate fingerprint image is cropped from the second fingerprint image, and the reference fingerprint image contains more fingerprint information than the fingerprint information of the corresponding candidate fingerprint image.
[0183] In some possible implementations of the embodiments of the present application, the processor 1410 is specifically configured to:
[0184] Combining the candidate fingerprint images to obtain a combined fingerprint image, the area of the combined fingerprint image being the same as the total area of the candidate fingerprint images;
[0185] aligning the second fingerprint image with the combined fingerprint image according to the fingerprint information;
[0186] For each candidate fingerprint image in the aligned combined fingerprint image, the position of the candidate fingerprint image is updated based on the position information of the aligned second fingerprint image until the fingerprint position information contained in the candidate fingerprint image matches the fingerprint position information in the second fingerprint image; a fingerprint image containing the fingerprint information of the candidate fingerprint image and having the same area as the candidate fingerprint image is cropped from the aligned second fingerprint image as a reference fingerprint image corresponding to the candidate fingerprint image.
[0187] In some possible implementations of the embodiments of the present application, the processor 1410 is further configured to, after storing each reference fingerprint image, collect a third fingerprint image through the fingerprint collection area when the electronic device is in a locked state;
[0188] matching the third fingerprint image with a plurality of stored reference fingerprint images;
[0189] If the matching is successful, the unlocking operation is performed.
[0190] In some possible implementations of the embodiments of the present application, the processor 1410 is further configured to, after performing the unlocking operation, splice the third fingerprint image with the plurality of stored reference fingerprint images to obtain a fourth fingerprint image;
[0191] The fourth fingerprint image is cropped to obtain multiple new reference fingerprint images, the number of new reference fingerprint images is less than the number of first fingerprint images, the total fingerprint information contained in each new reference fingerprint image is the same as the fingerprint information contained in the fourth fingerprint image, and the area of a single new reference fingerprint image is larger than the area of a single first fingerprint image.
[0192] After obtaining multiple small fingerprint images entered by the user, the embodiment of the present application can first splice the multiple small fingerprint images into a single large fingerprint image, and then reasonably crop them into multiple medium fingerprint images. While ensuring that the total fingerprint information remains unchanged, the number of medium fingerprint images is reduced and the fingerprint information of the medium fingerprint images is increased, which can improve the recognition speed and success rate of subsequent fingerprints. Moreover, during the unlocking process, the reference fingerprint image can also be dynamically updated according to the fingerprint image that is successfully unlocked, maximizing the recognition speed and success rate of fingerprints.
[0193] It should be understood that in the embodiment of the present application, the input unit 1404 may include a graphics processor (Graphics Processing Unit, GPU) 14041 and a microphone 14042, and the graphics processor 14041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1406 may include a display panel 14061, and the display panel 14061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1407 includes a touch panel 14071 and at least one of other input devices 14072. The touch panel 4071 is also called a touch screen. The touch panel 14071 may include two parts: a touch detection device and a touch controller. Other input devices 14072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0194] The memory 1409 can be used to store software programs and various data. The memory 1409 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1409 may include a volatile memory or a non-volatile memory, or the memory 1409 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1409 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0195] The processor 1410 may include one or more processing units; optionally, the processor 1410 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1410.
[0196] The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned fingerprint image processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0197] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0198] The embodiment of the present application further provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned fingerprint image processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0199] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0200] The embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the fingerprint image processing method embodiment as described above, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0201] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0202] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0203] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. A method for processing a fingerprint image, characterized in that: include: Collecting a plurality of first fingerprint images belonging to the same object through a fingerprint collection area, wherein the area of the fingerprint collection area is smaller than a reference area threshold; splicing the first fingerprint images according to the fingerprint features of the first fingerprint images to obtain a second fingerprint image, wherein the fingerprint information contained in the second fingerprint image is the same as the total fingerprint information contained in the first fingerprint images; Cropping the second fingerprint image to obtain a plurality of reference fingerprint images, the number of the reference fingerprint images being less than the number of the first fingerprint images, the total fingerprint information contained in each of the reference fingerprint images being the same as the fingerprint information contained in the second fingerprint image, and the area of a single reference fingerprint image being greater than the area of a single first fingerprint image; Each of the reference fingerprint images is stored.
2. The method according to claim 1, characterized in that The step of cropping the second fingerprint image to obtain a plurality of reference fingerprint images includes: Acquire a space capacity threshold of a storage space occupied by the reference fingerprint image and a fingerprint recognition speed threshold of the reference fingerprint image; The second fingerprint image is cropped according to the space capacity threshold and the fingerprint recognition speed threshold to obtain a plurality of reference fingerprint images.
3. The method according to claim 2, characterized in that The step of cropping the second fingerprint image according to the space capacity threshold and the fingerprint recognition speed threshold to obtain a plurality of reference fingerprint images includes: Determining the number of reference fingerprint images and the area of a single reference fingerprint image according to the space capacity threshold and the fingerprint recognition speed threshold; According to the number of the reference fingerprint images and the area of a single reference fingerprint image, the second fingerprint image is cropped to obtain a plurality of candidate fingerprint images, wherein the total fingerprint information contained in each of the candidate fingerprint images is the same as the fingerprint information contained in the second fingerprint image; According to the fingerprint information of the second fingerprint image and the fingerprint information of each candidate fingerprint image, a reference fingerprint image corresponding to each candidate fingerprint image is cropped from the second fingerprint image, and the reference fingerprint image contains more fingerprint information than the fingerprint information of the corresponding candidate fingerprint image.
4. The method according to claim 3, characterized in that The step of cropping a reference fingerprint image corresponding to each of the candidate fingerprint images from the second fingerprint image according to the fingerprint information of the second fingerprint image and the fingerprint information of each of the candidate fingerprint images comprises: Combining the candidate fingerprint images to obtain a combined fingerprint image, wherein the area of the combined fingerprint image is the same as the total area of the candidate fingerprint images; aligning the second fingerprint image with the combined fingerprint image according to the fingerprint information; For each candidate fingerprint image in the aligned combined fingerprint image, based on the position information of the aligned second fingerprint image, updating the position of the candidate fingerprint image until the fingerprint position information of the candidate fingerprint image matches the fingerprint position information in the second fingerprint image; A fingerprint image containing the fingerprint information of the candidate fingerprint image and having the same area as that of the candidate fingerprint image is cropped from the aligned second fingerprint image as a reference fingerprint image corresponding to the candidate fingerprint image.
5. The method according to any one of claims 1 to 4, characterized in that: After storing each of the reference fingerprint images, the method further includes: When the electronic device is in a locked state, the electronic device collects a third fingerprint image through the fingerprint collection area; The electronic device matches the third fingerprint image with the plurality of stored reference fingerprint images; When the matching is successful, the electronic device performs an unlocking operation.
6. The method according to claim 5, characterized in that After performing the unlocking operation, the method further includes: splicing the third fingerprint image with the plurality of stored reference fingerprint images to obtain a fourth fingerprint image; The fourth fingerprint image is cropped to obtain multiple new reference fingerprint images, the number of the new reference fingerprint images is less than the number of the first fingerprint images, the total fingerprint information contained in each of the new reference fingerprint images is the same as the fingerprint information contained in the fourth fingerprint image, and the area of a single new reference fingerprint image is larger than the area of a single first fingerprint image.
7. A fingerprint image processing device, characterized in that: include: A receiving module, configured to collect a plurality of first fingerprint images belonging to the same object through a fingerprint collection area, wherein the area of the fingerprint collection area is smaller than a reference area threshold; a splicing module, configured to splice the first fingerprint images according to the fingerprint features of the first fingerprint images to obtain a second fingerprint image, wherein the fingerprint information contained in the second fingerprint image is the same as the total fingerprint information contained in the first fingerprint images; a cropping module, configured to crop the second fingerprint image to obtain a plurality of reference fingerprint images, wherein the number of the reference fingerprint images is less than the number of the first fingerprint images, the total fingerprint information contained in each of the reference fingerprint images is the same as the fingerprint information contained in the second fingerprint image, and the area of a single reference fingerprint image is greater than the area of a single first fingerprint image; A storage module is used to store each of the reference fingerprint images.
8. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
10. A computer program product, characterized in that The program product is stored in a storage medium, and the program product is executed by at least one processor to implement the steps of the method according to any one of claims 1 to 6.