Fingerprint template update method and apparatus, and electronic device

Abstract

The embodiments of the present disclosure provide a fingerprint template update method and apparatus, and an electronic device. The fingerprint template update method comprises: obtaining a fingerprint image generated by a fingerprint sensor on the basis of an input fingerprint of a user, and determining whether or not a matching relationship is present between the fingerprint image and a fingerprint template in a fingerprint template library; if a matching relationship is present between the fingerprint image and the fingerprint template, on the basis of the matching relationship, using fingerprint feature information of the fingerprint image to perform fingerprint feature expansion on the fingerprint template; and updating the fingerprint template library with the fingerprint template that has undergone fingerprint feature expansion. The embodiments of the present disclosure enable effective expansion of baseline fingerprint feature information of fingerprint templates in a fingerprint template library, thereby effectively improving fingerprint recognition performance and accuracy and enhancing user experience.

Description

Fingerprint template updating method, device and electronic device

[0001] This disclosure claims priority to Chinese patent application number 2024102169018, filed with the China Patent Office on February 27, 2024, entitled “Fingerprint Template Updating Method, Device and Electronic Device,” the entire contents of which are incorporated herein by reference. Technical Field

[0002] The present disclosure relates to the field of fingerprint recognition technology, and in particular to a fingerprint template updating method, device, and electronic device. Background Art

[0003] In recent years, with the widespread adoption of mobile electronic devices such as smartphones, fingerprint recognition technology, a fundamental feature of mobile electronic devices, has become increasingly widespread. Users can use the fingerprint sensor on these devices to enter their fingerprint for identity verification. Generally speaking, during the registration phase, a mobile electronic device generates a fingerprint template based on the user's fingerprint entered via the fingerprint sensor. During the subsequent authentication phase, the user's currently entered fingerprint image is compared with the fingerprint template to determine whether the current user is legitimate.

[0004] Typically, a fingerprint sensor can be set below the front screen, on the back, or on the side of a mobile electronic device. Side fingerprint recognition solutions have rapidly developed in the field of mobile electronic devices due to their low cost, convenience, and screen-friendliness. However, in side fingerprint recognition solutions, due to the limited space on the side of the frame of a mobile electronic device, the fingerprint sensor needs to be designed to be relatively narrow, resulting in the fingerprint data it collects each time being only narrow, local data of the finger. Therefore, during the fingerprint registration phase, the fingerprint sensor can only collect very limited data to generate a fingerprint template each time the user presses to enter. Since the above-mentioned fingerprint template does not contain enough valid fingerprint information, using the fingerprint template to provide baseline fingerprint feature information for matching and verification during the identity verification phase may result in the fingerprint of the legitimate user not being recognized normally, thereby affecting the fingerprint recognition performance and reducing the user experience. Summary of the Invention

[0005] In view of this, embodiments of the present disclosure provide a fingerprint template updating method, device, and electronic device that can solve the above-mentioned problems.

[0006] According to one aspect of an embodiment of the present disclosure, a fingerprint template generation method is provided, comprising: obtaining a fingerprint image generated by a fingerprint sensor based on a user's input fingerprint, and determining whether there is a matching relationship between the fingerprint image and one of the fingerprint templates in a fingerprint template library; if there is a matching relationship between the fingerprint image and the fingerprint template, based on the matching relationship between the two, performing fingerprint feature expansion on the fingerprint template using fingerprint feature information of the fingerprint image; and updating the fingerprint template after the fingerprint feature expansion to the fingerprint template library.

[0007] Optionally, the step of expanding the fingerprint features of the fingerprint template using the fingerprint feature information of the fingerprint image includes: splicing the fingerprint image and the fingerprint template according to the overlapping area between the two, wherein the overlapping area refers to the area where the fingerprint feature information between the fingerprint image and the fingerprint template has a mutual correspondence; adding the fingerprint feature information of the fingerprint image to the fingerprint template so that the fingerprint template after fingerprint feature expansion has the fingerprint feature information of the non-overlapping area in the fingerprint image.

[0008] Optionally, the step of using the fingerprint feature information of the fingerprint image to expand the fingerprint feature of the fingerprint template includes: using the fingerprint feature information of the fingerprint image and the fingerprint feature information of the fingerprint template to expand the fingerprint features of the fingerprint template and the fingerprint image respectively, so that the fingerprint template after the fingerprint feature expansion has the fingerprint feature information of the non-overlapping area in the fingerprint image, and the fingerprint image after the fingerprint feature expansion has the fingerprint feature information of the non-overlapping area in the fingerprint template.

[0009] Optionally, the fingerprint template updating method further comprises: traversing other fingerprint templates in the fingerprint template library, and using the fingerprint feature information of the fingerprint image to perform fingerprint feature expansion on other fingerprint templates that have a matching relationship with the fingerprint image.

[0010] Optionally, the above-mentioned fingerprint template updating method also includes: when expanding the fingerprint features of each fingerprint template that has a matching relationship with the fingerprint image, the fingerprint feature information of each fingerprint template that has a matching relationship is used to expand the fingerprint features of the fingerprint image, so that the fingerprint feature information of the fingerprint image is iteratively updated multiple times when traversing the fingerprint template library.

[0011] Optionally, the step of updating the fingerprint template that has been expanded with fingerprint features to the fingerprint template library includes: after traversing all fingerprint templates in the fingerprint template library, synchronously updating each fingerprint template in the fingerprint template library that has a matching relationship with the fingerprint image and has been expanded with fingerprint features to the fingerprint template library; generating a new fingerprint template based on the fingerprint feature information of the fingerprint image and adding it to the fingerprint template library or replacing one of the fingerprint templates originally stored in the fingerprint template library; wherein the new fingerprint template includes the original fingerprint feature information of the fingerprint image, or also includes the fingerprint feature information of the fingerprint image after the fingerprint feature is expanded with each fingerprint template that has a matching relationship in the fingerprint template library.

[0012] Optionally, the above-mentioned fingerprint template updating method is applied in the fingerprint registration stage, and further includes: after updating the fingerprint template that has undergone fingerprint feature expansion to the fingerprint template library, re-acquiring another fingerprint image generated by the fingerprint sensor based on the user's input fingerprint, and traversing the fingerprint templates in the fingerprint template library again to determine the matching relationship between the another fingerprint image and the fingerprint templates in the fingerprint template library, and correspondingly performing fingerprint feature expansion between the another fingerprint image and each fingerprint template with a matching relationship.

[0013] Optionally, the above-mentioned fingerprint template updating method also includes: after obtaining the fingerprint image generated by the fingerprint sensor based on the user's input fingerprint, if the current fingerprint template library does not store a fingerprint template, or if the fingerprint feature information of the fingerprint image does not have a matching relationship with any fingerprint template in the fingerprint template library, directly using the fingerprint feature information of the fingerprint image as a new fingerprint template to add it to the fingerprint template library.

[0014] Optionally, the above-mentioned fingerprint template update method is applied in the fingerprint registration stage, and also includes: when it is determined that there is a matching relationship between the fingerprint image and the fingerprint template, determining that the user's identity authentication is passed and executing the corresponding function; judging whether it is necessary to start the fingerprint template self-learning function based on the fingerprint image, and expanding the fingerprint features of the fingerprint template when it is determined that the fingerprint template self-learning function needs to be started.

[0015] According to another aspect of an embodiment of the present disclosure, a fingerprint template updating device is provided, comprising: an acquisition module, configured to acquire a fingerprint image generated by a fingerprint sensor based on a user's input fingerprint, and extract fingerprint feature information of the fingerprint image; a judgment module, configured to judge, based on the fingerprint feature information of the fingerprint image, whether there is a matching relationship between the fingerprint image and one of the fingerprint templates in a fingerprint template library; a fingerprint feature expansion module, configured to, when there is a matching relationship between the fingerprint image and the fingerprint template, perform fingerprint feature expansion on the fingerprint template based on the matching relationship between the two using the fingerprint feature information of the fingerprint image; and a fingerprint template updating module, configured to update the fingerprint template after the fingerprint feature expansion to the fingerprint template library.

[0016] Optionally, the fingerprint feature expansion module includes: a fingerprint template splicing unit, used to splice the fingerprint image and the fingerprint template according to the overlapping area between the two, wherein the overlapping area refers to the area where the fingerprint feature information between the fingerprint image and the fingerprint template has a mutual correspondence; a fingerprint information adding unit, adding the fingerprint feature information of the fingerprint image to the fingerprint template, so that the fingerprint template after fingerprint feature expansion has the fingerprint feature information of the non-overlapping area in the fingerprint image.

[0017] Optionally, the fingerprint feature expansion module includes: a fingerprint template splicing unit, used to splice the fingerprint image and the fingerprint template according to the overlapping area between the two, wherein the overlapping area refers to the area where the fingerprint feature information between the fingerprint image and the fingerprint template has a mutual correspondence; a fingerprint information adding unit, used to use the fingerprint feature information of the fingerprint image and the fingerprint feature information of the fingerprint template to respectively expand the fingerprint features of the fingerprint template and the fingerprint image, so as to add the fingerprint feature information of the non-overlapping area in the fingerprint image to the fingerprint template, and add the fingerprint feature information of the non-overlapping area in the fingerprint template to the fingerprint image.

[0018] Optionally, the judgment module is further used to traverse other fingerprint templates in the fingerprint template library, and judge whether the fingerprint image has a matching relationship with other fingerprint templates in the fingerprint template library based on the fingerprint feature information of the fingerprint image; the fingerprint feature expansion module is further used to use the fingerprint feature information of the fingerprint image to expand the fingerprint features of other fingerprint templates with a matching relationship when the judgment module determines that the fingerprint image has a matching relationship with other fingerprint templates.

[0019] Optionally, the fingerprint feature expansion module is further used to, when performing fingerprint feature expansion on each fingerprint template that has a matching relationship with the fingerprint image, respectively use the fingerprint feature information of each fingerprint template that has a matching relationship to perform mutual fingerprint feature expansion on the fingerprint image, so that the fingerprint feature information of the fingerprint image is iteratively updated multiple times when traversing the fingerprint template library.

[0020] Optionally, the fingerprint template updating module includes: a template updating unit, which is used to synchronously update each fingerprint template in the fingerprint template library that has a matching relationship with the fingerprint image and has been expanded with fingerprint features into the fingerprint template library after traversing all fingerprint templates in the fingerprint template library using the fingerprint feature information of the fingerprint image; a template generating unit, which is used to generate a new fingerprint template based on the fingerprint feature information of the fingerprint image and add it to the fingerprint template library or replace one of the fingerprint templates originally stored in the fingerprint template library; wherein the new fingerprint template includes the original fingerprint feature information of the fingerprint image, or also includes the fingerprint feature information of the fingerprint image after the fingerprint feature is expanded with each fingerprint template in the fingerprint template library that has a matching relationship.

[0021] According to another aspect of the embodiments of the present disclosure, another fingerprint template generation method is provided, including: obtaining a fingerprint image generated by a fingerprint sensor based on a user's input fingerprint, and extracting fingerprint feature information of the fingerprint image; selecting a first fingerprint template from a fingerprint template library, and judging whether there is a matching relationship between the fingerprint image and the first fingerprint template based on the fingerprint feature information of the fingerprint image and the reference fingerprint feature information of the first fingerprint template; when there is a matching relationship between the fingerprint image and the first fingerprint template, performing fingerprint feature expansion on the first fingerprint template using the fingerprint feature information of the fingerprint image, and performing a first fingerprint feature expansion on the fingerprint image using the reference fingerprint feature information of the first fingerprint template to obtain a first updated fingerprint image.

[0022] Optionally, the above-mentioned fingerprint template updating method also includes: selecting a second fingerprint template from the fingerprint template library, and determining whether the fingerprint image has the preset matching relationship with the second fingerprint template; when the fingerprint image and the second fingerprint template have the preset matching relationship, using the fingerprint feature information of the first updated fingerprint image to expand the fingerprint features of the second fingerprint template, and using the fingerprint feature information of the second fingerprint template to expand the fingerprint features of the first updated fingerprint image for a second time to obtain a second updated fingerprint image.

[0023] According to another aspect of the embodiments of the present disclosure, an electronic device is provided, including a fingerprint sensor for collecting a user's input fingerprint and generating a corresponding fingerprint image; a processing unit, connected to the fingerprint sensor, for obtaining the fingerprint image from the fingerprint sensor, determining whether there is a matching relationship between the fingerprint image and a fingerprint template in a fingerprint template library; when the two have a matching relationship, performing fingerprint feature expansion on the fingerprint template based on the matching relationship and using fingerprint feature information of the fingerprint image, and updating the fingerprint template with the expanded fingerprint features to the fingerprint template library.

[0024] According to another aspect of the embodiments of the present disclosure, an electronic device is provided, including: a processor; and a memory storing a program, wherein the program includes instructions, and when the instructions are executed by the processor, the processor executes the method of the above embodiment.

[0025] According to yet another aspect of the embodiments of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable a computer to execute the method of the above embodiments.

[0026] One or more technical solutions provided in the embodiments of the present disclosure can utilize the fingerprint feature information carried in the fingerprint image generated by the user's fingerprint press input to expand the fingerprint features of the fingerprint templates in the fingerprint template library, thereby effectively expanding the coverage area of ​​the fingerprint template and increasing the baseline fingerprint feature information in the fingerprint template, effectively improving fingerprint recognition performance and fingerprint recognition accuracy. Even in application scenarios where the fingerprint sensor's sensing area is small, the fingerprint feature information in the fingerprint templates registered in the fingerprint template library can be enriched, increasing the success rate of fingerprint verification for legitimate users and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Further details, features and advantages of the present disclosure are disclosed in the following description of exemplary embodiments in conjunction with the accompanying drawings, in which:

[0028] FIG1A shows a schematic diagram of an electronic device that may be applicable according to an exemplary embodiment of the present disclosure;

[0029] FIG1B shows a block diagram of a fingerprint recognition system of an electronic device to which exemplary embodiments of the present disclosure may be applied;

[0030] FIG2 shows a flow chart of a fingerprint template updating method according to an exemplary embodiment of the present disclosure;

[0031] FIG3 shows an example of expanding fingerprint features of a fingerprint template using a fingerprint image;

[0032] FIG4 shows another example of performing fingerprint feature expansion on a fingerprint template using a fingerprint image;

[0033] FIG5 shows an example diagram of further fingerprint feature expansion of a fingerprint template using the next fingerprint image;

[0034] FIG6 shows a flowchart of a fingerprint template registration method according to an exemplary embodiment of the present disclosure;

[0035] FIG7 shows a flowchart of a fingerprint template self-learning method according to an exemplary embodiment of the present disclosure;

[0036] FIG8 shows a structural block diagram of a fingerprint template updating device according to an exemplary embodiment of the present disclosure;

[0037] FIG9 shows a block diagram of an exemplary electronic device that can be used to implement the embodiments of the present disclosure. DETAILED DESCRIPTION

[0038] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0039] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0040] The term "including" and its variations used in this document are open inclusions, that is, "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the description below. It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0041] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0042] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0043] FIG1A shows a schematic diagram of an electronic device that can be applied according to various exemplary embodiments of the present disclosure. In some embodiments, the electronic device 100 can be a portable mobile electronic device with a fingerprint recognition system. The portable mobile electronic device can be a smart phone, a tablet computer, a laptop computer, a personal digital assistant, etc. In other embodiments, the electronic device 100 can also be a smart wearable device. The embodiments of the present disclosure do not limit the type of the electronic device 100. As shown in FIG1A , the electronic device 100 can include a device body 101 and a fingerprint sensor 102. The fingerprint sensor 102 can collect the user's input fingerprint and generate a corresponding fingerprint image for fingerprint recognition. The fingerprint sensor 102 can include but is not limited to a capacitive fingerprint sensor, an optical fingerprint sensor, an ultrasonic fingerprint sensor, etc., and the specific position of the fingerprint sensor 102 in the electronic device 100 can be set on the side, back or below the display screen on the front of the device body 101 according to the actual product design requirements.

[0044] As a typical embodiment, the fingerprint sensor 102 can be specifically arranged on the side of the device body 101 of the electronic device 100; as smartphones or other portable electronic devices develop towards being lighter or foldable, the thickness of the electronic device 100 is getting smaller and smaller. Due to the limitation of the carrying space, the fingerprint sensor 102 arranged on the side of the device body 101 may also need to be designed into a narrow strip structure accordingly.

[0045] Referring to FIG1A , the device body 101 may include a display screen 10 and a middle frame 20. The display screen 10 is located on the front of the device body 101 and is used to display images and provide a human-computer interaction interface for the user. The middle frame 20 is generally located between the display screen 10 and the back cover of the electronic device, and is used to support the display screen 101 and to carry various functional components inside the device body 101, such as a motherboard, battery, camera, speaker, microphone, various sensor units, and the like. In a specific embodiment, the middle frame 20 may include a frame located on the periphery of the device body 101. The frame may be integrally formed with the main portion of the middle frame 20 located between the display screen 10 and the back cover, and include multiple side surfaces and carry a power button, volume button, or other function buttons. The fingerprint sensor 102 may be provided on one of the side surfaces of the frame and have a sensing area 108. In a specific embodiment, the fingerprint sensor 102 can be specifically a fingerprint recognition chip or a fingerprint module with a fingerprint recognition chip, which can be integrated above the power button or volume button on the side of the frame, embedded in a predetermined area on the side of the frame, or adhered to the inner surface of the side of the frame, so that the user can input the fingerprint to realize the side fingerprint function of the electronic device 100.

[0046] Referring to FIG. 1B , the fingerprint recognition system of electronic device 100 may include a fingerprint sensor 102 and a processing unit 120. Fingerprint sensor 102 includes a sensing array 103, an output module 104, an interface module 105, and a driver module 106. The sensing array 103 is configured to couple with the user's finger to collect fingerprint information when the user presses the fingerprint sensor 102 to input a fingerprint. Specifically, the sensing array 103 includes a plurality of sensing electrodes arranged in an array. The area where the sensing array 103 is located, or its effective fingerprint collection area, can be understood as the sensing area 108 of the fingerprint sensor 102. The driver module 106 and the output module 104 are connected to the sensing array 103 and the interface module 105, respectively. The driver module 106 is configured to drive the sensing array 103 to perform fingerprint scanning to collect fingerprint information from the user's finger. The output module 104 is configured to perform analog-to-digital conversion on the fingerprint information collected by the sensing array 103 to convert it into a corresponding digital fingerprint image, temporarily store the digital fingerprint image, and output the fingerprint image through the interface module 105 under the control of the processing unit 120.

[0047] The processing unit 120 may be specifically a main processor (such as a central processing unit (CPU)) or other functional unit with processing capabilities within the electronic device 100, such as a microcontroller (MCU). In a specific embodiment, the processing unit 120 may be primarily used to control the working state of the fingerprint sensor 102, process the fingerprint image output by the fingerprint sensor 102, perform fingerprint matching verification, and unlock the electronic device 100 or perform other fingerprint recognition-related functions based on the matching verification result; at the same time, a fingerprint template library is also configured within the processing unit 120, and the processing unit 120 may also be used to generate a new fingerprint template based on the fingerprint image output by the fingerprint sensor 102 and add it to the fingerprint template library or update and replace the fingerprint template library, and update the fingerprint template stored in the fingerprint template library.

[0048] As described above, due to the thickness limitation of the electronic device 100 itself, the fingerprint sensor 102 located on the side of the frame needs to be designed as a narrow strip structure, resulting in a narrow sensing area 108 of the fingerprint sensor 102. The fingerprint information collected by the fingerprint sensor 102 corresponds to the sensing area 108. Therefore, in the typical application scenario described above, the fingerprint sensor 102 directly collects only the relatively narrow local fingerprint information of the portion of the finger that covers the sensing area 108. In addition, in this application scenario, when the user holds the electronic device 100 and presses the fingerprint sensor 102 on the side of the frame, there is some uncertainty in the position of the finger pressing. For example, when the user presses the edge of the fingerprint sensor 102's sensing area 103, the fingerprint feature points and fingerprint ridge information at the edge of the finger are relatively few, so the fingerprint image generated by the fingerprint sensor 102 will carry less fingerprint feature information. If the fingerprint template is directly generated using the local fingerprint information of the finger collected by the fingerprint sensor 102, the discrimination of the fingerprint recognition will be low, affecting the fingerprint recognition performance.

[0049] To address the above problems, an embodiment of the present disclosure provides a fingerprint template updating method, which can be applied to the electronic device 100 as shown in FIG1A to improve its fingerprint recognition performance.

[0050] Figure 2 shows a flowchart of a fingerprint template updating method according to an exemplary embodiment of the present disclosure. As shown in Figure 2, the fingerprint template updating method of the embodiment of the present disclosure can be applied to the fingerprint registration stage or fingerprint verification stage of the electronic device 100, and specifically includes the following steps.

[0051] Step 200: The fingerprint sensor collects the user's input fingerprint and generates a corresponding fingerprint image;

[0052] In an embodiment of the present disclosure, in an electronic device 100, a fingerprint sensor 102 can activate a fingerprint collection function upon detecting contact with a user's finger or according to an instruction from a processing unit 120 of the electronic device 100, and collect fingerprint information input by the user by pressing the fingerprint sensor 102 through its sensing array 103, and generate a fingerprint image based on the fingerprint information input by the user. As an alternative embodiment, the fingerprint sensor 102 can be a capacitive fingerprint sensor, in which the multiple sensing electrodes of the sensing array 103 form different coupling capacitances with the ridges and valleys of the user's finger. The fingerprint sensor 102 drives the sensing array 103 to detect the capacitance signals formed by the ridges and valleys of the user's finger and the sensing electrodes, thereby collecting fingerprint information of the portion of the user's finger pressed against the sensing area 108, and further generating a corresponding fingerprint image based on the fingerprint information. The fingerprint image is specifically a digital image formed by converting and integrating the fingerprint information of the corresponding finger position collected by all the sensing electrodes of the sensing array 103.

[0053] In one application scenario of the embodiments of the present disclosure, as shown in FIG1A , the fingerprint sensor 102 may need to be designed as a narrow strip structure due to the width limitation of the side frame of the electronic device 100. This results in a smaller area of ​​its sensing area 108. When a user presses the fingerprint sensor 102 to input a fingerprint, only the fingerprint information of the finger portion covering the sensing area 108 of the fingerprint sensor 102 can be captured by the fingerprint sensor 102. Therefore, the fingerprint image captured and generated by the fingerprint sensor 102 is actually only a portion, or even only a small part, of the user's actual fingerprint. For example, if the fingerprint sensor 102 uses a capacitive fingerprint sensor with a sensing area 108 of size W*F (e.g., 8mm*1.8mm), and the sensing area 108 specifically includes a sensing array 103 formed by 160*36 sensing electrodes, the fingerprint image generated by the fingerprint sensor 102 corresponds to the position where the finger impacts the sensing area 108. That is, the size of the fingerprint image is only approximately 8mm*1.8mm, while the effective fingerprint area of ​​the main area of ​​an average user's finger is approximately 20mm*10mm. It can be seen that the fingerprint image is not only very narrow, but also smaller than the actual effective area of ​​the user's fingerprint. The embodiments of the present disclosure can also be applied to fingerprint recognition systems in other application scenarios. For example, if an optical or ultrasonic fingerprint recognition system is used below the front display screen, the area of ​​the fingerprint image generated when the fingerprint sensor collects the user's input fingerprint will be larger than that of the side capacitive fingerprint system shown in Figure 1A, but generally still smaller than the effective area of ​​the user's fingerprint.

[0054] Step S201, obtaining a fingerprint image generated by a fingerprint sensor, and determining whether the fingerprint image matches a fingerprint template in a fingerprint template library;

[0055] In the embodiment of the present disclosure, the processing unit 120 can send a control instruction to the fingerprint sensor 102 to control the output module 104 of the fingerprint sensor 102 to send the fingerprint image generated by the fingerprint sensor 102 to the processing unit 120 via the interface module 105. After receiving the fingerprint image, the processing unit 120 can perform pre-processing such as image self-calibration, image quantization, and image enhancement on the fingerprint image as needed to improve the image quality or clarity of the fingerprint image, and further determine whether the fingerprint image matches a fingerprint template in the fingerprint template library.

[0056] Specifically, if the current fingerprint template library does not store a fingerprint template (for example, when fingerprint entry begins during the fingerprint registration phase), the processing unit 120, after acquiring the fingerprint image generated by the fingerprint sensor 102, can extract fingerprint feature information from the fingerprint image and store the set of fingerprint feature information extracted from the fingerprint image as an independent fingerprint template in the fingerprint template library. The fingerprint feature information may include at least a portion of fingerprint feature point information (such as endpoints, breakpoints, intersections, and turning points), fingerprint pattern information, texture detail information, and other relevant information that can characterize fingerprint features.

[0057] If the current fingerprint template library has N fingerprint templates stored (N≥1), the processing unit 120 can select one of the fingerprint templates that have been registered and stored in the fingerprint template library, and determine whether the current fingerprint image has a matching relationship with the fingerprint template stored in the fingerprint template library; wherein, the matching determination between the current fingerprint image and the fingerprint template can refer to the fingerprint matching algorithm, that is, based on the fingerprint feature information extracted from the current fingerprint image and the fingerprint feature information of the fingerprint template, determine whether the two meet the preset fingerprint similarity condition; if part of the fingerprint feature information of the two has a corresponding relationship that meets the condition, then it is determined that the current fingerprint image has a matching relationship with the fingerprint template; otherwise, the two do not have a matching relationship.

[0058] Taking the fingerprint registration stage as an example, if the template library stores fingerprint template T A The current fingerprint image obtained from the fingerprint sensor 102 is P. The processing unit 120 can extract relevant fingerprint feature information from the fingerprint image P and first determine whether the current fingerprint image P is consistent with the fingerprint template T according to the fingerprint feature information extracted from the fingerprint image P. A As an optional embodiment, the processing unit 120 may first search for the fingerprint template T according to the fingerprint feature information of the fingerprint image P. A The fingerprint feature information corresponding to each other in the image is used for image positioning, and the overlapping area between the two is calculated. If the two have no overlapping area or the overlapping area is very small, the fingerprint image P and the fingerprint template T can be directly judged.A There is no matching relationship between the two; if there is an overlapping area between the two, the processing unit 120 can further determine whether the fingerprint feature information of the two in the overlapping area meets the preset similarity condition. If the above similarity condition is met, it is considered that the two have a matching relationship. If the above similarity condition is not met, it is considered that the two do not have a matching relationship. In a specific embodiment, the above similarity condition may not be a specific value, but can be determined based on the image quality of the current fingerprint image, the effective signal amount, and its similarity to the fingerprint template T A The overlapping area size is dynamically adjusted according to predetermined rules.

[0059] In step S201, if it is determined that the current fingerprint image P is consistent with the fingerprint template T A If there is a matching relationship between them, step S202 can be performed to use the current fingerprint image P to compare the fingerprint template T A Fingerprint feature expansion; if the current fingerprint image P and fingerprint template T A If there is no matching relationship between the two, step S203 can be executed to further determine whether there is a matching relationship between the current fingerprint image P and other fingerprint templates in the fingerprint template library, and fingerprint feature expansion is performed on the fingerprint templates with matching relationships until all fingerprint templates in the fingerprint template library are traversed.

[0060] Step S202: Based on the matching relationship between the fingerprint image and the fingerprint template, the fingerprint feature information of the fingerprint image is used to expand the fingerprint feature of the fingerprint template.

[0061] Fingerprint template T A For example, after determining the current fingerprint image P and the fingerprint template T A There is a matching relationship between them, the processing unit 120 can further use the fingerprint feature information of the current fingerprint image P and the fingerprint template T A The fingerprint feature information of the current fingerprint image P is added to the fingerprint template T A , to achieve the fingerprint template T A Fingerprint feature expansion. Specifically, between the current fingerprint image P and the fingerprint template T A When there is a matching relationship, there is an overlapping area between the two corresponding to the fingerprint feature information. At this time, the current fingerprint image P can be compared with the fingerprint template T A The overlapping areas of the two overlap each other to perform splicing based on the overlapping areas, as shown in Figure 3. After the two overlap each other, they can be spliced ​​into a larger fingerprint template, so that the fingerprint feature information of the non-overlapping area in the current fingerprint image P can be expanded to the fingerprint template T A Thus, the fingerprint template T is increased A The baseline fingerprint feature information in .

[0062] The image stitching shown in FIG3 can be realized by aligning the fingerprint feature information in a specific embodiment. A There is an overlapping area with the current fingerprint image P, but there may be some differences in the fingerprint feature information of the two in the overlapping area. The same shaded area in Figure 3 is only used as an example to illustrate the overlapping area, and does not mean that the fingerprint feature information of the two in the overlapping area is completely consistent. In fact, as mentioned above, as long as the fingerprint feature information in the overlapping area meets the fingerprint similarity requirements, the two are considered to have a matching relationship. On the other hand, although the current fingerprint image P may be different from the fingerprint template T in the overlapping area, the fingerprint feature information of the two in the overlapping area is different from the fingerprint template T. A With new fingerprint feature information, the fingerprint feature expansion process in step S202 may not be performed on the fingerprint template T A The fingerprint feature is expanded or updated in the overlapping area of ​​​​the fingerprint template T. Therefore, after the fingerprint feature expansion is completed, although the fingerprint template T A The whole is enlarged into a larger fingerprint template, but the original complete fingerprint template T is still maintained except for the expanded part A After completing the fingerprint feature expansion, the fingerprint template T A The fingerprint feature information includes three parts: (1) the original fingerprint template T A Fingerprint feature information of the overlapping area, (2) original fingerprint template T A The fingerprint feature information of the non-overlapping area (the area not covered by the current fingerprint image P) and (3) the fingerprint feature information expanded from the current fingerprint image P, i.e. the newly added fingerprint feature information.

[0063] As a preferred embodiment, in step S202, the processing unit 120 may also process the fingerprint image P and the fingerprint template T according to the current fingerprint image P and the fingerprint template T. A The matching relationship between the current fingerprint image P and the fingerprint template T A Perform mutual fingerprint feature expansion, that is, use the fingerprint feature information of the current fingerprint image P to expand the fingerprint template T A Perform fingerprint feature expansion and use fingerprint template T A The fingerprint feature information of the current fingerprint image P is also fingerprint feature expanded, so that the fingerprint feature information of the two in non-overlapping areas is expanded to each other respectively.

[0064] For example, FIG4 shows the current fingerprint image P and the fingerprint template T A An example of mutual expansion of fingerprint features, based on the current fingerprint image P and fingerprint template T A The splicing template or image formed after the matching relationship between them has an overlapping area SA and a fingerprint template T AThe first non-overlapping area SB that does not overlap with the current fingerprint image P, the first non-overlapping area SB that does not overlap with the fingerprint template T in the current fingerprint image P, A Furthermore, the fingerprint feature information in the first non-overlapping area SB as shown in FIG4 is expanded to the current fingerprint image P, and a fingerprint feature information set including the first non-overlapping area SB and the current fingerprint image P is obtained, that is, the updated fingerprint image P'. At the same time, the fingerprint feature information in the second non-overlapping area SC as shown in FIG4 is expanded to the fingerprint template T A , get the second non-overlapping area SC and fingerprint template T A The fingerprint feature information set, that is, the updated fingerprint template T A In the above scheme, between the current fingerprint image P and the fingerprint template T A When performing mutual fingerprint feature expansion, since only the fingerprint feature information of each other's non-overlapping areas SB and SC are expanded respectively, the two still maintain their original fingerprint feature information in the overlapping areas. Therefore, the fingerprint feature information actually carried by the first fingerprint splicing template and the second splicing template obtained after mutual expansion is still different.

[0065] In a specific embodiment, for the updated fingerprint template T A ', the processing unit 120 can generate the original fingerprint template T A and a second mark for the second non-overlapping area SC to indicate the updated fingerprint template T A Which part of the fingerprint feature information comes from the original fingerprint template T A , and which part of the fingerprint feature information is obtained by performing fingerprint feature expansion based on the non-overlapping area of ​​the fingerprint image P. Similarly, the processing unit 120 can also add different marks to the updated fingerprint image P' to indicate which part of the fingerprint feature information is derived from the original fingerprint image P, and which part of the fingerprint feature information is obtained based on the fingerprint template T A The fingerprint feature is expanded in the non-overlapping area to obtain the new fingerprint feature information.

[0066] It should be understood that based on the current fingerprint image P and fingerprint template T A The actual matching relationship between the current fingerprint image P and the fingerprint template T A There may be other overlapping areas or splicing relationships, and Figure 4 is only for illustrative purposes.

[0067] Step S203: traverse other fingerprint templates in the fingerprint template library, and use the fingerprint feature information of the fingerprint image to expand the fingerprint features of other fingerprint templates that have a matching relationship with the above fingerprint image.

[0068] After determining the current fingerprint image P and the fingerprint template T A There is no matching relationship or the current fingerprint image P and fingerprint template T A After having a matching relationship and performing fingerprint feature expansion, the processing unit 120 can further select another fingerprint template stored in the fingerprint template library and repeat the above matching relationship judgment and corresponding fingerprint feature expansion steps until all fingerprint templates stored in the fingerprint template library are traversed and the fingerprint template that has a matching relationship with the above fingerprint image P completes the corresponding fingerprint feature expansion.

[0069] For example, suppose that when the processing unit 120 obtains the fingerprint image P in step S202, the fingerprint template library contains the fingerprint template T A In addition, the fingerprint template T B , fingerprint template T C , ..., fingerprint template T N For ease of description, the fingerprint template T A Named as the first fingerprint template, and the other fingerprint templates T stored in the fingerprint template library B 、T C ,…T N They are named as the second fingerprint template, the third fingerprint template, ..., the Nth fingerprint template, and the processing unit 120 determines whether the current fingerprint image P is consistent with the first fingerprint template T A There is no matching relationship or when the current fingerprint image P is judged to be A After the matching relationship is established and the corresponding fingerprint feature expansion is performed, the second fingerprint template T can be further selected. B , and judge the fingerprint image P and the second fingerprint template T B Is there a matching relationship? If there is a matching relationship, the fingerprint feature information of the fingerprint image P is used to identify the second fingerprint template T. B Perform fingerprint feature expansion. If the second fingerprint template T B The processing unit 120 can further select a third fingerprint template T C And perform matching judgment and related fingerprint feature expansion on it, and so on, until the Nth fingerprint template also completes matching judgment and related fingerprint feature expansion, that is, all fingerprint templates T in the fingerprint template library A ~T N All traversals completed.

[0070] It should be noted that if in step S203 the first fingerprint template T A While expanding the fingerprint features, the first fingerprint template T is also used AThe fingerprint feature information of the fingerprint image P is used to expand the fingerprint features of each other. In step S204, the second fingerprint template T B When determining the matching relationship, it is possible to use only the fingerprint feature information of the fingerprint image P originally obtained from the fingerprint sensor 102 to determine whether it matches the second fingerprint template T B Whether there is a matching relationship can also be determined by using the first fingerprint template T A After the fingerprint feature information is expanded, the first updated fingerprint image P' is obtained to perform matching judgment. Similarly, after judging that the fingerprint image P or the updated fingerprint image P' is consistent with the second fingerprint template T B When there is also a matching relationship, the original fingerprint image P can be used to match the second fingerprint template T B To expand the fingerprint features, the first updated fingerprint image P' can also be used to update the second fingerprint template T B Perform fingerprint feature expansion. If the latter is adopted, the second fingerprint template T B The expanded fingerprint information will be more; at the same time, when the second fingerprint template T B When expanding the fingerprint features, the second fingerprint template T can also be used synchronously B The fingerprint feature information of the first updated fingerprint image P' is used to expand the fingerprint features of each other again and obtain the second updated fingerprint image P". Step S203 is to traverse the other fingerprint templates T in the fingerprint template library in the subsequent step. C ~T N When the fingerprint image is scanned, the above-mentioned various matching judgment and fingerprint feature expansion schemes can also be adopted. If the iterative update scheme is adopted for the fingerprint feature expansion of the fingerprint image, then after all the fingerprint templates in the fingerprint template library are traversed, the fingerprint image P after multiple iterative updates will contain more fingerprint feature information.

[0071] Step S204: after all the fingerprint templates in the fingerprint template library are traversed, the fingerprint template with fingerprint feature expansion is updated to the fingerprint template library, and a new fingerprint template is generated according to the fingerprint feature information of the fingerprint image and stored in the fingerprint template library.

[0072] Specifically, when the fingerprint feature information of the fingerprint image P is used to traverse all the fingerprint templates T in the fingerprint template library, A ~T N After completing the matching judgment and the corresponding fingerprint feature expansion, the processing unit 120 can synchronously update the fingerprint templates in the fingerprint template library that have a matching relationship with the above fingerprint image P and have undergone fingerprint feature expansion into the fingerprint template library. For example, assuming that the fingerprint template T stored in the fingerprint template library A ~T N In the example, only the fingerprint template T A and TC The fingerprint image P has a matching relationship. At this time, the processing unit 120 can use the fingerprint template T in the fingerprint template library A and T C Updated to the fingerprint template T after fingerprint feature expansion A ' and T C ', while other fingerprint templates T B and T D ~T N Remain unchanged.

[0073] On the other hand, the processing unit 120 may also generate a new fingerprint template based on the fingerprint feature information of the fingerprint image P and store it in the fingerprint template library. As an embodiment, if the fingerprint feature information of the fingerprint template is not used to perform mutual fingerprint feature expansion on the fingerprint image P in steps S202 and S203, the new fingerprint template stored in the fingerprint template library may be a set of fingerprint feature information directly extracted from the fingerprint image P. Conversely, in other embodiments, if the fingerprint image P has been subjected to mutual fingerprint feature expansion in the previous steps, the new fingerprint template stored in the fingerprint template library may be a set of fingerprint feature information corresponding to the fingerprint image after fingerprint feature expansion, or a set of fingerprint feature information corresponding to the fingerprint image after iterative updating. In addition, when adding the above-mentioned new fingerprint template to the fingerprint template library, if the fingerprint template library is not saturated at this time, the above-mentioned new fingerprint template can be directly added to the fingerprint template library as an independent fingerprint template; if the fingerprint template library is saturated at this time (such as the fingerprint template library supports registering K fingerprint templates, and the fingerprint template library already stores K fingerprint templates at this time), the processing unit 120 can replace the above-mentioned new fingerprint template with one of the fingerprint templates with less valid fingerprint information in the original fingerprint template library according to the preset rules.

[0074] As an alternative implementation scheme, the processing unit 120 may also directly update the expanded fingerprint template to the fingerprint template library after each fingerprint template that has a matching relationship with the above-mentioned fingerprint image P completes its own fingerprint feature expansion, without having to wait for all fingerprint templates that have a matching relationship with the above-mentioned fingerprint image P to complete the fingerprint feature expansion before performing a synchronous update.

[0075] It should be understood that during the use of the electronic device 100, whether in the fingerprint registration stage or the fingerprint verification stage, when the fingerprint sensor 102 collects a new fingerprint image, the processing unit 120 can execute the fingerprint template update method as described above according to actual needs and the conditions pre-set by the system. Therefore, during the use of the fingerprint recognition system of the electronic device 100, the baseline fingerprint information of the fingerprint template stored in the fingerprint template library can be continuously updated, so that the fingerprint template stored in the fingerprint template library has more and more rich baseline fingerprint feature information, thereby further improving the fingerprint recognition performance.

[0076] For example, taking fingerprint template T A For example, after steps S200 to S204, the fingerprint template T in the fingerprint template library A Has been updated to the fingerprint template T after fingerprint feature expansion A ', as shown in FIG3 or FIG4. Assume that the user presses the fingerprint sensor 102 again with a different fingerprint area of ​​the same finger to enter a new fingerprint template according to the system prompt during the fingerprint registration stage. At this time, the fingerprint sensor 102 will collect the user's new input fingerprint and generate a new fingerprint image Q. After obtaining the above-mentioned new fingerprint image Q from the fingerprint sensor 102, the processing unit 120 will extract the fingerprint feature information carried by the new fingerprint image and determine whether it has a matching relationship with the fingerprint template stored in the fingerprint template library based on the above-mentioned fingerprint feature information. If the above-mentioned new fingerprint image Q is consistent with the updated fingerprint template T in the fingerprint template library after the fingerprint feature expansion A 'There is still an overlapping area between them and the fingerprint feature information of the two in the overlapping area meets the preset fingerprint similarity condition, then it is considered that the new fingerprint image Q is similar to the updated fingerprint template T A 'Also has a matching relationship; Alternatively, in the above new fingerprint image Q and the updated fingerprint template T A 'matching judgment, it is also possible to use only the fingerprint template T before fingerprint feature expansion A The fingerprint feature information in the new fingerprint image Q is matched with the new fingerprint image Q. If the two have a matching relationship, the processing unit 120 will further perform an update on the updated fingerprint template T according to the fingerprint feature information carried by the new fingerprint image Q. A 'Fingerprint feature expansion again.

[0077] As shown in Figure 5, after determining the new fingerprint image Q and the fingerprint template T A 'There is a matching relationship between them, the processing unit 120 can perform splicing between the two according to the fingerprint feature information of the overlapping area, and further add the fingerprint feature information of the non-overlapping area in the new fingerprint image Q to the fingerprint template T A ', and obtain the fingerprint template T after fingerprint feature expansion againA ", so the updated fingerprint template T A "Including not only the original fingerprint template T A The fingerprint feature information also includes the fingerprint feature information S obtained by the last fingerprint feature expansion based on the fingerprint image P P , and the fingerprint feature information S obtained by expanding the fingerprint feature based on the new fingerprint image Q Q Similarly, the processing unit 120 processes the fingerprint template T A After the fingerprint feature of the new fingerprint image Q is expanded, the other fingerprint templates in the fingerprint template library will be traversed and the fingerprint feature expansion between the new fingerprint image Q and each matching fingerprint template in the fingerprint template library will be performed in the traversal order, so that the other matching fingerprint templates in the fingerprint template library will also obtain the newly added fingerprint feature information. This shows that after the user presses the fingerprint multiple times, the fingerprint feature information of each fingerprint template in the fingerprint template library will become richer based on the fingerprint feature expansion of the fingerprint image input by the user.

[0078] Although the above-mentioned fingerprint template update method is mainly explained using the fingerprint registration stage as an example, in specific implementation, if the fingerprint recognition system of the electronic device 100 can support the fingerprint template self-learning function, the above-mentioned fingerprint template update method can also be applied to the fingerprint verification stage. By adopting the above-mentioned fingerprint template update method in the fingerprint template self-learning process, the fingerprint template stored in the fingerprint template library can achieve further enrichment and expansion of the baseline fingerprint feature information during the user's daily use.

[0079] Specifically, during the fingerprint registration phase, after the user completes the fingerprint entry and corresponding fingerprint registration of a certain finger according to the electronic device 100, the fingerprint template library stores multiple fingerprint templates of the above-mentioned finger. Thereafter, when the user uses fingerprint unlocking, fingerprint payment or other fingerprint recognition related functions in daily life, the fingerprint sensor 102 will also generate a corresponding fingerprint image based on the user's input fingerprint (equivalent to step S200). After obtaining the above-mentioned fingerprint image, the processing unit 120 first extracts the corresponding fingerprint feature information from the fingerprint image, and matches and verifies it with the fingerprint feature information of the fingerprint template stored in the fingerprint template library to determine whether there is a matching relationship between the two (equivalent to step S201). If the fingerprint feature information of the fingerprint image and the fingerprint feature information of one of the fingerprint templates in the current fingerprint template library meet the preset fingerprint similarity requirements, the matching verification of the fingerprint image is successful, and the processing unit 120 can determine that the user's identity authentication is passed, and control the relevant functional modules of the electronic device 100 to perform fingerprint unlocking, fingerprint payment or other corresponding functions.

[0080] In addition, the processing unit 120 can also determine whether it is necessary to start the fingerprint template self-learning function for the current fingerprint image, such as by judging based on the saturation level of the fingerprint template library, the image quality of the current fingerprint image, or the amount of newly added fingerprint feature information; if it is necessary to start the fingerprint template self-learning function, the processing unit 120 can expand the fingerprint features of the fingerprint template based on the matching relationship between the current fingerprint image and the above-mentioned fingerprint template, and using the fingerprint feature information of the fingerprint image (equivalent to step S202). Thereafter, the processing unit 120 can further traverse other fingerprint templates in the fingerprint template library to determine whether there are other fingerprint templates that have a matching relationship with the current fingerprint image, and use the fingerprint feature information of the current fingerprint image to expand the fingerprint features of other fingerprint templates with a matching relationship (equivalent to step S203); it can be understood that the fingerprint templates in the fingerprint template library traversed by the processing unit 120 may include some fingerprint templates that have been expanded and updated with fingerprint features before, as well as some original fingerprint templates that were only entered during the fingerprint registration stage. Furthermore, the processing unit 120 may update each fingerprint template that has been expanded with fingerprint features to the fingerprint template library, and generate a new fingerprint template based on the fingerprint feature information of the above fingerprint image and store it in the fingerprint template library or replace one of the fingerprint templates in the fingerprint template library with less valid fingerprint information (equivalent to step S204).

[0081] Compared to existing technologies, the fingerprint template update method provided by the disclosed embodiments can utilize the fingerprint feature information carried in the fingerprint image generated by the user's fingerprint press input during the fingerprint registration or fingerprint verification phase to expand the fingerprint features of the fingerprint templates in the fingerprint template library. This effectively expands the coverage area of ​​the fingerprint template and increases the baseline fingerprint feature information in the fingerprint template, effectively improving fingerprint recognition performance and fingerprint recognition accuracy. Even in application scenarios where the fingerprint sensor's sensing area is small, the fingerprint feature information in the fingerprint templates registered in the fingerprint template library can be enriched, increasing the success rate of fingerprint verification for legitimate users and enhancing the user experience.

[0082] As previously described, the fingerprint template update method provided by the embodiments of the present disclosure can be applied both to the fingerprint registration phase of the fingerprint recognition system in the electronic device 100 and to the fingerprint verification phase during daily use of the fingerprint recognition function by the user after fingerprint registration is completed. To better understand the applicable scenarios of the embodiments of the present disclosure, the following briefly describes an optional fingerprint template registration solution and an optional fingerprint template self-learning solution for the fingerprint verification phase based on the above-mentioned fingerprint template update method, respectively, in conjunction with Figures 5 and 6.

[0083] FIG6 shows a flow chart of an optional fingerprint registration solution according to an exemplary embodiment of the present disclosure. As shown in FIG5 , the fingerprint registration method includes steps S601 to S609 .

[0084] Step S601: The fingerprint sensor collects the user's input fingerprint and generates a corresponding fingerprint image.

[0085] Step S602, determining whether the number N of registered fingerprint templates in the fingerprint template library is 0; if N is not 0, proceeding to step S603; otherwise, proceeding to step S607.

[0086] Step S603, a fingerprint template is selected from the fingerprint template library, and the fingerprint feature information extracted from the fingerprint image is matched and compared with the above fingerprint template; the fingerprint template selected in this step is a fingerprint template in the fingerprint template library that has not been matched and compared. In specific implementation, it can be selected according to the order of fingerprint templates or different priority orders can be set according to actual conditions.

[0087] Step S604: Determine whether the fingerprint image matches the selected fingerprint template. If so, proceed to step S605; otherwise, proceed to step S506.

[0088] Step S605: Based on the matching relationship between the fingerprint image and the fingerprint template, the fingerprint feature information of the two is used to perform fingerprint feature expansion on each other.

[0089] Step S606, determining whether there are other fingerprint templates in the fingerprint template library that have not been matched with the fingerprint image, that is, whether all fingerprint templates in the fingerprint template library have been traversed and matched with the fingerprint image and fingerprint features have been expanded; if the traversal is complete, proceed to step S607, otherwise return to step S503.

[0090] Step S607: Generate a new fingerprint template based on the fingerprint feature information of the fingerprint image and store it in the fingerprint template library. Meanwhile, increase the number of fingerprint templates N in the fingerprint template library by 1. Also, update the fingerprint template with the expanded fingerprint features in the fingerprint template library.

[0091] Step S608: Determine whether the fingerprint template registration termination condition has been met, such as whether the target number of new fingerprint templates has been entered into the fingerprint template library or the user has performed a specified number of fingerprint input operations. If so, proceed to step S609; otherwise, return to step S601.

[0092] Step S609: End the fingerprint template registration process.

[0093] The steps involved in the above-mentioned fingerprint registration scheme can be found in the fingerprint template update method shown in Figures 2-5 and the related description of the embodiments of the present disclosure. Through the fingerprint template registration scheme shown in Figure 6, the fingerprint recognition system of the electronic device can use the fingerprint feature information of the fingerprint image collected by the user's different fingerprint input operations during the fingerprint registration stage to expand the fingerprint features of the fingerprint templates in the fingerprint template library, so that the fingerprint templates entered during the fingerprint registration process have richer baseline fingerprint feature information, which is conducive to improving fingerprint recognition performance and user experience.

[0094] FIG7 shows a flowchart of an optional fingerprint template self-learning method provided according to an exemplary embodiment of the present disclosure. As shown in FIG7 , the fingerprint template self-learning method includes steps S701 to S708 .

[0095] Step S701: The fingerprint sensor collects the user's input fingerprint and generates a corresponding fingerprint image.

[0096] Step S702 determines whether the fingerprint image successfully matches one of the fingerprint templates stored in the fingerprint template library and meets the conditions for triggering fingerprint template self-learning. If the match is successful, the user's identity verification is successful, and the system can then perform the corresponding fingerprint unlocking, fingerprint payment, or other related functions. At the same time, it determines whether the fingerprint template self-learning function needs to be triggered. If so, the fingerprint feature information of the fingerprint image can be used to expand the fingerprint feature of the fingerprint template, or the fingerprint feature of the two can be expanded together, and the process proceeds to step S703; otherwise, the process proceeds to step S708.

[0097] Step S703, select another fingerprint template from the fingerprint template library, and match and compare the fingerprint feature information extracted from the fingerprint image with the above fingerprint template; the fingerprint template selected in this step is a fingerprint template in the fingerprint template library that has not been matched and compared. In specific implementation, it can be selected according to the order of fingerprint templates or different priority orders can be set according to actual conditions.

[0098] Step S704, determining whether the fingerprint image matches the selected fingerprint template; if so, proceeding to step S705; otherwise, proceeding to step S706.

[0099] Step S705: Based on the matching relationship between the fingerprint image and the fingerprint template, the fingerprint feature information of the two is used to perform mutual fingerprint feature expansion.

[0100] Step S706, determining whether there are other fingerprint templates in the fingerprint template library that have not been matched with the fingerprint image, that is, whether all fingerprint templates in the fingerprint template library have been traversed and matched with the fingerprint image and fingerprint features have been expanded; if the traversal is complete, proceed to step S707, otherwise return to step S603.

[0101] Step S707: Generate a new fingerprint template based on the fingerprint feature information of the fingerprint image and register it in the fingerprint template library.

[0102] Step S608: End the fingerprint template self-learning process.

[0103] The steps involved in the above-mentioned fingerprint template self-learning scheme can be referred to the fingerprint template updating method shown in Figures 2 to 5 and the related description of the embodiments of the present disclosure. Through the fingerprint template self-learning scheme shown in Figure 7, after the fingerprint registration is completed, the fingerprint recognition system of the electronic device can expand the fingerprint features of the fingerprint templates in the fingerprint template library based on the fingerprint feature information of the fingerprint image collected by the user's fingerprint input operation during daily use, so that the fingerprint templates in the fingerprint template library have richer baseline fingerprint feature information, which is conducive to improving fingerprint recognition performance and user experience.

[0104] The presently disclosed embodiments further provide a fingerprint template updating device, which can form a fingerprint recognition system within the electronic device 100 together with the fingerprint sensor 102 shown in FIG. 1A and FIG. 1B . The fingerprint template updating device can be specifically implemented by the processing unit 120 shown in FIG. 1B . For example, the fingerprint template updating device can be configured in the main processor 120 (e.g., a central processing unit (CPU)) of the electronic device 100 to execute the main steps of the fingerprint template updating device described in each of the above embodiments. In other alternative embodiments, the fingerprint template updating device can also be implemented using other processing units or control units (e.g., a microcontroller (MCU)) with processing capabilities.

[0105] As shown in FIG7 , a fingerprint template updating apparatus 700 provided in one embodiment of the present disclosure may include:

[0106] An acquisition module 710 is configured to acquire a fingerprint image generated by a fingerprint sensor based on a user's input fingerprint and extract fingerprint feature information from the fingerprint image;

[0107] A determination module 720 is configured to determine whether there is a matching relationship between the fingerprint image and one of the fingerprint templates in the fingerprint template library based on the fingerprint feature information of the fingerprint image;

[0108] Fingerprint feature expansion module 730, configured to expand the fingerprint features of the fingerprint template using the fingerprint feature information of the fingerprint image when there is a matching relationship between the fingerprint image and the fingerprint template;

[0109] The fingerprint template updating module 740 is configured to update the fingerprint template after the fingerprint feature expansion to the fingerprint template library.

[0110] As an implementation method, the fingerprint feature expansion module 730 may include:

[0111] a fingerprint template splicing unit, configured to splice the fingerprint image and the fingerprint template according to an overlapping area between the two, wherein the overlapping area refers to an area where fingerprint feature information of the fingerprint image and the fingerprint template have a corresponding relationship with each other; and

[0112] The fingerprint information adding unit adds the fingerprint feature information of the fingerprint image to the fingerprint template, so that the fingerprint template after fingerprint feature expansion has the fingerprint feature information of the non-overlapping area in the fingerprint image.

[0113] As another implementation, the fingerprint feature expansion module 730 may further include:

[0114] a fingerprint template splicing unit, configured to splice the fingerprint image and the fingerprint template according to an overlapping area between the two, wherein the overlapping area refers to an area where fingerprint feature information of the fingerprint image and the fingerprint template have a corresponding relationship with each other;

[0115] A fingerprint information adding unit is used to use the fingerprint feature information of the fingerprint image and the fingerprint feature information of the fingerprint template to respectively perform fingerprint feature expansion on the fingerprint template and the fingerprint image, so as to add the fingerprint feature information of the non-overlapping area in the fingerprint image to the fingerprint template, and add the fingerprint feature information of the non-overlapping area in the fingerprint template to the fingerprint image.

[0116] In one embodiment, the judgment module 720 can also be used to traverse other fingerprint templates in the fingerprint template library, and determine whether the fingerprint image has a matching relationship with other fingerprint templates in the fingerprint template library based on the fingerprint feature information of the fingerprint image; and the fingerprint feature expansion module 730 can also be used to use the fingerprint feature information of the fingerprint image to expand the fingerprint features of other fingerprint templates with a matching relationship when the judgment module determines that the fingerprint image has a matching relationship with other fingerprint templates in the fingerprint template.

[0117] In one embodiment, the fingerprint feature expansion module 730 can also be used to expand the fingerprint features of each fingerprint template that has a matching relationship with the fingerprint image, and use the fingerprint feature information of each matching fingerprint template to expand the fingerprint features of the fingerprint image, so that the fingerprint feature information of the fingerprint image is iteratively updated multiple times when traversing the fingerprint template library.

[0118] As an optional implementation, the fingerprint template updating module 740 may include:

[0119] a template updating unit, configured to, after traversing all fingerprint templates in the fingerprint template library using the fingerprint feature information of the fingerprint image, synchronously update each fingerprint template in the fingerprint template library that has a matching relationship with the fingerprint image and has undergone fingerprint feature expansion into the fingerprint template library;

[0120] A template generation unit is configured to generate a new fingerprint template based on the fingerprint feature information of the fingerprint image and add it to the fingerprint template library or replace one of the fingerprint templates originally stored in the fingerprint template library; wherein the new fingerprint template includes the original fingerprint feature information of the fingerprint image, or includes the fingerprint feature information of the fingerprint image after fingerprint feature expansion with each fingerprint template having a matching relationship in the fingerprint template library.

[0121] Those skilled in the art will appreciate that the specific functions and implementations of the various functional modules or functional units of the fingerprint template updating device described above in conjunction with FIG. 7 are similar to the descriptions of the fingerprint template updating method with reference to FIG. 2 to FIG. 6 , and are not repeated here.

[0122] The present disclosure also provides a fingerprint template updating device, including a processor and a memory storing a program, wherein the program includes instructions that, when executed by the processor, enable the processor to execute the method of the above embodiment, such as the method shown in Figures 2 to 6.

[0123] The present disclosure also provides an electronic device, as shown in FIG1 , comprising a device body 101 and the aforementioned fingerprint sensor 102 disposed therein. In some embodiments, the electronic device 100 may be a portable electronic device, such as a smartphone, tablet computer, laptop computer, personal digital assistant, or the like; alternatively, the electronic device 100 may be a smart wearable device. This disclosure is not limited to this aspect.

[0124] The electronic device 100 provided by the embodiment of the present disclosure further includes a processor and a memory for storing programs, wherein the processor can be the processing unit 120 as shown in Figure 1B, which is connected to the fingerprint sensor 102 and forms a fingerprint recognition system of the electronic device 100 with the fingerprint sensor 102; the program includes instructions, and when the instructions are executed by the processor, the processor executes the method of the above embodiment, such as the method shown in Figures 2 to 6.

[0125] The embodiments of the present disclosure further provide a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the processing unit 120 of the electronic device 100 to execute the method of the above embodiment, such as the method shown in Figures 2 to 6.

[0126] With reference to Figure 9, the block diagram of the structure of the electronic device 900 will now be described, which is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device 900 may include: a computing unit 901, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 902 or a computer program loaded from a storage unit 908 into a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 can also be stored. The computing unit 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0127] Multiple components within electronic device 900 are connected to I / O interface 905, including an input unit 906, an output unit 907, a storage unit 908, and a communication unit 909. Input unit 906 can be any type of device capable of inputting information into electronic device 900. Input unit 906 can receive input numeric or character information and generate key signal inputs related to user settings and / or function control of the electronic device. Output unit 907 can be any type of device capable of presenting information and may include, but is not limited to, a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. Storage unit 908 may include, but is not limited to, a magnetic disk or an optical disk. Communication unit 909 allows electronic device 900 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks, and may include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver and / or a chipset, such as a Bluetooth device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.

[0128] The computing unit 901 can be various general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 901 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 901 performs the various methods and processes described in the present disclosure. For example, in some embodiments, the fan noise reduction method of the embodiment of the present disclosure can be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 908. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 900 via the ROM 902 and / or the communication unit 909. In some embodiments, the computing unit 901 can be configured as the method of this embodiment by any other appropriate means (for example, by means of firmware).

[0129] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0130] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0131] As used in this disclosure, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and / or device (e.g., a magnetic disk, an optical disk, a memory, a programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including machine-readable media that receive machine instructions as machine-readable signals. The term "machine-readable signal" refers to any signal used to provide machine instructions and / or data to a programmable processor.

[0132] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user; and a keyboard and pointing device through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0133] The above are merely preferred embodiments of the present disclosure and are not intended to limit the present disclosure in any form. Although the present disclosure has been disclosed as above with preferred embodiments, they are not intended to limit the present disclosure. Any person skilled in the art can make some changes or modifications to equivalent embodiments using the technical contents disclosed above without departing from the scope of the technical solution of the present disclosure. However, any brief modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present disclosure without departing from the content of the technical solution of the present disclosure are still within the scope of the technical solution of the present disclosure.

Claims

1. A fingerprint template updating method, characterized in that: include: Obtaining a fingerprint image generated by the fingerprint sensor based on the user's input fingerprint, and determining whether there is a matching relationship between the fingerprint image and one of the fingerprint templates in the fingerprint template library; If there is a matching relationship between the fingerprint image and the fingerprint template, the fingerprint template is expanded using the fingerprint feature information of the fingerprint image according to the matching relationship; The fingerprint template expanded with fingerprint features is updated to the fingerprint template library.

2. The fingerprint template updating method according to claim 1, wherein: The step of expanding the fingerprint features of the fingerprint template using the fingerprint feature information of the fingerprint image includes: splicing the fingerprint image and the fingerprint template according to an overlapping area between the two, wherein the overlapping area refers to an area where fingerprint feature information of the fingerprint image and the fingerprint template has a corresponding relationship with each other; The fingerprint feature information of the fingerprint image is added to the fingerprint template, so that the fingerprint template after fingerprint feature expansion has the fingerprint feature information of the non-overlapping area in the fingerprint image.

3. The fingerprint template updating method according to claim 1, wherein: The step of expanding the fingerprint features of the fingerprint template using the fingerprint feature information of the fingerprint image includes: Using the fingerprint feature information of the fingerprint image and the fingerprint feature information of the fingerprint template, the fingerprint features of the fingerprint template and the fingerprint image are respectively expanded, so that the fingerprint template after the fingerprint feature expansion has the fingerprint feature information of the non-overlapping area in the fingerprint image, and the fingerprint image after the fingerprint feature expansion has the fingerprint feature information of the non-overlapping area in the fingerprint template.

4. The fingerprint template updating method according to claim 1, wherein: Also includes: Traverse other fingerprint templates in the fingerprint template library, and use the fingerprint feature information of the fingerprint image to expand the fingerprint features of other fingerprint templates that have a matching relationship with the fingerprint image.

5. The fingerprint template updating method according to claim 4, characterized in that: Also includes: When fingerprint feature expansion is performed on each fingerprint template that has a matching relationship with the fingerprint image, the fingerprint feature information of each matching fingerprint template is used to perform mutual fingerprint feature expansion on the fingerprint image, so that the fingerprint feature information of the fingerprint image is iteratively updated multiple times when traversing the fingerprint template library.

6. The fingerprint template updating method according to claim 4, characterized in that: The step of updating the fingerprint template expanded with fingerprint features to the fingerprint template library comprises: After traversing all the fingerprint templates in the fingerprint template library, each fingerprint template in the fingerprint template library that has a matching relationship with the fingerprint image and has undergone fingerprint feature expansion is synchronously updated into the fingerprint template library; A new fingerprint template is generated based on the fingerprint feature information of the fingerprint image and added to the fingerprint template library or replaces one of the fingerprint templates originally stored in the fingerprint template library; wherein the new fingerprint template includes the original fingerprint feature information of the fingerprint image, or also includes the fingerprint feature information of the fingerprint image after the fingerprint feature is expanded with each fingerprint template with a matching relationship in the fingerprint template library.

7. The fingerprint template updating method according to claim 1, wherein: The fingerprint template updating method is applied in the fingerprint registration stage and further includes: After the fingerprint template with fingerprint feature expansion is updated to the fingerprint template library, another fingerprint image generated by the fingerprint sensor according to the user's input fingerprint is reacquired, and the fingerprint templates in the fingerprint template library are traversed again to determine the matching relationship between the another fingerprint image and the fingerprint templates in the fingerprint template library, and fingerprint feature expansion between the another fingerprint image and each fingerprint template with a matching relationship is performed accordingly.

8. The fingerprint template updating method according to claim 7, wherein: Also includes: After obtaining the fingerprint image generated by the fingerprint sensor based on the user's input fingerprint, if the current fingerprint template library does not store a fingerprint template, or if the fingerprint feature information of the fingerprint image does not have a matching relationship with any fingerprint template in the fingerprint template library, the fingerprint feature information of the fingerprint image is directly used as a new fingerprint template to be added to the fingerprint template library.

9. The fingerprint template updating method according to claim 1, wherein: The fingerprint template updating method is applied in the fingerprint registration stage and further includes: When it is determined that there is a matching relationship between the fingerprint image and the fingerprint template, determining that the user's identity authentication is passed and executing a corresponding function; It is determined whether a fingerprint template self-learning function needs to be started according to the fingerprint image, and fingerprint features of the fingerprint template are expanded when it is determined that the fingerprint template self-learning function needs to be started.

10. A fingerprint template updating device, applied to an electronic device having a fingerprint sensor, characterized in that: The fingerprint template updating device comprises: An acquisition module is used to acquire a fingerprint image generated by the fingerprint sensor according to the user's input fingerprint, and extract fingerprint feature information of the fingerprint image; a judgment module, configured to judge whether there is a matching relationship between the fingerprint image and one of the fingerprint templates in the fingerprint template library based on the fingerprint feature information of the fingerprint image; a fingerprint feature expansion module configured to, when there is a matching relationship between the fingerprint image and the fingerprint template, expand the fingerprint features of the fingerprint template using the fingerprint feature information of the fingerprint image according to the matching relationship; The fingerprint template updating module is used to update the fingerprint template expanded with fingerprint features to the fingerprint template library.

11. The fingerprint template updating device according to claim 10, characterized in that: The fingerprint feature expansion module includes: a fingerprint template splicing unit, configured to splice the fingerprint image and the fingerprint template according to an overlapping area between the two, wherein the overlapping area refers to an area where fingerprint feature information of the fingerprint image and the fingerprint template have a corresponding relationship with each other; The fingerprint information adding unit adds the fingerprint feature information of the fingerprint image to the fingerprint template, so that the fingerprint template after fingerprint feature expansion has the fingerprint feature information of the non-overlapping area in the fingerprint image.

12. The fingerprint template updating device according to claim 10, wherein: The fingerprint feature expansion module includes: a fingerprint template splicing unit, configured to splice the fingerprint image and the fingerprint template according to an overlapping area between the two, wherein the overlapping area refers to an area where fingerprint feature information of the fingerprint image and the fingerprint template have a corresponding relationship with each other; a fingerprint information adding unit, configured to use the fingerprint feature information of the fingerprint image and the fingerprint feature information of the fingerprint template to perform fingerprint feature expansion on the fingerprint template and the fingerprint image, respectively, so as to add the fingerprint feature information of the non-overlapping area in the fingerprint image to the fingerprint template, and to add the fingerprint feature information of the non-overlapping area in the fingerprint template to the fingerprint image.

13. The fingerprint template updating device according to claim 10, wherein: The judgment module is further configured to traverse other fingerprint templates in the fingerprint template library and judge, based on the fingerprint feature information of the fingerprint image, whether it has a matching relationship with other fingerprint templates in the fingerprint template library; The fingerprint feature expansion module is further configured to, when the judgment module determines that the fingerprint image has a matching relationship with other fingerprint templates, use the fingerprint feature information of the fingerprint image to expand the fingerprint features of other fingerprint templates with a matching relationship.

14. The fingerprint template updating device according to claim 13, wherein: The fingerprint feature expansion module is further configured to, when performing fingerprint feature expansion on each fingerprint template that has a matching relationship with the fingerprint image, respectively utilize the fingerprint feature information of each matching fingerprint template to perform mutual fingerprint feature expansion on the fingerprint image, so that the fingerprint feature information of the fingerprint image is iteratively updated multiple times when traversing the fingerprint template library.

15. The fingerprint template updating device according to claim 13, wherein: The fingerprint template updating module includes: a template updating unit, configured to, after traversing all fingerprint templates in the fingerprint template library using the fingerprint feature information of the fingerprint image, synchronously update each fingerprint template in the fingerprint template library that has a matching relationship with the fingerprint image and has undergone fingerprint feature expansion into the fingerprint template library; A template generating unit, configured to generate a new fingerprint template according to the fingerprint feature information of the fingerprint image and add the new fingerprint template to the fingerprint template library or replace one of the fingerprint templates originally stored in the fingerprint template library; The new fingerprint template includes the original fingerprint feature information of the fingerprint image, or includes the fingerprint feature information after the fingerprint image is expanded with each fingerprint template having a matching relationship in the fingerprint template library.

16. A fingerprint template updating method, characterized in that: include: Obtaining a fingerprint image generated by the fingerprint sensor based on the user's input fingerprint, and extracting fingerprint feature information of the fingerprint image; Selecting a first fingerprint template from a fingerprint template library, and determining whether the fingerprint image matches the first fingerprint template based on fingerprint feature information of the fingerprint image and reference fingerprint feature information of the first fingerprint template; When there is a matching relationship between the fingerprint image and the first fingerprint template, the fingerprint feature information of the fingerprint image is used to expand the fingerprint feature of the first fingerprint template, and the reference fingerprint feature information of the first fingerprint template is used to expand the fingerprint feature of the fingerprint image for the first time to obtain a first updated fingerprint image.

17. The fingerprint template updating method according to claim 16, wherein: Also includes: Selecting a second fingerprint template from the fingerprint template library, and determining whether the fingerprint image has the preset matching relationship with the second fingerprint template; When there is a preset matching relationship between the fingerprint image and the second fingerprint template, the fingerprint feature information of the first updated fingerprint image is used to expand the fingerprint feature of the second fingerprint template, and the fingerprint feature information of the second fingerprint template is used to expand the fingerprint feature of the first updated fingerprint image for a second time to obtain a second updated fingerprint image.

18. An electronic device, characterized in that: include: Fingerprint sensor, used to collect the user's input fingerprint and generate a corresponding fingerprint image; a processing unit connected to the fingerprint sensor, configured to obtain the fingerprint image from the fingerprint sensor, determine whether there is a matching relationship between the fingerprint image and a fingerprint template in a fingerprint template library, and when the two have a matching relationship, perform fingerprint feature expansion on the fingerprint template based on the matching relationship and using fingerprint feature information of the fingerprint image, and update the fingerprint template with the expanded fingerprint feature to the fingerprint template library.

19. An electronic device comprising: processor; as well as Memory for storing programs, The program includes instructions, which, when executed by the processor, cause the processor to perform the method according to any one of claims 1-9 or 16-17.

20. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause a computer to execute the method according to any one of claims 1-9 or 16-17.

Images