Fingerprint background data acquisition method and apparatus, and electronic device and storage medium
By acquiring and updating multiple frames of fingerprint images from the fingerprint module, the problem of high assembly cost and low efficiency of fingerprint modules in the prior art is solved, and efficient and accurate fingerprint background data acquisition is achieved.
Patent Information
- Application Number
- PCT/CN2024/126535
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-04-08
- Filing Date
- 2024-10-22
- Publication Date
- 2025-10-16
AI Technical Summary
Existing technologies require multiple test heads for testing when assembling fingerprint modules, resulting in high costs and low efficiency, and making it impossible to efficiently obtain fingerprint background data.
By acquiring multiple frames of fingerprint images collected by the fingerprint module, the initial fingerprint background data is updated using these multiple frames of fingerprint images to obtain the fingerprint background data of the fingerprint module.
It eliminates the need for testing in specific environments, reducing assembly costs, improving assembly efficiency, and enhancing the accuracy and speed of fingerprint background data acquisition.
Smart Images

Figure CN2024126535_16102025_PF_FP_ABST
Abstract
Description
Fingerprint background data acquisition method and device, electronic equipment and storage medium
[0001] The present application claims priority to the application date of April 8, 2024, application number "202410417721.6", patent name "Fingerprint background data acquisition method, device, electronic equipment and storage medium" invention application, the entire contents of which are hereby incorporated by reference. TECHNICAL FIELD
[0002] The embodiments of the present application relate to the technical field of data processing, and in particular to a fingerprint background data acquisition method, device, electronic equipment and storage medium. BACKGROUND
[0003] With the development of the consumer electronics industry, under-screen optical fingerprint technology is widely used in terminal devices such as smartphones, tablets, and door locks. The principle of under-screen optical fingerprint technology is to use the screen or other means to emit light, which is reflected on the finger after the light passes through the screen or glass surface. After the light is reflected by the finger, it is transmitted through the screen to enable the fingerprint module set below the screen to receive the reflected light, achieving fingerprint image acquisition and fingerprint recognition.
[0004] Currently, when assembling a fingerprint module to an electronic device, a variety of test heads are needed to test the fingerprint module to determine the fingerprint background data of the fingerprint module, so that the fingerprint image corresponding to the fingerprint in the fingerprint image collected by the fingerprint module can be determined according to the fingerprint background data when the fingerprint module is used.
[0005] However, when testing the fingerprint module by a variety of test heads during the assembly of the fingerprint module, a professional detection device or detection environment is needed, which is costly and time-consuming, resulting in low efficiency of assembling the fingerprint module.
[0006] SUMMARY
[0007] Therefore, the embodiments of the present application provide a fingerprint background data acquisition method, device, electronic equipment and computer storage medium to at least partially solve the above problems.
[0008] According to a first aspect of the embodiments of the present application, a fingerprint background data acquisition method is provided, comprising: acquiring a plurality of frames of fingerprint images collected by a fingerprint module; updating initial fingerprint background data through at least part of the plurality of frames of fingerprint images to obtain fingerprint background data of the fingerprint module.
[0009] According to a second aspect of the embodiment of the present application, a fingerprint background data acquisition device is provided, comprising: an acquisition unit, configured to acquire a plurality of fingerprint images collected by a fingerprint module; and an updating unit, configured to update initial fingerprint background data by at least part of the plurality of fingerprint images to obtain fingerprint background data of the fingerprint module.
[0010] According to a third aspect of the embodiment of the present application, an electronic device is provided, comprising: a processor, a memory, a communication interface and a communication bus, the processor, the memory and the communication interface complete communication with each other through the communication bus; the memory is configured to store at least one executable instruction, and the executable instruction causes the processor to perform operations corresponding to the method of the first aspect.
[0011] According to a fourth aspect of the embodiment of the present application, a computer storage medium is provided, which stores a computer program, and the program is executed by a processor to implement the method of the first aspect.
[0012] According to the fingerprint background data acquisition scheme provided by the embodiment of the present application, a plurality of fingerprint images collected by a fingerprint module are acquired, and initial fingerprint background data is updated by at least part of the plurality of fingerprint images, so that fingerprint background data corresponding to the fingerprint module can be obtained. Since the fingerprint background data acquisition method in the embodiment of the present application determines the fingerprint background data in the process of collecting the fingerprint image, the fingerprint background data can be determined when the user first enters the fingerprint. Compared with the prior art, the fingerprint background data does not need to be acquired by a detection device in a specific detection environment in the assembly process of the fingerprint module, so that the detection device and the detection environment do not need to be set in the assembly process, thereby reducing the assembly cost of the fingerprint module and improving the assembly efficiency of the fingerprint module. BRIEF DESCRIPTION OF DRAWINGS
[0013] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed in the embodiment or prior art description will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments described in the embodiments of the present application, and other drawings can also be obtained by those skilled in the art based on these drawings.
[0014] FIG. 1 is a flowchart of a fingerprint background data acquisition method provided by an embodiment of the present application;
[0015] FIG. 2 is an example of fingerprint background data provided by an embodiment of the present application;
[0016] FIG. 3 is a schematic diagram of a fingerprint image provided by an embodiment of the present application;
[0017] FIG. 4 is a schematic diagram of an identification image provided by an embodiment of the present application;
[0018] FIG. 5 is a flowchart of a method for assembling and calibrating a fingerprint module according to an embodiment of the present application;
[0019] FIG. 6 is a schematic diagram of a first calibration image according to an embodiment of the present application;
[0020] FIG. 7 is a flowchart of another method for assembling and calibrating a fingerprint module according to an embodiment of the present application;
[0021] FIG. 8 is a schematic diagram of a calibration image according to an embodiment of the present application;
[0022] FIG. 9 is a schematic diagram of a device for obtaining fingerprint background data according to an embodiment of the present application;
[0023] FIG. 10 is a schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION
[0024] In order to make personnel in the art better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art should fall within the scope of protection of the present application.
[0025] The terminology used in the present application is merely for the purpose of describing particular embodiments and is not intended to limit the present application. As used in the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "and / or," as used herein, refer to and encompass any or all possible combinations of one or more of the associated listed items.
[0026] It should be understood that, although the terms first, second, third, etc. can be used herein to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one piece of information from another piece of information of the same type. For example, a first information can also be referred to as a second information without departing from the scope of the present application, and similarly, a second information can also be referred to as a first information. Depending on the context, the word "if" as used herein can be interpreted as "when" or "in response to determining" as used herein.
[0027] As described above, with the development of the consumer electronics industry, the under-screen optical fingerprint technology is widely used in terminal devices such as smart phones, tablet computers, door locks, etc. The principle of the under-screen optical fingerprint technology is to use the screen or other ways to emit light, the light irradiates on the finger after passing through the screen or the glass surface, and after being reflected by the finger, the light transmits through the screen to make the fingerprint module arranged below the screen receive the reflected light, so as to realize the fingerprint image acquisition and the fingerprint recognition. At present, when the fingerprint module is assembled to the electronic device, the fingerprint module needs to be tested by multiple test heads to determine the fingerprint background data of the fingerprint module, so that the image corresponding to the fingerprint in the fingerprint image can be determined according to the fingerprint background data when the fingerprint module is used. Specifically, before the user uses the fingerprint module for fingerprint recognition, the fingerprint needs to be registered. When registering, the fingerprint module collects the fingerprint image, and then removes the background image other than the image of the fingerprint in the fingerprint image according to the fingerprint background data to obtain the image corresponding to the fingerprint. However, when the fingerprint module is tested by multiple test heads, a special detection device or detection environment is needed, the cost is high, and a long test time is needed, so the assembly efficiency of the fingerprint module is low.
[0028] The embodiment of the present application provides a fingerprint background data acquisition method, acquires multiple frames of fingerprint images collected by a fingerprint module, and updates initial fingerprint background data through at least part of the multiple frames of fingerprint images. Thus, the fingerprint background data corresponding to the fingerprint module can be obtained. Since the fingerprint background data acquisition method in the embodiment of the present application determines the fingerprint background data in the process of collecting the fingerprint image, the fingerprint background data can be determined when the user first enters the fingerprint. Compared with the prior art, the fingerprint background data does not need to be acquired by the detection device in a specific detection environment in the assembly process of the fingerprint module. Therefore, the detection device and the detection environment do not need to be set in the assembly process, the assembly cost of the fingerprint module is reduced, and the assembly efficiency of the fingerprint module is improved.
[0029] The fingerprint background data acquisition method provided by the present application will be described below through an embodiment.
[0030] FIG. 1 is a flowchart of a fingerprint background data acquisition method provided by an embodiment of the present application. As shown in FIG. 1, the fingerprint background data acquisition method includes the following steps 101 to 102:
[0031] Step 101, acquiring multiple frames of fingerprint images collected by a fingerprint module.
[0032] The plurality of fingerprint images can be a plurality of fingerprint images collected by the fingerprint module in batches, for example, the fingerprint module collects one frame of fingerprint image each time, and then a plurality of fingerprint images are obtained by collecting multiple times. The plurality of fingerprint images can also be a plurality of fingerprint images collected by the fingerprint module at one time. In an optional embodiment, the plurality of fingerprint images can be collected in batches, and each time a plurality of fingerprint images are collected, and then the plurality of fingerprint images are superimposed to synthesize a clear frame of fingerprint image. In this way, a plurality of clear fingerprint images can be obtained by collecting multiple times, for example, 5 frames of fingerprint images are collected each time, and then 5 frames of collected fingerprint images are superimposed to synthesize 1 frame of clear fingerprint image. A total of 6 times of collection are performed to obtain 6 frames of clear fingerprint images.
[0033] In step 102, the initial fingerprint background data is updated by using at least part of the plurality of fingerprint images to obtain the fingerprint background data of the fingerprint module.
[0034] The initial fingerprint background data is updated by using at least part of the plurality of fingerprint images, for example, the plurality of fingerprint images can be superimposed to update the fingerprint background data. It should be understood that, because the images corresponding to the fingerprint in different frames of fingerprint images are not completely the same, but the images corresponding to the fingerprint background are almost completely the same, therefore, the images of the fingerprint can be faded and the images of the fingerprint background can be highlighted by superimposing the plurality of fingerprint images, so that the fingerprint background data can be updated.
[0035] In the embodiment of the present application, the plurality of fingerprint images collected by the fingerprint module are obtained, and the initial fingerprint background data is updated by using at least part of the plurality of fingerprint images, so that the fingerprint background data corresponding to the fingerprint module can be obtained. Because the fingerprint background data acquisition method in the embodiment of the present application determines the fingerprint background data in the process of collecting the fingerprint image, the fingerprint background data can be determined when the user first enters the fingerprint. Compared with the prior art, the fingerprint background data does not need to be obtained by the detection device in a specific detection environment during the assembly process of the fingerprint module, so that the detection device and the detection environment do not need to be set during the assembly process, thereby reducing the assembly cost of the fingerprint module and improving the assembly efficiency of the fingerprint module.
[0036] In a possible implementation, when the initial fingerprint background data is updated by at least part of the plurality of fingerprint images, the (i-1)th fingerprint background data can be updated by the ith image group to obtain the ith fingerprint background data, where i is a positive integer less than or equal to N, N is equal to the number of fingerprint images included in the plurality of fingerprint images, the 0th fingerprint background data is the initial fingerprint background data, the ith image group includes the ith fingerprint image in the plurality of fingerprint images, and when i is greater than 1, the first to (i-1)th image groups do not include the (i+1)th to Nth fingerprint images. If the ith fingerprint background data satisfies the update completion condition, the ith fingerprint background data is determined as the fingerprint background data of the fingerprint module, or the fingerprint background data of the fingerprint module is determined according to the first to ith fingerprint images. If the ith fingerprint background data does not satisfy the update completion condition and i is less than N, after i is set to i+1, the step of updating the (i-1)th fingerprint background data by the ith image group is performed.
[0037] The plurality of fingerprint images can be divided into a plurality of fingerprint image groups, each of which includes one or more fingerprint images, the ith image group includes the ith fingerprint image in the plurality of fingerprint images, and when i is greater than 1, the first to (i-1)th image groups do not include the (i+1)th to Nth fingerprint images. For example, there are 20 fingerprint images, the first image group includes the first fingerprint image, but does not include the second to 20th fingerprint images, and the eighth image group includes the eighth fingerprint image, but does not include the ninth to 20th fingerprint images. It should be understood that the ith image group can include at least part of the first to ith fingerprint images, but must include the ith fingerprint image, for example, the eighth image group can include the first to eighth fingerprint images or the fifth to eighth fingerprint images.
[0038] The (i-1)th fingerprint background data is updated by the ith image group to obtain the ith fingerprint background data, and it is judged whether the ith fingerprint background data satisfies a preset update completion condition, that is, whether the ith fingerprint background data can accurately reflect the background data corresponding to the fingerprint module by the preset update completion condition. It should be understood that the number of fingerprint background data is 1, the first fingerprint background data is obtained by updating the fingerprint background data for the first time, the first fingerprint background data is updated to the second fingerprint background data when the fingerprint background data is updated for the second time, and the (i-1)th fingerprint background data is updated to the ith fingerprint background data when the fingerprint background data is updated for the ith time.
[0039] When the i-th fingerprint background data meets the update completion condition, the i-th fingerprint background data is determined as the fingerprint background data of the fingerprint module, or a fingerprint background data is determined as the fingerprint background data of the fingerprint module based on the 1st to ith frames of fingerprint images. In one example, the fingerprint background data of the fingerprint module can be determined by weighted superposition of the 1st to ith frames of fingerprint images according to the preset image coefficients corresponding to each frame of fingerprint image. For example, the fingerprint background data of the fingerprint module is determined by the following formula: Base = α1P1 + α2P2 + ... + α i P i ,Base is used to represent the fingerprint background data of the fingerprint module,P i Used to represent the fingerprint image of the i-th frame, α i Used to represent the image coefficient corresponding to the i-th frame fingerprint image.
[0040] FIG2 is an example of fingerprint background data provided by an embodiment of the present application. As shown in FIG2 , when determining the fingerprint background data, multiple frames of fingerprint images, namely P1 to P2 in FIG2 , can be used. i The fingerprint image determines the fingerprint background data.
[0041] When the i-th fingerprint background data does not meet the update completion condition, if i is less than N, after executing i=i+1, the step of updating the i-1-th fingerprint background data through the i-th image group is executed, that is, the i-th fingerprint background data is updated through the i+1-th fingerprint image group, and so on.
[0042] In an embodiment of the present application, the i-1th fingerprint background data is updated through the i-th image group to obtain the i-th fingerprint background data, thereby achieving the updating of the initial fingerprint background data through multiple frames of fingerprint images. Since multiple frames of fingerprint images are used when updating the initial background, the determined fingerprint background data has a higher accuracy. Moreover, by judging whether the fingerprint background data meets the update completion conditions, it can be determined whether the fingerprint background data meets the requirements, thereby further improving the accuracy of the fingerprint background data.
[0043] In one possible implementation, if the i-th fingerprint background data does not meet the update completion condition and i is equal to N, the i-th fingerprint background data is determined as the fingerprint background data of the fingerprint module, or the fingerprint background data of the fingerprint module is determined based on the 1st to i-th frames of fingerprint images.
[0044] When the i-th fingerprint background data does not meet the update completion condition, and i is equal to N, that is, the fingerprint background data is not determined by the multiple frames of fingerprint images collected, then the i-th fingerprint background data is determined as the fingerprint background data of the fingerprint module, or the fingerprint background data of the fingerprint module is determined based on the 1st to i-frame fingerprint images.
[0045] It should be understood that the image quantity threshold of the collected fingerprint images can be preset, and when the quantity of the fingerprint images collected by the fingerprint module is greater than or equal to the image quantity threshold, the fingerprint module stops collecting the fingerprint images. At this time, if the fingerprint background data updated by each collected fingerprint image does not satisfy the update completion condition, the steps in the above embodiment are executed, that is, the last updated fingerprint background data is determined as the fingerprint background data corresponding to the fingerprint module, or the fingerprint background data of the fingerprint module is determined according to each fingerprint image.
[0046] In the embodiment of the present application, when the i-th fingerprint background data does not satisfy the update completion condition and i is equal to N, the i-th fingerprint background data is determined as the fingerprint background data of the fingerprint module, or the fingerprint background data of the fingerprint module is determined according to the first to i-th fingerprint images. In this way, the fingerprint background data of the fingerprint module can be determined. Since the quantity of the fingerprint images used to update the fingerprint background data is limited, the fingerprint background data can be updated for a limited number of times when the fingerprint background data does not satisfy the update completion condition, which prevents the user from waiting for a long time when obtaining the fingerprint background data, thereby reducing the time required by the user to obtain the fingerprint background data during use and improving the user experience.
[0047] In a possible implementation, when the i-1-th fingerprint background data is updated by the i-th image group, the i-1-th fingerprint background data can be updated by the i-th fingerprint image in the plurality of fingerprint images.
[0048] When the fingerprint background data is updated, the i-1-th fingerprint background data can be updated by the i-th fingerprint image. In an example, the fingerprint background data can be updated by the following formula: i = αBase i-1 + βP i , Base i is used to represent the i-th fingerprint background data, P i is used to represent the i-th fingerprint image, α is used to represent a coefficient corresponding to the fingerprint background data, and β is used to represent a coefficient corresponding to the fingerprint image. In an example, the i-th fingerprint image can be de-background processed by the i-1-th fingerprint background data, and then the coefficient corresponding to the fingerprint background data and the coefficient corresponding to the fingerprint image are determined according to the clarity of the image corresponding to the fingerprint in the i-th fingerprint image obtained after the de-background processing. It should be understood that when the clarity of the image corresponding to the fingerprint in the i-th fingerprint image is high, it proves that the i-1-th fingerprint background data can accurately reflect the fingerprint background data of the fingerprint module, at this time, α is large and β is small. On the contrary, it proves that the i-1-th fingerprint background data cannot accurately reflect the fingerprint background data of the fingerprint module, at this time, α is small and β is large.
[0049] In the embodiment of the present application, the i-1th fingerprint background data is updated by the i-th frame of the plurality of fingerprint images, thereby the fingerprint background data can be updated by superimposing the fingerprint image and the fingerprint background data updated by the last fingerprint image, the fingerprint background data can be determined by the plurality of fingerprint images, and the fingerprint background data can accurately reflect the fingerprint background corresponding to the fingerprint module due to the weighted superimposition of the current fingerprint image and the fingerprint background data updated by the last fingerprint image, thereby the accuracy of the fingerprint background data is improved.
[0050] In a possible implementation, when the i-1th fingerprint background data is updated by the i-th image group, the i-1th fingerprint background data can be updated by the m-th to i-th frames of the plurality of fingerprint images, wherein m is a positive integer less than i.
[0051] When the i-1th fingerprint background data is updated, the i-1th fingerprint background data can be updated by at least part of the images in the i-th image group, in an example, the i-1th fingerprint background data can be updated by the following formula: Base i = αBase i-1 + α m P m + … + α i P i The fingerprint background data can be updated by the m-th to i-th frames of the fingerprint images, for example, when the fingerprint background data is updated for the first time, the initial fingerprint data is updated by the first frame of the fingerprint image, when the fingerprint background data is updated for the fifth time, the fourth fingerprint background data is updated by the first to fifth frames of the fingerprint image, or when the fingerprint background data is updated for the fifth time, the fourth fingerprint background data is updated by the third to fifth frames of the fingerprint image, and the like.
[0052] In the embodiment of the present application, the i-1th fingerprint background data is updated by at least part of the fingerprint images in the i-th image group, thereby the fingerprint background data can be updated by the plurality of fingerprint images each time the fingerprint background data is updated, the fingerprint background data can be superimposed by the plurality of fingerprint images each time the fingerprint background data is updated, thereby the time for the fingerprint background data to meet the update completion condition is shortened, and the efficiency of updating the fingerprint background data is improved.
[0053] In one possible implementation, the update completion condition includes at least one of the following: (i) the clarity of the fingerprint image in the i-th fingerprint image frame determined based on the i-th fingerprint background data is greater than a preset clarity threshold; (ii) the fingerprint template corresponding to the i-th fingerprint image frame satisfies a preset fingerprint template completion condition, wherein the fingerprint template corresponding to the i-th fingerprint image frame is obtained based on the first to i-th fingerprint image frames and the first to i-th fingerprint background data.
[0054] FIG3 is a schematic diagram of a fingerprint image provided by an embodiment of the present application. As shown in FIG3 , a fingerprint image can be determined based on the i-th fingerprint image frame and the i-th fingerprint background data. It should be understood that the i-th fingerprint background data can be used to remove the background of the i-th fingerprint image frame, thereby obtaining an image including only the fingerprint. A determination is made as to whether the clarity of the fingerprint image shown in FIG3 meets a clarity threshold. If so, it indicates that most of the background in the i-th fingerprint image frame has been removed, and the i-th fingerprint background data meets the requirement.
[0055] It should be noted that while the initial fingerprint background data is updated using at least part of the fingerprint images in the multiple frames of fingerprint images, the multiple frames of fingerprint images will be registered into the fingerprint template in sequence, and the fingerprint template corresponding to the i-th frame of fingerprint image is obtained based on the 1st to i-th frames of fingerprint images and the 1st to i-th fingerprint background data. Therefore, when the fingerprint template corresponding to the i-th frame of fingerprint image meets the fingerprint template completion condition, it is proved that the i-th fingerprint background data meets the requirements.
[0056] In an embodiment of the present application, the update completion condition includes at least one of the above conditions, thereby limiting the update completion condition of the fingerprint background data. When the fingerprint background data meets the requirements, the update of the fingerprint background data can be stopped, so that the fingerprint background data can meet the usage requirements.
[0057] In one possible implementation, the fingerprint background data acquisition method can also perform background removal processing on the kth frame fingerprint image using the kth fingerprint background data to obtain the kth first denoised fingerprint image, where k is a positive integer less than or equal to i, and the 1st to i first denoised fingerprint images are spliced to obtain a fingerprint template corresponding to the i-th frame fingerprint image.
[0058] In the determination of the fingerprint template, the kth fingerprint background data can be used to perform background removal on the kth fingerprint image. That is, after the first update of the fingerprint background data, the first fingerprint background data is used to perform background removal on the first fingerprint image to obtain the first denoised fingerprint image. Then, the first denoised fingerprint image is registered in the fingerprint template. Then, it is determined whether the fingerprint template meets the fingerprint template completion condition in the foregoing embodiments. If not, it is equivalent to the first fingerprint background data not meeting the update completion condition. Then, the second update of the fingerprint background data is performed, and the second fingerprint background data is used to perform background removal on the second fingerprint image to obtain the second denoised fingerprint image. The second denoised fingerprint image is registered in the fingerprint template, and the determination is re-performed. In this way, the first denoised fingerprint image is registered in the fingerprint template.
[0059] In the registration of the first denoised fingerprint image in the fingerprint template, the first to ith denoised fingerprint images can be spliced. In an example, the positions of the first to ith denoised fingerprint images corresponding to the fingerprint of the finger can be identified, and the first to ith denoised fingerprint images can be spliced according to the identified positions of the first to ith denoised fingerprint images corresponding to the finger, so that the spliced fingerprint template corresponds to the fingerprint of the finger.
[0060] It should be noted that the first denoised fingerprint images are not simply spliced together, but are combined into a fingerprint template. For example, the image of a region of a first denoised fingerprint image can be superimposed on the image of a region of another first denoised fingerprint image. In the following example, the first denoised fingerprint image 1 includes images corresponding to the fingerprint region 1 and the fingerprint region 2, and the first denoised fingerprint image 2 includes images corresponding to the fingerprint region 2 and the fingerprint region 3. In this case, the image corresponding to the fingerprint region 2 in the first denoised fingerprint image 1 or the first denoised fingerprint image 2 can be removed, and then the first denoised fingerprint image 1 and the first denoised fingerprint image 2 can be spliced. Alternatively, the images corresponding to the fingerprint region 2 in the first denoised fingerprint image 1 and the first denoised fingerprint image 2 can be aligned and superimposed (for example, superimposed in the manner of γA+δB, where A is the image corresponding to the fingerprint region 2 in the first denoised fingerprint image 1, B is the image corresponding to the fingerprint region 2 in the first denoised fingerprint image 2, and γ and δ are corresponding superimposition coefficients), to obtain a fingerprint spliced image for the fingerprint region 1, the fingerprint region 2, and the fingerprint region 3. The above operation can be performed on multiple first denoised fingerprint images to splice the multiple first denoised fingerprint images into a complete finger fingerprint image, that is, the multiple first denoised fingerprint images can be combined to form a fingerprint template for fingerprint recognition. The splicing of the denoised fingerprint images into the fingerprint template described in the subsequent embodiments of the present application is applicable to the above explanation.
[0061] In the embodiment of the present application, the kth fingerprint background data is used to perform background removal processing on the kth frame of fingerprint image to obtain a kth first denoised fingerprint image, and the first to ith first denoised fingerprint images are spliced to obtain a fingerprint template corresponding to the ith frame of fingerprint image, so that the fingerprint template can be determined. Since the plurality of first denoised fingerprint images spliced to obtain the fingerprint template are all subjected to background removal processing, the influence of the environment on the fingerprint template can be reduced, and the determined fingerprint template can be more close to the fingerprint image of the finger. Since the fingerprint image is subjected to background removal processing according to the fingerprint background data, the image of the fingerprint is relatively accurate when the fingerprint template meets the fingerprint template completion condition, and therefore more background is removed when the fingerprint image is subjected to background removal processing. Therefore, the fingerprint background data of the fingerprint module is relatively accurate, and the accuracy of the fingerprint background data is improved.
[0062] In a possible implementation, if the ith fingerprint background data meets the update completion condition and the fingerprint background data of the fingerprint module is obtained, the first to ith frames of fingerprint images are subjected to background removal processing according to the fingerprint background data of the fingerprint module to obtain i second denoised fingerprint images, and the i second denoised fingerprint images are spliced to obtain a fingerprint template.
[0063] The ith fingerprint background data meets the update completion condition, that is, the update of the fingerprint background data of the fingerprint module is completed, and the first to ith frames of fingerprint images collected are subjected to background removal processing according to the fingerprint background data to obtain a plurality of second denoised fingerprint images, and the plurality of second denoised fingerprint images are spliced to obtain a fingerprint template. The fingerprint template can be used for fingerprint recognition by the fingerprint module.
[0064] In the embodiment of the present application, after the fingerprint background data of the fingerprint module is determined, a plurality of frames of fingerprint images are subjected to background removal processing according to the fingerprint background data to obtain a plurality of frames of second denoised fingerprint images. Therefore, the fingerprint template can be obtained by the plurality of frames of second denoised fingerprint images. Since the fingerprint background data is relatively accurate, the fingerprint background in the plurality of frames of second denoised fingerprint images is less, and the fingerprint image is relatively clear. Therefore, the fingerprint template spliced from the second denoised fingerprint images has high clarity, can accurately reflect the fingerprint of the finger, and improves the accuracy of the fingerprint template.
[0065] In a possible implementation, the initial fingerprint background data includes blank image data, or the initial fingerprint background data includes an identification image displayed on the screen, and the image data collected by the fingerprint module when the identification region of the fingerprint module does not include the to-be-recognized object. The identification image is used to indicate the position of the identification region on the screen.
[0066] The initial fingerprint background data can be blank image data. When the initial fingerprint background data is updated by the first frame of fingerprint image, the first frame of fingerprint image is updated as the first fingerprint background data because the initial fingerprint background data is blank image data.
[0067] Alternatively, the initial fingerprint background data can also be image data collected by the fingerprint module when the identification area of the fingerprint module does not include the object to be identified while a screen displays an identification image. It should be understood that when a fingerprint image is collected, the screen displays a circular or other shaped highlighted identification image when a finger presses a position on the screen corresponding to the fingerprint identification area in the fingerprint module, and then the fingerprint image is collected. Therefore, the image data collected by the fingerprint module when the identification area of the fingerprint module does not include the object to be identified while the screen displays the identification image can reflect the image data of the fingerprint module when it is empty, i.e., can be used as the initial background data.
[0068] In an example, FIG. 4 is a schematic diagram of an identification image provided by an embodiment of the present application. As shown in FIG. 4, the identification image can be a circular light spot displayed on the screen. It should be understood that FIG. 4 is only an example, and the specific identification image is not limited in the embodiments of the present application.
[0069] In the embodiments of the present application, the initial fingerprint background data includes blank image data, or the initial fingerprint background data includes an identification image. Since the identification image can partially reflect the current environment and the fingerprint background data, the environmental factors can be removed when determining the fingerprint background data, thereby improving the accuracy of the fingerprint background data and the efficiency of determining the fingerprint background data.
[0070] FIG. 5 is a flowchart of a fingerprint module assembly calibration method provided by an embodiment of the present application. As shown in FIG. 5, the fingerprint module assembly calibration method includes the following steps 501 to 503:
[0071] Step 501: Calibrate the exposure time of the fingerprint module.
[0072] The exposure time of the fingerprint module affects the brightness of the image collected by the fingerprint module. By calibrating the exposure time of the fingerprint module, the brightness of the image collected by the fingerprint module can be prevented from exceeding the upper limit of brightness.
[0073] Step 502: Collect a first calibration image displayed on a screen by the fingerprint module after the exposure time is calibrated to obtain a first target calibration image.
[0074] The first calibration image displayed on the screen is captured by the fingerprint module with the calibrated exposure time. In an example, FIG. 6 is a schematic diagram of a first calibration image according to an embodiment of the present application. As shown in FIG. 6, the first calibration image can be a stripe image. It should be understood that FIG. 6 is only an example, and the first calibration image can also be a circular, annular, radial, or other calibration image, and the form of the calibration image is not limited.
[0075] In step 503, the fingerprint module is calibrated according to the image depth and the image magnification of the first target calibration image.
[0076] The fingerprint module is calibrated according to the image depth, i.e., the color difference between different colors, in the first target calibration image, and the image magnification, i.e., the ratio of the image size, such as the side length, the circumference, the area, the diameter, or the like, between the first target calibration image and the first calibration image. For example, the distance from the lens measurement surface of the fingerprint module to the screen surface can be adjusted.
[0077] In the embodiment of the present application, the first calibration image displayed on the screen is captured by the fingerprint module with the calibrated exposure time, and the fingerprint module is calibrated according to the image depth and the image magnification of the obtained first target calibration image. Since the fingerprint module is calibrated by capturing the image, the fingerprint module calibration method provided by the embodiment of the present application does not need to use a calibration device, and does not need to be calibrated in a specific environment, thereby reducing the cost of fingerprint module calibration.
[0078] FIG. 7 is a flowchart of another fingerprint module calibration method according to an embodiment of the present application. As shown in FIG. 7, the fingerprint module calibration method includes the following steps 701 to 704:
[0079] In step 701, a second calibration image displayed on the screen is captured to obtain a second target calibration image.
[0080] In step 702, the exposure time of the fingerprint module is calibrated according to the second target calibration image.
[0081] The exposure time of the fingerprint module is calibrated according to the second target calibration image, so that the brightest point of the subsequent image is consistent with the brightness of the brightest point in the second target calibration image when the fingerprint module captures the subsequent image, thereby eliminating the influence of brightness on the calibration process.
[0082] In step 703, a third calibration image displayed on the screen is captured by the fingerprint module with the calibrated exposure time to obtain a third target calibration image.
[0083] Since the third target calibration image is acquired by the fingerprint module collecting the third calibration image displayed on the screen after the exposure time is calibrated, the brightness of the third target calibration image is less than or equal to the brightness of the brightest point in the second target calibration image.
[0084] In step 704, the fingerprint module is assembled and calibrated according to the second target calibration image and the third target calibration image.
[0085] In an example, the third target calibration image can be subtracted from the second target calibration image, and the absolute value of the image obtained after the subtraction can be taken, since the second target calibration image includes the environmental signal effect, and the third target calibration image includes the same environmental signal effect, the image obtained after the subtraction can remove the environmental signal effect and be more referential.
[0086] According to the second target calibration image and the third target calibration image, the distance from the lens measurement surface of the fingerprint module to the screen surface can be adjusted according to the depth of the image obtained by subtracting the third target calibration image from the second target calibration image in another example.
[0087] In the embodiment of the present application, the second calibration image displayed on the screen is collected to obtain the second target calibration image, the exposure time of the fingerprint module is calibrated through the second target calibration image, and the third calibration image displayed on the screen is collected through the fingerprint module after the exposure time is calibrated to obtain the third target calibration image. Therefore, the fingerprint module can be assembled and calibrated through the second target calibration image and the third target calibration image. Since the exposure time of the fingerprint module is calibrated after the second calibration image is collected, errors in the assembly and calibration of the fingerprint module caused by different brightness between the second target calibration image and the third target calibration image can be prevented. Since the fingerprint module is assembled and calibrated through the second target calibration image and the third target calibration image, the influence of the environment on the assembly and calibration process can be avoided. Since the fingerprint module can be assembled and calibrated by collecting images through the fingerprint module, the fingerprint module assembly and calibration method provided in the embodiment of the present application does not need to use a calibration device, nor does it need to be assembled and calibrated in a specific environment, thereby reducing the cost of fingerprint module assembly and calibration.
[0088] In a possible implementation, the second calibration image is an identification image, or the second calibration image is inverted with respect to the third calibration image, wherein the identification image is used to indicate the position of the identification area on the screen.
[0089] The second calibration image can be an identification image as shown in FIG. 4. In an example, FIG. 8 is a schematic diagram of a calibration image provided in an embodiment of the present application. As shown in FIG. 8, the second calibration image can be inverted with respect to the third calibration image, that is, the image colors between the second calibration image and the third calibration image are complementary.
[0090] In the embodiment of the present application, the second calibration image is a logo image, or the second calibration image is inverted with the third calibration image, so that the environmental influence in the assembly and calibration process of the fingerprint module can be removed by the second calibration image and the third calibration image, and the precision of the assembly and calibration process of the fingerprint module is improved.
[0091] FIG. 9 is a schematic diagram of a fingerprint background data acquisition device provided by an embodiment of the present application. As shown in FIG. 9, the device 900 includes:
[0092] An acquisition unit 901 is configured to acquire a plurality of fingerprint images collected by a fingerprint module.
[0093] An updating unit 902 is configured to update initial fingerprint background data by at least part of the plurality of fingerprint images to obtain fingerprint background data of the fingerprint module.
[0094] In the embodiment of the present application, the acquisition unit 901 can be configured to perform step 101 in the method embodiment described above, and the updating unit 902 can be configured to perform step 102 in the method embodiment described above.
[0095] In a possible implementation, the updating unit 902 can also be configured to update the (i-1)th fingerprint background data by the ith image group to obtain the ith fingerprint background data, where i is a positive integer less than or equal to N, N is equal to the number of fingerprint images included in the plurality of fingerprint images, the 0th fingerprint background data is the initial fingerprint background data, the ith image group includes the ith fingerprint image in the plurality of fingerprint images, and when i is greater than 1, the first to (i-1)th image groups do not include the (i+1)th to Nth fingerprint images; if the ith fingerprint background data satisfies an update completion condition, the ith fingerprint background data is determined as the fingerprint background data of the fingerprint module, or the fingerprint background data of the fingerprint module is determined according to the first to ith fingerprint images; if the ith fingerprint background data does not satisfy the update completion condition and i is less than N, after i=i+1, the step of updating the (i-1)th fingerprint background data by the ith image group is performed.
[0096] In a possible implementation, the updating unit 902 can also be configured to, if the ith fingerprint background data does not satisfy the update completion condition and i is equal to N, determine the ith fingerprint background data as the fingerprint background data of the fingerprint module, or determine the fingerprint background data of the fingerprint module according to the first to ith fingerprint images.
[0097] In a possible implementation, the updating unit 902 can also be configured to update the (i-1)th fingerprint background data by the ith fingerprint image in the plurality of fingerprint images.
[0098] In a possible implementation, the updating unit 902 can also be configured to update the i-1th fingerprint background data by the mth to ith fingerprint images included in the plurality of fingerprint images, where m is a positive integer less than i.
[0099] In a possible implementation, the updating completion condition comprises at least one of the following: (i) the clarity of the image of the fingerprint in the ith frame fingerprint image determined according to the i th fingerprint background data is greater than a preset clarity threshold; (ii) a fingerprint template corresponding to the ith frame fingerprint image satisfies a preset fingerprint template completion condition, where the fingerprint template corresponding to the ith frame fingerprint image is obtained according to the 1st to ith frame fingerprint images and the 1st to i th fingerprint background data.
[0100] In a possible implementation, the updating unit 902 can also be configured to perform background removal processing on the kth frame fingerprint image by the k th fingerprint background data to obtain a k th first denoised fingerprint image, where k is a positive integer less than or equal to i; and splice the 1st to i th first denoised fingerprint images to obtain the fingerprint template corresponding to the ith frame fingerprint image.
[0101] In a possible implementation, the updating unit 902 can also be configured to, if the i th fingerprint background data satisfies the updating completion condition and the fingerprint background data of the fingerprint module is obtained, perform background removal processing on the 1st to ith frame fingerprint images respectively by the fingerprint background data of the fingerprint module to obtain i second denoised fingerprint images; and splice the i second denoised fingerprint images to obtain the fingerprint template.
[0102] In a possible implementation, the initial fingerprint background data comprises blank image data; or the initial fingerprint background data comprises image data collected by the fingerprint module when the identification area of the fingerprint module does not include the to-be-identified object while displaying an identification image on the screen, where the identification image is used to indicate the position of the identification area on the screen.
[0103] In a possible implementation, the fingerprint module is assembled and calibrated by the following method: calibrating the exposure time of the fingerprint module; collecting a first calibration image displayed on the screen by the fingerprint module after the exposure time is calibrated to obtain a first target calibration image; and assembling and calibrating the fingerprint module according to the pattern depth and pattern magnification in the first target calibration image.
[0104] In a possible implementation, a second calibration image of a screen display is collected to obtain a second target calibration image; an exposure time of the fingerprint module is calibrated according to the second target calibration image; a third calibration image of the screen display is collected by the fingerprint module after the exposure time is calibrated to obtain a third target calibration image, where the brightness of the third target calibration image is less than or equal to the brightness of the brightest point in the second target calibration image; and the fingerprint module is assembled and calibrated by using the second target calibration image and the third target calibration image.
[0105] In a possible implementation, the second calibration image is an identification image, or the second calibration image is inverted with the third calibration image, where the identification image is used to indicate the position of the identification area on the screen.
[0106] Referring to FIG. 10, a structural schematic diagram of an electronic device according to an embodiment of the present application is shown, and the embodiments of the present application do not limit the specific implementation of the electronic device.
[0107] As shown in FIG. 10, the electronic device can include a processor 1002, a communications interface 1004, a memory 1006, and a communications bus 1008.
[0108] Wherein:
[0109] The processor 1002, the communications interface 1004, and the memory 1006 complete mutual communication through the communications bus 1008.
[0110] The communications interface 1004 is configured to communicate with other electronic devices or servers.
[0111] The processor 1002 is configured to execute the program 1010, and specifically can execute the related steps in the fingerprint background data acquisition method embodiments.
[0112] Specifically, the program 1010 can include program code, and the program code includes computer operation instructions.
[0113] The processor 1002 can be a central processing unit (CPU), or a graphics processing unit (GPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement one or more embodiments of the present application. The one or more processors included in the smart device can be the same type of processor, such as one or more CPUs; one or more GPUs; or can be different types of processors, such as one or more CPUs and one or more GPUs and one or more ASICs.
[0114] The memory 1006 is configured to store programs 1010. The memory 1006 can include a high-speed RAM memory, and can further include a non-volatile memory, such as at least one disk memory.
[0115] The programs 1010 can be specifically configured to enable the processor 1002 to perform the fingerprint background data acquisition method in any of the foregoing embodiments.
[0116] The specific implementation of each step in the programs 1010 can refer to the corresponding description in the corresponding steps and units in any of the foregoing fingerprint background data acquisition method embodiments, and will not be described herein. It can be clearly understood by those skilled in the art that, for the convenience and brevity of description, the specific working process of the devices and modules described above can refer to the corresponding process description in the foregoing method embodiments, and will not be described herein.
[0117] In the embodiments of the present application, multiple frames of fingerprint images collected by the fingerprint module are acquired, and the initial fingerprint background data is updated through at least part of the multiple frames of fingerprint images, so that the fingerprint background data corresponding to the fingerprint module can be obtained. Since the fingerprint background data acquisition method in the embodiments of the present application determines the fingerprint background data in the process of collecting the fingerprint images, the fingerprint background data can be determined when the user first enters the fingerprint. Compared with the prior art, the fingerprint background data does not need to be acquired by the detection device in a specific detection environment during the assembly process of the fingerprint module, so that the detection device and the detection environment do not need to be set during the assembly process, thereby reducing the assembly cost of the fingerprint module and improving the assembly efficiency of the fingerprint module.
[0118] The embodiments of the present application further provide a computer program product, including computer instructions, which instruct a computing device to perform operations corresponding to any of the methods in the foregoing method embodiments.
[0119] It should be noted that, according to the needs of implementation, each component / step described in the embodiments of the present application can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps, to achieve the purpose of the embodiments of the present application.
[0120] The method according to the embodiments of the present application described above can be implemented in hardware, firmware, or as software or computer code that can be stored in a recording medium such as a CD ROM, a RAM, a floppy disk, a hard disk or an optical disk, or be downloaded through a network originally stored in a remote recording medium or a non-transitory machine readable medium and stored in a local recording medium, so that the method described herein can be processed by such software using a general computer, a special purpose processor or programmable or special hardware such as ASIC or FPGA. It can be understood that the computer, processor, microprocessor controller or programmable hardware includes a storage component (for example, RAM, ROM, flash memory, etc.) that can store or receive software or computer code, when the software or computer code is accessed and executed by the computer, processor or hardware, the fingerprint background data acquisition method described herein is implemented. In addition, when a general computer accesses the code for implementing the fingerprint background data acquisition method shown herein, the execution of the code will convert the general computer into a special computer for executing the fingerprint background data acquisition method shown herein.
[0121] Those of ordinary skill in the art can realize that the units and method steps of the examples described in combination with the embodiments disclosed herein can be realized in electronic hardware, or a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. A skilled person can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of the present application.
[0122] The above embodiments are only used to illustrate the present application, and not to limit the present application, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present application, therefore all equivalent technical solutions also belong to the scope of the present application, the patent protection scope of the present application should be defined by the claims.
Claims
1. A fingerprint background data acquisition method, characterized in that: include: Acquire multiple frames of fingerprint images collected by the fingerprint module; Initial fingerprint background data is updated using at least a portion of the fingerprint images in the multiple frames of fingerprint images to obtain fingerprint background data of the fingerprint module.
2. The method according to claim 1, characterized in that The updating of the initial fingerprint background data using at least part of the fingerprint images in the multiple frames of fingerprint images includes: Updating the i-1th fingerprint background data through the i-th image group to obtain the i-th fingerprint background data, wherein i is a positive integer less than or equal to N, N is equal to the number of fingerprint images included in the multiple frames of fingerprint images, the 0th fingerprint background data is the initial fingerprint background data, the i-th image group includes the i-th frame of fingerprint image in the multiple frames of fingerprint images, and when i is greater than 1, the 1st to i-1st image groups do not include the i-th to N-th frames of fingerprint images; If the i-th fingerprint background data meets the update completion condition, the i-th fingerprint background data is determined as the fingerprint background data of the fingerprint module, or the fingerprint background data of the fingerprint module is determined according to the 1st to i-th fingerprint image frames; If the i-th fingerprint background data does not meet the update completion condition, and i is less than N, then after executing i=i+1, the step of updating the i-1-th fingerprint background data through the i-th image group is executed.
3. The method according to claim 2, characterized in that The method further comprises: If the i-th fingerprint background data does not meet the update completion condition and i is equal to N, the i-th fingerprint background data is determined as the fingerprint background data of the fingerprint module, or the fingerprint background data of the fingerprint module is determined according to the 1st to i-th fingerprint image frames.
4. The method according to claim 2, characterized in that The updating of the (i-1)th fingerprint background data by using the (i)th image group includes: The i-1th fingerprint background data is updated using the i-th fingerprint image in the multiple fingerprint image frames.
5. The method according to claim 2, characterized in that The updating of the (i-1)th fingerprint background data by using the (i)th image group includes: The i-1th fingerprint background data is updated using the mth to ith fingerprint images included in the multiple frames of fingerprint images, wherein m is a positive integer less than i.
6. The method according to any one of claims 2 to 5, characterized in that: The update completion condition includes at least one of the following: (i) the clarity of the fingerprint image in the i-th frame of fingerprint image determined based on the i-th fingerprint background data is greater than a preset clarity threshold; (ii) The fingerprint template corresponding to the i-th frame fingerprint image meets the preset fingerprint template completion condition, wherein the fingerprint template corresponding to the i-th frame fingerprint image is obtained based on the 1st to i-th frame fingerprint images and the 1st to i-th fingerprint background data.
7. The method according to claim 6, characterized in that The method further comprises: Perform background removal on the k-th fingerprint image using the k-th fingerprint background data to obtain the k-th first denoised fingerprint image, where k is a positive integer less than or equal to i; The first denoised fingerprint images from 1 to ith are spliced together to obtain a fingerprint template corresponding to the ith frame of fingerprint image.
8. The method according to claim 7, characterized in that The method further comprises: If the i-th fingerprint background data meets the update completion condition and the fingerprint background data of the fingerprint module is obtained, the fingerprint images of the first to i frames are subjected to background removal processing respectively using the fingerprint background data of the fingerprint module to obtain i second denoised fingerprint images; The i second denoised fingerprint images are spliced together to obtain a fingerprint template.
9. The method according to claim 1, characterized in that The initial fingerprint background data includes blank image data; or, The initial fingerprint background data includes image data collected by the fingerprint module when an identification image is displayed on the screen and the identification area of the fingerprint module does not include an object to be identified, wherein the identification image is used to indicate the position of the identification area on the screen.
10. The method according to claim 1, characterized in that The fingerprint module is assembled and calibrated by the following method: Calibrate the exposure time of the fingerprint module; The fingerprint module after calibrating the exposure time collects a first calibration image displayed on the screen to obtain a first target calibration image; The fingerprint module is assembled and calibrated according to the pattern depth and pattern magnification in the first target calibration image.
11. The method according to claim 1, wherein The step of acquiring a calibration image displayed on a screen by the fingerprint module after calibrating the exposure time to obtain a target calibration image includes: Acquiring a second calibration image displayed on the screen to obtain a second target calibration image; calibrating the exposure time of the fingerprint module according to the second target calibration image; Acquire a third calibration image displayed on the screen by the fingerprint module after calibrating the exposure time to obtain a third target calibration image, wherein the brightness of the third target calibration image is less than or equal to the brightness of the brightest point in the second target calibration image; The fingerprint module is assembled and calibrated using the second target calibration image and the third target calibration image.
12. The method according to claim 11, characterized in that The second calibration image is a logo image, or the second calibration image is the inverse of the third calibration image, wherein the logo image is used to indicate the position of the recognition area on the screen.
13. A fingerprint background data acquisition device, characterized in that: include: An acquisition unit, configured to acquire multiple frames of fingerprint images collected by a fingerprint module; The updating unit is used to update the initial fingerprint background data using at least part of the fingerprint images in the multiple frames of fingerprint images to obtain the fingerprint background data of the fingerprint module.
14. An electronic device comprising: A processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to execute the fingerprint background data acquisition method according to any one of claims 1-12.
15. A computer storage medium storing a computer program, wherein when the program is executed by a processor, the method for obtaining fingerprint background data according to any one of claims 1 to 12 is implemented.
Citation Information
Patent Citations
Fingerprint background data acquisition method and device, electronic equipment and storage medium
CN118314607A
A method for fingerprint image background segmentation
CN105989351B
Image data processing method and device and electronic equipment
CN110263667A
Method and device for fingerprint identification
CN116311396A
Method, apparatus, and computer-readable storage medium for acquiring fingerprint image
US20220164563A1