Fingerprint image acquisition method, fingerprint image processing method, device, electronic device and storage medium

Abstract

Embodiments of the present application provide a fingerprint image acquisition method, a fingerprint image processing method, an apparatus, an electronic device, and a storage medium. The fingerprint image acquisition method includes: acquiring multiple fingerprint images using multiple acquisition parameters and then sending them to a processing unit for processing; an image acquisition step: acquiring fingerprint images using corresponding acquisition parameters; a caching step: caching the fingerprint images; and an image transmission step: transmitting the cached fingerprint images to the processing unit. The start time of the image acquisition step for the second fingerprint image falls within a first target time period corresponding to the first fingerprint image, the first target time period starting at the end time of the image acquisition step for the first fingerprint image and ending at the end time of the image transmission step for the first fingerprint image. The first and second fingerprint images are two adjacent fingerprint images among the multiple fingerprint images, and the first fingerprint image is acquired before the second fingerprint image. This method requires less time to acquire multiple fingerprint images.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of fingerprint recognition technology, and in particular to a fingerprint image acquisition method, a fingerprint image processing method, a device, an electronic device, and a storage medium. Background Art

[0002] Fingerprint recognition is a biometric technology widely used in various fields, including smartphone unlocking, financial transactions, and access control. Therefore, preventing illegal unlocking caused by fake fingerprints and foreign objects, as well as the resulting information leakage, is crucial in everyday applications.

[0003] Currently, when a finger is pressed on the recognition area of ​​the fingerprint module, multiple fingerprint image acquisitions and fingerprint image processing are performed serially through different acquisition parameters, so that fingerprint recognition and fingerprint anti-counterfeiting are performed respectively through the processing results of multiple fingerprint images.

[0004] However, performing multiple fingerprint image acquisitions and fingerprint image processing in series with different acquisition parameters takes a long time, resulting in a poor user experience when performing fingerprint recognition and fingerprint anti-counterfeiting verification. Summary of the Invention

[0005] In view of this, embodiments of the present application provide a fingerprint image acquisition method, a fingerprint image processing method, an apparatus, an electronic device, and a storage medium to at least partially solve the above-mentioned problems.

[0006] According to a first aspect of an embodiment of the present application, a fingerprint image acquisition method is provided, comprising: acquiring multiple fingerprint images through multiple acquisition parameters and then sending them to a processing unit for processing, wherein the fingerprint images are acquired and sent through the following steps: an image acquisition step: acquiring the fingerprint image through corresponding acquisition parameters; a caching step: caching the fingerprint image; an image transmission step: sending the cached fingerprint image to the processing unit; wherein the start time of the image acquisition step of the second fingerprint image is within a first target time period corresponding to the first fingerprint image, the first target time period starts at the end time of the image acquisition step of the first fingerprint image and ends at the end time of the image transmission step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images acquired among the multiple fingerprint images, and the first fingerprint image is acquired before the second fingerprint image.

[0007] In one possible implementation, if the cache space of the fingerprint module is greater than or equal to the first space threshold, the start time of the capture step of the second fingerprint image is within the first target time period corresponding to the first fingerprint image, and the first space threshold is equal to the space occupied by a fingerprint image; if the cache space corresponding to the fingerprint module is less than the first space threshold, the start time of the capture step of the second fingerprint image is the end time of the image transmission step of the first fingerprint image.

[0008] In one possible implementation, acquiring the fingerprint image using corresponding acquisition parameters includes: receiving an acquisition signal sent by the processing unit, wherein, when the acquisition parameters corresponding to the first fingerprint image and the second fingerprint image are different, the acquisition signals corresponding to the first fingerprint image and the second fingerprint image are sent by different processing cores of the processing unit; and acquiring the fingerprint image according to the acquisition parameters indicated by the acquisition signal.

[0009] According to a second aspect of an embodiment of the present application, a fingerprint image processing method is provided, comprising: receiving multiple fingerprint images sent by a fingerprint module, and processing the multiple fingerprint images, wherein the fingerprint images are processed by the following steps: a processing step: processing the fingerprint image; a reporting step: outputting the processing result of the fingerprint image; wherein the start time of the processing step of the second fingerprint image is within a second target time period corresponding to the first fingerprint image, the second target time period starts with the start time of the processing step of the first fingerprint image, and ends with the end time of the reporting step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images received among the multiple fingerprint images, and the first fingerprint image is received before the second fingerprint image, and the multiple fingerprint images are obtained by the fingerprint image acquisition method as described in the first aspect.

[0010] In one possible implementation, the processing of the multiple fingerprint images includes: processing the multiple fingerprint images in parallel through multiple processing cores of a processing unit, wherein the start time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image; or, processing the multiple fingerprint images in series through a single processing core of the processing unit, wherein the start time of the processing step of the second fingerprint image is the end time of the reporting step of the first fingerprint image.

[0011] In one possible implementation, the method further includes: sending an image acquisition signal to the fingerprint module through multiple processing cores of the processing unit, so that the fingerprint module acquires the multiple fingerprint images according to the image acquisition signal, wherein the image acquisition signals sent by different processing cores correspond to different acquisition parameters.

[0012] In one possible implementation, the sending of the image acquisition signal to the fingerprint module through multiple processing cores of the processing unit includes: creating multiple threads executed concurrently by multiple processing cores through a process running in the trust domain of the processing unit, and different threads sending the image acquisition signals corresponding to different acquisition parameters to the fingerprint module; or sending the image acquisition signal to the fingerprint module through multiple processes running concurrently in multiple trust domains of the processing unit, wherein different processes send the image acquisition signals corresponding to different acquisition parameters to the fingerprint module, and different trust domains are created in different processing cores included in the processing unit.

[0013] In one possible implementation, the method further includes: determining a fingerprint recognition result based on processing results corresponding to at least some of the fingerprint images among a plurality of fingerprint images, and / or determining a carrier state of a fingerprint carrier based on processing results corresponding to at least some of the fingerprint images among a plurality of fingerprint images, wherein the fingerprint carrier is a medium that carries the fingerprint corresponding to the fingerprint image.

[0014] According to a third aspect of an embodiment of the present application, a fingerprint image acquisition device is provided, which is used to acquire multiple fingerprint images through multiple acquisition parameters and then send them to a processing unit for processing, wherein the acquisition and sending of the fingerprint images include an image acquisition step, a caching step and an image transmission step; the fingerprint image acquisition device includes: an image acquisition unit, which is used to execute the image acquisition step: acquire the fingerprint image through corresponding acquisition parameters; a caching unit, which is used to execute the caching step: cache the fingerprint image; and a sending unit, which is used to execute the image transmission step: send the cached fingerprint image to the processing unit; wherein the start time of the image acquisition step of the second fingerprint image is within a first target time period corresponding to the first fingerprint image, the first target time period starts at the end time of the image acquisition step of the first fingerprint image and ends at the end time of the image transmission step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two fingerprint images acquired adjacent to each other among the multiple fingerprint images, and the first fingerprint image is acquired before the second fingerprint image.

[0015] According to a fourth aspect of an embodiment of the present application, a fingerprint image processing device is provided for receiving multiple fingerprint images sent by a fingerprint module and processing the multiple fingerprint images, wherein the processing of the fingerprint images includes a processing step and a reporting step; the fingerprint image processing device includes: a computing unit for executing the processing step: processing the fingerprint image; a reporting unit for executing the reporting step: outputting the processing result of the fingerprint image; wherein the start time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image, the second target time period starts at the start time of the processing step of the first fingerprint image and ends at the end time of the reporting step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images received among the multiple fingerprint images, and the first fingerprint image is received before the second fingerprint image, and the multiple fingerprint images are obtained by the fingerprint image acquisition method as described in the first aspect.

[0016] According to the fifth aspect of the embodiments of the present application, an electronic device is provided, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the method described in the first aspect or the second aspect.

[0017] According to a sixth aspect of the embodiments of the present application, a computer storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method described in the first aspect or the second aspect is implemented.

[0018] According to the fingerprint image acquisition solution provided in the embodiment of the present application, the fingerprint module acquires multiple fingerprint images through multiple acquisition parameters and then sends them to the processing unit for processing. The process of acquiring each fingerprint image includes an image acquisition step, a caching step and an image transmission step. When acquiring adjacent first and second fingerprint images, the start time of the second fingerprint image acquisition step is between the end time of the image acquisition step corresponding to the first fingerprint image and the end time of the image transmission step corresponding to the first fingerprint image. Therefore, multiple fingerprint images can be acquired in parallel through different acquisition parameters. Compared with the prior art, since part of the acquisition process of adjacent fingerprint images in multiple fingerprint images is performed in parallel, the overall acquisition time is shorter when acquiring the same number of fingerprint images, thereby reducing the total time required for fingerprint recognition and / or fingerprint carrier status recognition, and improving user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0020] Figure 1 is a schematic diagram of a fingerprint image acquisition method provided in an embodiment of the present application;

[0021] Figure 2 is a schematic diagram of another fingerprint image acquisition method provided in an embodiment of the present application;

[0022] Figure 3 is a schematic diagram of a fingerprint image processing method provided in an embodiment of the present application;

[0023] Figure 4 is a schematic diagram of another fingerprint image processing method provided in an embodiment of the present application;

[0024] Figure 5 is a schematic diagram of another fingerprint image processing method provided in an embodiment of the present application;

[0025] Figure 6 is a schematic diagram of a fingerprint image acquisition device provided in an embodiment of the present application;

[0026] Figure 7 is a schematic diagram of a fingerprint image processing device provided in an embodiment of the present application;

[0027] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0028] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field should fall within the scope of protection of the embodiments of the present application.

[0029] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. As used in this application and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0030] It should be understood that although the terms first, second, third, etc. may be used in this application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of this application, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0031] As previously mentioned, fingerprint recognition is a biometric technology. Because fingerprint recognition is widely used in various fields, including smartphone unlocking, financial transactions, and access control, it is crucial to prevent illegal unlocking caused by fake fingerprints and foreign object attacks, as well as the resulting information leakage, in everyday applications. Currently, after a finger is pressed on the recognition area of ​​the fingerprint module, multiple fingerprint image acquisitions and fingerprint image processing are performed serially using different acquisition parameters. The processing results of these multiple fingerprint images are then used to perform fingerprint recognition and fingerprint anti-counterfeiting, respectively. For example, fingerprint image 1 is acquired, processed, and fingerprint recognition is performed based on the processing results of fingerprint image 1. Then, fingerprint image 2 is acquired, processed, and fingerprint anti-counterfeiting verification is performed based on the processing results of fingerprint image 2. However, performing multiple fingerprint image acquisitions and fingerprint image processing serially using different acquisition parameters consumes a long time, resulting in a poor user experience during fingerprint recognition and fingerprint anti-counterfeiting.

[0032] An embodiment of the present application provides a fingerprint image acquisition method, in which a fingerprint module acquires multiple fingerprint images using multiple acquisition parameters and then sends them to a processing unit for processing. The process of acquiring each fingerprint image includes an image acquisition step, a caching step, and an image transmission step. When acquiring adjacent first and second fingerprint images, the start time of the image acquisition step of the second fingerprint image is between the end time of the image acquisition step corresponding to the first fingerprint image and the end time of the image transmission step corresponding to the first fingerprint image. In this way, multiple fingerprint images can be acquired in parallel using different acquisition parameters. Compared with the prior art, since part of the acquisition process of adjacent fingerprint images in multiple fingerprint images is performed in parallel, the overall acquisition time is shorter when acquiring the same number of fingerprint images, thereby reducing the total time required for fingerprint recognition and / or fingerprint carrier status recognition, and improving user experience.

[0033] The fingerprint image acquisition method and fingerprint image processing method provided by this application are described below through examples.

[0034] Figure 1 is a schematic diagram of a fingerprint image acquisition method provided in an embodiment of the present application, such as Figure 1As shown, the fingerprint image acquisition method includes: acquiring multiple fingerprint images through multiple acquisition parameters and sending them to a processing unit for processing, wherein the fingerprint image is acquired and sent through the following steps: an image acquisition step 101: acquiring the fingerprint image through the corresponding acquisition parameters, a caching step 102: caching the fingerprint image, and an image transmission step 103: sending the cached fingerprint image to the processing unit.

[0035] The start time of the second fingerprint image capture step 101 is within the first target time period corresponding to the first fingerprint image. The first target time period starts at the end time of the first fingerprint image capture step 101 and ends at the end time of the first fingerprint image transmission step 103. The first fingerprint image and the second fingerprint image are two adjacent fingerprint images captured among multiple fingerprint images, and the first fingerprint image is captured before the second fingerprint image. Compared with the serial fingerprint capture in the prior art, the first target time period is the time consumption optimized by this solution in capturing fingerprint images.

[0036] The second fingerprint image acquisition step 101 is between the end time of the first fingerprint image acquisition step 101 and the end time of the first fingerprint image transmission step 103. It should be understood that since there is only one fingerprint module, the fingerprint module can only acquire one fingerprint image at a time. Therefore, the start time of the second fingerprint image acquisition step 101 needs to be later than the end time of the first fingerprint image acquisition step 101. For example, Figure 1 As shown, fingerprint image 1 and fingerprint image 2 are adjacent fingerprint images, and the start time of fingerprint image 2's image acquisition step 101 is located at the end time of fingerprint image 1's image acquisition step 101. Fingerprint image 3 and fingerprint image 2 are adjacent fingerprint images, and the start time of fingerprint image 3's image acquisition step 101 is located at the end time of fingerprint image 2's image acquisition step 101. Figure 1 This is just an example. Specifically, the start time of the fingerprint image 2 capture step 101 may also be the end time of the fingerprint image 1 cache step 102.

[0037] It should be noted that when the fingerprint module is an ultrasonic fingerprint module, the acquisition parameters may include ultrasonic emission frequency, ultrasonic reception delay and number of integral operations, etc. When the fingerprint module is an optical fingerprint module, the acquisition parameters may indicate aperture size and exposure time, etc. The specific acquisition parameters can be set as needed according to the type of fingerprint module. The acquisition parameters corresponding to the first fingerprint image and the second fingerprint image may be the same or different, that is, the acquisition parameters corresponding to some fingerprint images in multiple fingerprint images may be the same. For example: multiple fingerprint images can be collected using the same acquisition parameters to perform fingerprint recognition through multiple fingerprint images.

[0038] In an embodiment of the present application, the fingerprint module collects multiple fingerprint images using multiple collection parameters and then sends them to the processing unit for processing. The process of collecting each fingerprint image includes a collection step 101, a caching step 102, and a transmission step 103. When collecting adjacent first and second fingerprint images, the start time of the second fingerprint image collection step 101 is between the end time of the collection step 101 corresponding to the first fingerprint image and the end time of the transmission step 103 corresponding to the first fingerprint image. Therefore, multiple fingerprint images can be collected in parallel using different collection parameters. Compared with the prior art, since part of the collection process of adjacent fingerprint images in multiple fingerprint images is performed in parallel, the overall collection time is shorter when collecting the same number of fingerprint images, thereby reducing the total time required for fingerprint recognition and / or fingerprint carrier status recognition, and improving user experience.

[0039] In one possible implementation, if the cache space of the fingerprint module is greater than or equal to the first space threshold, the start time of the second fingerprint image capture step is within the first target time period corresponding to the first fingerprint image, and the first space threshold is greater than or equal to the space occupied by a fingerprint image. If the cache space corresponding to the fingerprint module is less than the first space threshold, the start time of the second fingerprint image capture step is the end time of the first fingerprint image transmission step.

[0040] The fingerprint module has a corresponding cache space. When the cache space of the fingerprint module is less than the first space threshold, a complete fingerprint image cannot be cached in the cache space. At this time, after the fingerprint module collects the fingerprint image, it performs the caching step and the image transmission step at the same time. After the image transmission step sends part of the fingerprint image, it continues to cache the remaining part of the fingerprint image to realize the collection and transmission of the fingerprint image. At this time, if a second fingerprint image is collected, the data corresponding to the second fingerprint image will overwrite the data corresponding to the part of the first fingerprint image that is being cached or has been cached in the cache space, resulting in the loss of the fingerprint image and the inability to collect multiple fingerprint images. Therefore, when the cache space corresponding to the fingerprint module is less than the first space threshold, the start time of the second fingerprint image collection step is the end time of the first fingerprint image transmission step, that is, the second fingerprint image is collected after the first fingerprint image is sent to the processing unit. Figure 2 is a schematic diagram of another fingerprint image acquisition method provided in an embodiment of the present application, such as Figure 2 As shown, when the cache space of the fingerprint module is less than the first space threshold, the start time of the image acquisition step 101 of the fingerprint image 2 is the end time of the image transmission step 103 of the fingerprint image 1, and the start time of the image acquisition step 101 of the fingerprint image 3 is the end time of the image transmission step 103 of the fingerprint image 2.

[0041] When the cache space of the fingerprint module is greater than or equal to the first space threshold, a complete fingerprint image can be cached in the cache space. At this time, after the fingerprint module collects the fingerprint image, it first performs the caching step and then the image transmission step to realize the collection and transmission of the fingerprint image. Since the cache space is sufficient to completely cache the first fingerprint image, the image collection step corresponding to the second fingerprint image and the caching step or image transmission step corresponding to the first fingerprint image can be performed in parallel. For example Figure 1 That is, the start time of the second fingerprint image acquisition step is between the end time of the first fingerprint image acquisition step and the end time of the image transmission step.

[0042] In an embodiment of the present application, the start time of the second fingerprint image acquisition step is determined based on whether the cache space of the fingerprint module can meet the needs of completely caching a fingerprint image. This can prevent the cache step of the second fingerprint image from overlapping with the cache step of the first fingerprint image, resulting in the data of the first fingerprint image being overwritten by the data of the second fingerprint image, thereby ensuring that multiple fingerprint images can be acquired normally.

[0043] In one possible implementation, when a fingerprint image is collected using corresponding collection parameters, a collection signal sent by a processing unit can be received, wherein when the collection parameters corresponding to the first fingerprint image and the second fingerprint image are different, the collection signals corresponding to the first fingerprint image and the second fingerprint image are sent by different processing cores of the processing unit, and the fingerprint image is collected according to the collection parameters indicated by the collection signal.

[0044] The processing unit will send an image acquisition signal to the fingerprint module through different processing cores. The image acquisition signal can indicate the acquisition parameters used by the fingerprint module when acquiring the fingerprint image. For example, when the fingerprint module is an ultrasonic fingerprint module, the image acquisition signal can indicate acquisition parameters such as the transmission frequency and receiving delay of the ultrasonic signal. A single processing core of the processing unit can only serially control the fingerprint module to acquire fingerprint images. For example, after the processing core 1 of the processing unit controls the fingerprint module to acquire fingerprint image 1 through parameter 1, the fingerprint module caches fingerprint image 1 and sends it to the processing unit. After the processing core 1 of the processing unit completes the processing of fingerprint image 1, the processing core 1 controls the fingerprint module to acquire fingerprint image 2 through parameter 1 or parameter 2. When the image acquisition signal is sent through different processing cores of the processing unit, the fingerprint module can be controlled in parallel to acquire multiple fingerprint images. For example, after the processing core 1 of the processing unit controls the fingerprint module to acquire fingerprint image 1 through parameter 1, when the fingerprint module caches fingerprint image 1, the processing core 2 controls the fingerprint module to acquire fingerprint image 2 through parameter 2, thereby realizing the parallel execution of some steps of fingerprint image acquisition, for example: Figure 1 shown.

[0045] In an embodiment of the present application, a capture signal sent by a processing unit is received, and a fingerprint image is captured according to the capture parameters indicated by the capture signal. Since the capture signal is sent in parallel by different processing cores of the processing unit, it is possible to control the capture step of the second fingerprint image and the caching step of the first fingerprint image or the image transmission step of the first fingerprint image to be executed in parallel by different processing cores of the processing unit, which can reduce the time required for capturing multiple fingerprint images using multiple capture parameters and improve user experience.

[0046] Figure 3 is a schematic diagram of a fingerprint image processing method provided in an embodiment of the present application, such as Figure 3 As shown, the processing unit receives multiple fingerprint images sent by the fingerprint module and processes the multiple fingerprint images, wherein the fingerprint images are processed through the following steps 301 to 302: Processing step 301: Processing the fingerprint image, reporting step 302: Outputting the processing result of the fingerprint image.

[0047] The start time of the processing step 301 of the second fingerprint image is within the second target time period corresponding to the first fingerprint image. The second target time period starts at the start time of the processing step 301 of the first fingerprint image and ends at the end time of the reporting step 302 of the first fingerprint image. The first fingerprint image and the second fingerprint image are two adjacent fingerprint images received among the multiple fingerprint images, and the first fingerprint image is received before the second fingerprint image. The multiple fingerprint images are obtained by the fingerprint image acquisition method in any of the above embodiments. Compared with the serial processing of fingerprint images in the prior art, the second target time period is the time consumption optimized by this solution in processing fingerprint images.

[0048] Processing step 301 may include image processing and algorithmic processing. Image processing may include synthesis and noise reduction of the fingerprint image, and algorithmic processing may include fingerprint recognition and other biometric identification operations based on the processed fingerprint image. Adjacently received fingerprint images may have at least some processing processes performed in parallel. Specifically, if a second fingerprint image is received adjacent to a first fingerprint image, processing step 301 of the second fingerprint image may be partially parallel to processing step 301 or reporting step 302 of the first fingerprint image. That is, the start time of processing step 301 of the second fingerprint image falls between the start time of processing step 301 of the first fingerprint image and the end time of reporting step 302 of the first fingerprint image.

[0049] In an embodiment of the present application, multiple fingerprint images sent by the fingerprint module are received. When processing the adjacent first fingerprint image and the second fingerprint image, the processing step 301 of the second fingerprint image is located between the start time of the processing step 301 of the first fingerprint image and the end time of the reporting step 302 of the first fingerprint image. The multiple fingerprint images can be processed in parallel. Compared with the prior art, since the multiple fingerprint images are processed in parallel, the time required to process the multiple fingerprint images is less, and the start time of the image acquisition step 101 of the second fingerprint image is located between the end time of the image acquisition step 101 corresponding to the first fingerprint image and the end time of the image transmission step 103 corresponding to the first fingerprint image. In this way, multiple fingerprint images can be acquired in parallel and processed in parallel, which can reduce the time required to acquire and process multiple fingerprint images and improve user experience.

[0050] In one possible implementation, when processing multiple fingerprint images, the multiple fingerprint images can be processed in parallel by multiple processing cores of the processing unit, wherein the start time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image, or, the multiple fingerprint images can be processed serially by a single processing core of the processing unit, wherein the start time of the processing step of the second fingerprint image is the end time of the reporting step of the first fingerprint image.

[0051] When processing multiple fingerprint images, multiple processing cores can be used to process multiple fingerprint images in parallel. Figure 4 is a schematic diagram of another fingerprint image processing method provided in an embodiment of the present application, such as Figure 4 As shown, fingerprint image 2 and fingerprint image 1 are adjacent fingerprint images. The start time of fingerprint image 2's image acquisition step 101 is the start time of fingerprint image 1's cache step 102. Fingerprint image 1 completes image transmission step 103 and is transmitted to the processing unit. The processing core 1 of the processing unit executes processing step 301 on fingerprint image 1. At this time, fingerprint image 2 completes image transmission step 103 and is transmitted to the processing unit. The processing core 2 of the processing unit executes processing step 301 on fingerprint image 2 to achieve parallel processing. The principle of fingerprint image 3 is similar and will not be repeated here.

[0052] Alternatively, since the processing cores of the electronic device include processing cores of different specifications, the fingerprint processing process can be run on the processing core with stronger computing power of the processing unit. Figure 5 is a schematic diagram of another fingerprint image processing method provided in an embodiment of the present application, such as Figure 5As shown, fingerprint image 2 and fingerprint image 1 are adjacent fingerprint images, the start time of fingerprint image 2's image acquisition step 101 is the start time of fingerprint image 1's cache step 102, fingerprint image 1 is first transmitted to the processing unit, and the processing core 1 of the processing unit performs processing step 301 on fingerprint image 1. At this time, fingerprint image 2 is transmitted to the processing unit, and after the processing core 1 of the processing unit completes the reporting step 302 of fingerprint image 1, it performs the processing step 301 of fingerprint image 2, and after completing the reporting step 302 of fingerprint image 2, it performs the processing step 301 of fingerprint image 3.

[0053] In an embodiment of the present application, multiple fingerprint images can be processed in parallel by multiple processing cores of the processing unit, or multiple fingerprint images can be processed serially by a single processing core of the processing unit. When there are many idle processing cores of the processing unit, multiple fingerprint images can be processed in parallel by multiple processing cores of the processing unit, or when multiple processing cores of the processing unit are occupied, multiple fingerprint images can be processed serially by a single processing core, thereby realizing the processing of multiple fingerprint images and reducing the time required to process multiple fingerprint images.

[0054] In a possible implementation, multiple processing cores of the processing unit send image acquisition signals to the fingerprint module, so that the fingerprint module acquires multiple fingerprint images according to the image acquisition signals, wherein the image acquisition signals sent by different processing cores correspond to different acquisition parameters.

[0055] Multiple processing cores of the processing unit can each send an image acquisition signal to the fingerprint module, thereby controlling the fingerprint module to acquire fingerprint images. For example, processing core 1 sends image acquisition signal 1 to the fingerprint module. After the fingerprint module completes the image acquisition step of fingerprint image 1 according to image acquisition signal 1, processing core 2 sends image acquisition signal 2 to the fingerprint module. The fingerprint module simultaneously executes the image acquisition step of fingerprint image 2 according to image acquisition signal 2 while executing the caching step of fingerprint image 1. The image acquisition signals sent by different processing cores indicate different acquisition parameters. For example, different image acquisition signals can indicate different ultrasonic emission frequencies and ultrasonic reception delays.

[0056] In an embodiment of the present application, a capture signal is sent to the fingerprint module through multiple processing cores of the processing unit, so that the fingerprint module captures multiple fingerprint images according to the capture signal. As a result, the fingerprint module can be controlled by different processing cores of the processing unit to capture the adjacent first fingerprint image and the second fingerprint image, respectively, so that the start time of the second fingerprint image capture step is between the end time of the capture step corresponding to the first fingerprint image and the end time of the image transmission step corresponding to the first fingerprint image. This can realize parallel capture of multiple fingerprint images, thereby reducing the time required to capture multiple fingerprint images through different capture parameters.

[0057] In one possible implementation, when sending image acquisition signals to the fingerprint module through multiple processing cores of the processing unit, multiple threads that are concurrently executed by multiple processing cores can be created through a process running in the trust domain of the processing unit, and different threads send image acquisition signals corresponding to different acquisition parameters to the fingerprint module. Alternatively, image acquisition signals can be sent to the fingerprint module through multiple processes running concurrently in multiple trust domains of the processing unit, wherein different processes send image acquisition signals corresponding to different acquisition parameters to the fingerprint module, and different trust domains are created in different processing cores included in the processing unit.

[0058] A Trust Area (TA) is a secure area created on a processing unit that provides an isolated execution environment. Programs and data running in the TA are isolated from the main operating system, preventing interference from malware and ensuring the security of sensitive data (such as biometric data). The fingerprint program associated with the fingerprint module runs in the trust area, which can be set on a single processing core of the fingerprint module. Multiple threads are created by a single process corresponding to the fingerprint program running in the trust area. Multiple processing cores are called to execute the created threads concurrently, and image acquisition signals are sent to the fingerprint module in parallel through multiple threads. This allows the multiple processing cores of the processing unit to send image acquisition signals to the fingerprint module. At this time, all of the processor's multiple processing cores are called by the process corresponding to the fingerprint program running on the single processing core.

[0059] The trust domain can also be set on multiple processing cores, and a trust domain is set on each of the multiple processing cores. A fingerprint program is running on each trust domain, that is, multiple processes corresponding to the fingerprint programs are running on the processing unit, each process runs on a processing core, and multiple processes concurrently send image acquisition signals to the fingerprint module, thereby realizing the sending of image acquisition signals to the fingerprint module through multiple processing cores of the processing unit.

[0060] In an embodiment of the present application, a process running on a single processing core can be used to create multiple threads that are executed concurrently by multiple processing cores, or multiple processes running concurrently in multiple trust domains on multiple processing cores of a processing unit can be used to send image acquisition signals to a fingerprint module through multiple processing cores. In this way, the fingerprint module can be controlled by the multiple processing cores of the processing unit to acquire multiple fingerprint images in parallel, thereby reducing the time required to acquire multiple fingerprint images.

[0061] In one possible implementation, a fingerprint recognition result may be determined based on processing results corresponding to at least some of the multiple fingerprint images, and / or a carrier state of a fingerprint carrier may be determined based on processing results corresponding to at least some of the multiple fingerprint images, where the fingerprint carrier is a medium that carries the fingerprint corresponding to the fingerprint image.

[0062] The fingerprint recognition result can be determined based on the processing results corresponding to some fingerprint images in the multiple fingerprint images. The fingerprint recognition result may include whether the fingerprint recognition is passed. When the fingerprint image matches the fingerprint template, the recognition is output as passed. When the fingerprint image does not match the fingerprint template, the recognition is output as failed.

[0063] The carrier state of the fingerprint carrier can also be determined based on the processing results corresponding to some fingerprint images in multiple fingerprint images. The carrier state can be whether the fingerprint carrier is the binary differentiation result of the finger, the medium classification of the fingerprint carrier, the physical state of the fingerprint carrier, etc., thereby realizing fingerprint anti-counterfeiting or fingerprint derivation operations.

[0064] In an embodiment of the present application, a fingerprint recognition result can be determined based on a processing result corresponding to at least some of the fingerprint images in a plurality of fingerprint images, and / or the carrier state of the fingerprint carrier can be determined based on a processing result corresponding to at least some of the fingerprint images in a plurality of fingerprint images. Thus, a plurality of fingerprint images can be collected according to different collection parameters, and fingerprint recognition and / or carrier state identification of the fingerprint carrier can be performed based on the plurality of fingerprint images. Fingerprint derivative operations such as fingerprint anti-counterfeiting can be performed while fingerprint recognition is being performed. Since the collection and / or processing processes of the plurality of fingerprint images are at least partially performed in parallel, the time required for fingerprint recognition and / or carrier state identification of the fingerprint carrier can be reduced, thereby improving the user experience.

[0065] Figure 6 This is a schematic diagram of a fingerprint image acquisition device provided by an embodiment of the present application, which is used to acquire multiple fingerprint images using multiple acquisition parameters and then send them to a processing unit for processing, wherein the acquisition and transmission of fingerprint images include an image acquisition step, a cache step, and an image transmission step. Figure 6As shown, the fingerprint image acquisition device 600 includes: an image acquisition unit 601, which is used to perform an image acquisition step: acquiring a fingerprint image through corresponding acquisition parameters; a cache unit 602, which is used to perform a cache step: caching the fingerprint image; and a sending unit 603, which is used to perform an image transmission step: sending the cached fingerprint image to the processing unit, wherein the start time of the image acquisition step of the second fingerprint image is within the first target time period corresponding to the first fingerprint image, the first target time period starts at the end time of the image acquisition step of the first fingerprint image, and ends at the end time of the image transmission step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images collected from multiple fingerprint images, and the first fingerprint image is collected before the second fingerprint image.

[0066] In an embodiment of the present application, the image acquisition unit 601 may be used to execute step 101 in the above method embodiment, the cache unit 602 may be used to execute step 102 in the above method embodiment, and the sending unit 603 may be used to execute step 103 in the above method embodiment.

[0067] In one possible implementation, if the cache space of the fingerprint module is greater than or equal to the first space threshold, the start time of the second fingerprint image capture step is within the first target time period corresponding to the first fingerprint image, and the first space threshold is equal to the space occupied by a fingerprint image. If the cache space corresponding to the fingerprint module is less than the first space threshold, the start time of the second fingerprint image capture step is the end time of the first fingerprint image transmission step.

[0068] In one possible implementation, the image acquisition unit 601 can also receive an image acquisition signal sent by the processing unit, wherein, when the acquisition parameters corresponding to the first fingerprint image and the second fingerprint image are different, the image acquisition signals corresponding to the first fingerprint image and the second fingerprint image are sent by different processing cores of the processing unit, and the fingerprint image is acquired according to the acquisition parameters indicated by the image acquisition signal.

[0069] Figure 7 This is a schematic diagram of a fingerprint image processing device provided by an embodiment of the present application, which is used to receive multiple fingerprint images sent by a fingerprint module and process the multiple fingerprint images, wherein the fingerprint image processing includes a processing step and a reporting step. Figure 7As shown, the fingerprint image processing device 700 includes: a computing unit 701, configured to execute a processing step of processing a fingerprint image; and a reporting unit 702, configured to execute a reporting step of outputting a processing result of the fingerprint image, wherein the starting time of the processing step of the second fingerprint image is within a second target time period corresponding to the first fingerprint image, the second target time period starts at the starting time of the processing step of the first fingerprint image and ends at the ending time of the reporting step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images received from a plurality of fingerprint images, and the first fingerprint image is received before the second fingerprint image, and the plurality of fingerprint images are obtained by the fingerprint image acquisition method in any of the above embodiments.

[0070] In the embodiment of the present application, the calculation unit 701 may be used to execute step 301 in the above method embodiment, and the reporting unit 702 may be used to execute step 302 in the above method embodiment.

[0071] In one possible implementation, the computing unit 701 can also process multiple fingerprint images in parallel through multiple processing cores of the processing unit, wherein the start time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image; or, through a single processing core of the processing unit, process multiple fingerprint images in series, wherein the start time of the processing step of the second fingerprint image is the end time of the reporting step of the first fingerprint image.

[0072] In one possible implementation, the fingerprint image processing device 700 may send an image acquisition signal to the fingerprint module through multiple processing cores of the processing unit, so that the fingerprint module acquires multiple fingerprint images according to the image acquisition signal, wherein the image acquisition signals sent by different processing cores correspond to different acquisition parameters.

[0073] In one possible implementation, the fingerprint image processing device 700 can create multiple threads that are executed concurrently by multiple processing cores through a process running in the trust domain of the processing unit, and different threads send image acquisition signals corresponding to different acquisition parameters to the fingerprint module; or, send image acquisition signals to the fingerprint module through multiple processes running concurrently in multiple trust domains of the processing unit, wherein different processes send image acquisition signals corresponding to different acquisition parameters to the fingerprint module, and different trust domains are created in different processing cores included in the processing unit.

[0074] In one possible implementation, the fingerprint image processing device 700 can determine the fingerprint recognition result based on the processing results corresponding to at least some of the fingerprint images among the multiple fingerprint images, and / or determine the carrier state of the fingerprint carrier based on the processing results corresponding to at least some of the fingerprint images among the multiple fingerprint images, wherein the fingerprint carrier is a medium that carries the fingerprint corresponding to the fingerprint image.

[0075] Reference Figure 8 , shows a structural diagram of an electronic device according to an embodiment of the present application. The specific embodiment of the present application does not limit the specific implementation of the electronic device.

[0076] like Figure 8 As shown, the electronic device may include: a processor (processor) 802 , a communication interface (Communications Interface) 804 , a memory (memory) 806 , and a communication bus 808 .

[0077] in:

[0078] The processor 802 , the communication interface 804 , and the memory 806 communicate with each other via a communication bus 808 .

[0079] The communication interface 804 is used to communicate with other electronic devices or servers.

[0080] The processor 802 is configured to execute the program 810, and specifically to execute the relevant steps in the above-mentioned fingerprint image acquisition method or fingerprint image processing method embodiments.

[0081] Specifically, the program 810 may include program codes, which include computer operation instructions.

[0082] Processor 802 may be a central processing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the smart device may be processors of the same type, such as one or more CPUs; one or more GPUs; or different types of processors, such as one or more CPUs, one or more GPUs, and one or more ASICs.

[0083] The memory 806 is used to store the program 810. The memory 806 may include a high-speed RAM memory, or may also include a non-volatile memory (non-volatile memory), such as at least one disk storage.

[0084] The program 810 may be specifically configured to enable the processor 802 to execute the fingerprint image acquisition method or fingerprint image processing method in any of the aforementioned embodiments.

[0085] The specific implementation of each step in program 810 can be found in the corresponding descriptions of the corresponding steps and units in any of the aforementioned embodiments of the fingerprint image acquisition method or fingerprint image processing method, and will not be repeated here. Those skilled in the art will clearly understand that for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding process descriptions in the aforementioned method embodiments, and will not be repeated here.

[0086] In an embodiment of the present application, the fingerprint module collects multiple fingerprint images through multiple collection parameters and then sends them to the processing unit for processing. The process of collecting each fingerprint image includes a collection step, a caching step and a transmission step. When collecting adjacent first and second fingerprint images, the start time of the second fingerprint image collection step is between the end time of the collection step corresponding to the first fingerprint image and the end time of the transmission step corresponding to the first fingerprint image. Therefore, multiple fingerprint images can be collected in parallel through different collection parameters. Compared with the prior art, since part of the collection process of adjacent fingerprint images in multiple fingerprint images is carried out in parallel, the overall collection time is shorter when collecting the same number of fingerprint images, thereby reducing the total time required for fingerprint recognition and / or fingerprint carrier status recognition, and improving user experience.

[0087] An embodiment of the present application also provides a computer program product, including computer instructions, which instruct a computing device to execute operations corresponding to any one of the above-mentioned multiple method embodiments.

[0088] It should be pointed out that, according to the needs of implementation, the various components / steps described in the embodiments of the present application can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present application.

[0089] The methods described above according to the embodiments of the present application can be implemented in hardware, firmware, or as software or computer code that can be stored on a recording medium (such as a CD ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or as computer code originally stored on a remote recording medium or non-transitory machine-readable medium downloaded over a network and then stored on a local recording medium. Thus, the methods described herein can be processed by software stored on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an ASIC or FPGA). It will be understood that a computer, processor, microprocessor controller, or programmable hardware includes a storage component (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code. When the software or computer code is accessed and executed by the computer, processor, or hardware, the fingerprint image acquisition method or fingerprint image processing method described herein is implemented. Furthermore, when a general-purpose computer accesses the code for implementing the fingerprint image acquisition method or fingerprint image processing method described herein, the execution of the code transforms the general-purpose computer into a dedicated computer for executing the fingerprint image acquisition method or fingerprint image processing method described herein.

[0090] Those skilled in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of this application.

[0091] The above implementation methods are only used to illustrate the embodiments of the present application, and are not intended to limit the embodiments of the present application. Ordinary technicians in the relevant technical field can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application. Therefore, all equivalent technical solutions also fall within the scope of the embodiments of the present application, and the scope of patent protection of the embodiments of the present application should be defined by the claims.

Claims

1. A fingerprint image acquisition method, characterized in that: include: A fingerprint module capable of collecting only one fingerprint image at a time collects multiple fingerprint images using multiple collection parameters and sends them to a processing unit for processing. The fingerprint images are collected and sent through the following steps: Image acquisition step: acquiring the fingerprint image using corresponding acquisition parameters; Caching step: caching the fingerprint image; Image transmission step: sending the cached fingerprint image to the processing unit; The start time of the capture step of the second fingerprint image is within the first target time period corresponding to the first fingerprint image, the first target time period starts at the end time of the capture step of the first fingerprint image and ends at the end time of the image transmission step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images captured among the multiple fingerprint images, and the first fingerprint image is captured before the second fingerprint image, and the acquisition parameters include ultrasonic emission frequency, ultrasonic reception delay, and number of integral operations; The collecting of the fingerprint image using corresponding collection parameters includes: Receive an image acquisition signal sent by the processing unit, wherein multiple threads are created by a single process corresponding to a fingerprint program running in a trust domain, multiple processing cores of the processing unit are called to concurrently execute the created multiple threads, and image acquisition signals are sent to the fingerprint module in parallel through the multiple threads, the trust domain is set on a single processing core of the processing unit, different threads send image acquisition signals corresponding to different acquisition parameters to the fingerprint module; and the fingerprint image is acquired according to the acquisition parameters indicated by the image acquisition signal.

2. The method according to claim 1, characterized in that If the cache space of the fingerprint module is greater than or equal to a first space threshold, then the start time of the capture step of the second fingerprint image is within the first target time period corresponding to the first fingerprint image, and the first space threshold is equal to the space occupied by one fingerprint image; If the cache space corresponding to the fingerprint module is smaller than the first space threshold, the start time of the second fingerprint image capturing step is the end time of the first fingerprint image transmitting step.

3. A fingerprint image processing method, characterized in that: include: Receive multiple fingerprint images sent by the fingerprint module and process the multiple fingerprint images, wherein the fingerprint images are processed through the following steps: Processing step: processing the fingerprint image; Reporting step: outputting the processing result of the fingerprint image; The starting time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image, the second target time period starts at the starting time of the processing step of the first fingerprint image and ends at the end time of the reporting step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images received among the multiple fingerprint images, and the first fingerprint image is received before the second fingerprint image, and the multiple fingerprint images are obtained by the fingerprint image acquisition method described in any one of claims 1-2.

4. The method according to claim 3, characterized in that The processing of the multiple fingerprint images includes: Processing the multiple fingerprint images in parallel using multiple processing cores of a processing unit, wherein a start time of a processing step of the second fingerprint image is within a second target time period corresponding to the first fingerprint image; or, The multiple fingerprint images are processed serially by a single processing core of the processing unit, wherein the start time of the processing step of the second fingerprint image is the end time of the reporting step of the first fingerprint image.

5. The method according to claim 3, characterized in that The method further comprises: The multiple processing cores of the processing unit send image acquisition signals to the fingerprint module, so that the fingerprint module acquires the multiple fingerprint images according to the image acquisition signals, wherein the image acquisition signals sent by different processing cores correspond to different acquisition parameters.

6. The method according to claim 5, characterized in that The sending of the image acquisition signal to the fingerprint module by the multiple processing cores of the processing unit includes: Creating a plurality of threads that are concurrently executed by a plurality of processing cores by a process running in the trust domain of the processing unit, wherein different threads send the acquisition signals corresponding to different acquisition parameters to the fingerprint module; or, The image acquisition signal is sent to the fingerprint module through multiple processes running concurrently in multiple trust domains of the processing unit, wherein different processes send the image acquisition signals corresponding to different acquisition parameters to the fingerprint module, and different trust domains are created in different processing cores included in the processing unit.

7. The method according to claim 3, characterized in that The method further comprises: Determining a fingerprint recognition result based on processing results corresponding to at least some of the multiple fingerprint images, and / or determining a carrier state of a fingerprint carrier based on processing results corresponding to at least some of the multiple fingerprint images, wherein the fingerprint carrier is a medium that carries the fingerprint corresponding to the fingerprint image.

8. A fingerprint image acquisition device, characterized in that: A fingerprint module capable of collecting only one fingerprint image at a time collects multiple fingerprint images using multiple collection parameters and then sends them to a processing unit for processing, wherein the collection and transmission of the fingerprint images includes an image collection step, a buffering step, and an image transmission step; The fingerprint image acquisition device comprises: An image acquisition unit is used to perform an image acquisition step: acquiring the fingerprint image using corresponding acquisition parameters; A cache unit, configured to execute a cache step: caching the fingerprint image; A sending unit, configured to execute the image transmission step: sending the cached fingerprint image to the processing unit; The start time of the capture step of the second fingerprint image is within the first target time period corresponding to the first fingerprint image, the first target time period starts at the end time of the capture step of the first fingerprint image and ends at the end time of the image transmission step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images captured among the multiple fingerprint images, and the first fingerprint image is captured before the second fingerprint image, and the acquisition parameters include ultrasonic emission frequency, ultrasonic reception delay, and number of integral operations; The collecting of the fingerprint image using corresponding collection parameters includes: Receive an image acquisition signal sent by the processing unit, wherein multiple threads are created by a single process corresponding to a fingerprint program running in a trust domain, multiple processing cores of the processing unit are called to concurrently execute the created multiple threads, and image acquisition signals are sent to the fingerprint module in parallel through the multiple threads, the trust domain is set on a single processing core of the processing unit, different threads send image acquisition signals corresponding to different acquisition parameters to the fingerprint module; and the fingerprint image is acquired according to the acquisition parameters indicated by the image acquisition signal.

9. A fingerprint image processing device, characterized in that: Used to receive multiple fingerprint images sent by the fingerprint module and process the multiple fingerprint images, wherein the processing of the fingerprint images includes a processing step and a reporting step; The fingerprint image processing device comprises: A computing unit, configured to execute the processing step of: processing the fingerprint image; A reporting unit, configured to perform a reporting step of outputting a processing result of the fingerprint image; The starting time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image, the second target time period starts at the starting time of the processing step of the first fingerprint image and ends at the end time of the reporting step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images received among the multiple fingerprint images, and the first fingerprint image is received before the second fingerprint image, and the multiple fingerprint images are obtained by the fingerprint image acquisition method described in any one of claims 1-2.

10. An electronic device, characterized in that: include: A processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to execute the fingerprint image acquisition method according to any one of claims 1-2, or execute the fingerprint image processing method according to any one of claims 3-7.

11. A computer storage medium, characterized in that A computer program is stored thereon, and when the program is executed by a processor, the fingerprint image acquisition method according to any one of claims 1 to 2 is implemented, or the fingerprint image processing method according to any one of claims 3 to 7 is implemented.

Images