Fingerprint image acquisition method and device, fingerprint image processing method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a fingerprint image acquisition method, a fingerprint image processing method, a fingerprint image processing device, electronic equipment and a storage medium, the fingerprint image acquisition method comprises the following steps: acquiring a plurality of fingerprint images through a plurality of acquisition parameters and then sending the fingerprint images to a processing unit for processing, an image acquisition step: acquiring the fingerprint images through the corresponding acquisition parameters; a caching step: caching the fingerprint image; an image transmission step: sending the cached fingerprint image to a processing unit; wherein the starting time of the image acquisition step of the second fingerprint image is within a first target time period corresponding to the first fingerprint image, and the first target time period takes the ending time of the image acquisition step of the first fingerprint image as a starting point and takes the ending time of the image transmission step of the first fingerprint image as an ending point; the first fingerprint image and the second fingerprint image are two adjacently acquired fingerprint images in the plurality of fingerprint images, and the first fingerprint image is acquired before the second fingerprint image. According to the method, less time is required for acquiring a plurality of fingerprint images.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of fingerprint recognition technology, and in particular to a fingerprint image acquisition method, a fingerprint image processing method, a device, an electronic device, and a storage medium. Background Art

[0002] Fingerprint recognition is a biometric technology. Since fingerprint recognition is widely used in many fields such as smartphone unlocking, financial transactions, and access control, it is crucial to avoid illegal unlocking caused by fake fingerprints and foreign body attacks, as well as the resulting information leakage, in daily applications.

[0003] At present, when a finger is pressed on the recognition area of ​​the fingerprint module, multiple fingerprint image acquisitions and fingerprint image processing are performed serially through different acquisition parameters, so that fingerprint recognition and fingerprint anti-counterfeiting are performed respectively through the processing results of multiple fingerprint images.

[0004] However, performing multiple fingerprint image acquisitions and fingerprint image processing in series through different acquisition parameters takes a long time, resulting in a poor user experience when performing fingerprint recognition and fingerprint anti-counterfeiting verification. Summary of the invention

[0005] In view of this, embodiments of the present application provide a fingerprint image acquisition method, a fingerprint image processing method, a device, an electronic device and a storage medium to at least partially solve the above problems.

[0006] According to a first aspect of an embodiment of the present application, a fingerprint image acquisition method is provided, comprising: acquiring multiple fingerprint images through multiple acquisition parameters and then sending them to a processing unit for processing, wherein the fingerprint image is acquired and sent through the following steps: an image acquisition step: acquiring the fingerprint image through corresponding acquisition parameters; a caching step: caching the fingerprint image; an image transmission step: sending the cached fingerprint image to the processing unit; wherein the start time of the image acquisition step of the second fingerprint image is within a first target time period corresponding to the first fingerprint image, the first target time period starts at the end time of the image acquisition step of the first fingerprint image, and ends at the end time of the image transmission step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two fingerprint images acquired adjacently among the multiple fingerprint images, and the first fingerprint image is acquired before the second fingerprint image.

[0007] In one possible implementation, if the cache space of the fingerprint module is greater than or equal to the first space threshold, the start time of the capture step of the second fingerprint image is within the first target time period corresponding to the first fingerprint image, and the first space threshold is equal to the space occupancy of a fingerprint image; if the cache space corresponding to the fingerprint module is less than the first space threshold, the start time of the capture step of the second fingerprint image is the end time of the image transmission step of the first fingerprint image.

[0008] In a possible implementation, acquiring the fingerprint image through corresponding acquisition parameters includes: receiving an acquisition signal sent by the processing unit, wherein when the acquisition parameters corresponding to the first fingerprint image and the second fingerprint image are different, the acquisition signals corresponding to the first fingerprint image and the second fingerprint image are sent by different processing cores of the processing unit; and acquiring the fingerprint image according to the acquisition parameters indicated by the acquisition signal.

[0009] According to a second aspect of an embodiment of the present application, a fingerprint image processing method is provided, comprising: receiving multiple fingerprint images sent by a fingerprint module, and processing the multiple fingerprint images, wherein the fingerprint images are processed by the following steps: a processing step: processing the fingerprint images; a reporting step: outputting the processing results of the fingerprint images; wherein the start time of the processing step of the second fingerprint image is within a second target time period corresponding to the first fingerprint image, the second target time period starts with the start time of the processing step of the first fingerprint image, and ends with the end time of the reporting step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacently received fingerprint images among the multiple fingerprint images, and the first fingerprint image is received before the second fingerprint image, and the multiple fingerprint images are obtained by the fingerprint image acquisition method as described in the first aspect.

[0010] In a possible implementation, the processing of the multiple fingerprint images includes: processing the multiple fingerprint images in parallel through multiple processing cores of a processing unit, wherein the start time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image; or, processing the multiple fingerprint images in series through a single processing core of the processing unit, wherein the start time of the processing step of the second fingerprint image is the end time of the reporting step of the first fingerprint image.

[0011] In a possible implementation, the method further includes: sending an image acquisition signal to the fingerprint module through multiple processing cores of the processing unit, so that the fingerprint module acquires the multiple fingerprint images according to the image acquisition signal, wherein the image acquisition signals sent by different processing cores have different acquisition parameters corresponding to them.

[0012] In a possible implementation, the sending of the image acquisition signal to the fingerprint module through the multiple processing cores of the processing unit includes: creating multiple threads executed concurrently by the multiple processing cores through a process running in the trust domain of the processing unit, and different threads sending the image acquisition signals corresponding to different acquisition parameters to the fingerprint module; or sending the image acquisition signal to the fingerprint module through multiple processes running concurrently in the multiple trust domains of the processing unit, wherein different processes send the image acquisition signals corresponding to different acquisition parameters to the fingerprint module, and different trust domains are created in different processing cores included in the processing unit.

[0013] In a possible implementation, the method further includes: determining a fingerprint recognition result based on processing results corresponding to at least some of the multiple fingerprint images, and / or determining a carrier state of a fingerprint carrier based on processing results corresponding to at least some of the multiple fingerprint images, wherein the fingerprint carrier is a medium that carries the fingerprint corresponding to the fingerprint image.

[0014] According to a third aspect of an embodiment of the present application, a fingerprint image acquisition device is provided, which is used to acquire multiple fingerprint images through multiple acquisition parameters and then send them to a processing unit for processing, wherein the acquisition and sending of the fingerprint images include an image acquisition step, a caching step and an image transmission step; the fingerprint image acquisition device includes: an image acquisition unit, which is used to execute the image acquisition step: acquire the fingerprint image through corresponding acquisition parameters; a caching unit, which is used to execute the caching step: cache the fingerprint image; a sending unit, which is used to execute the image transmission step: send the cached fingerprint image to the processing unit; wherein the start time of the image acquisition step of the second fingerprint image is within the first target time period corresponding to the first fingerprint image, the first target time period starts with the end time of the image acquisition step of the first fingerprint image and ends with the end time of the image transmission step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two fingerprint images acquired adjacent to each other among the multiple fingerprint images, and the first fingerprint image is acquired before the second fingerprint image.

[0015] According to a fourth aspect of an embodiment of the present application, a fingerprint image processing device is provided, which is used to receive multiple fingerprint images sent by a fingerprint module and process the multiple fingerprint images, wherein the processing of the fingerprint image includes a processing step and a reporting step; the fingerprint image processing device includes: a computing unit, which is used to execute the processing step: processing the fingerprint image; a reporting unit, which is used to execute the reporting step: outputting the processing result of the fingerprint image; wherein the starting time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image, the second target time period starts with the starting time of the processing step of the first fingerprint image and ends with the ending time of the reporting step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two fingerprint images received adjacently among the multiple fingerprint images, and the first fingerprint image is received before the second fingerprint image, and the multiple fingerprint images are obtained by the fingerprint image acquisition method as described in the first aspect.

[0016] According to the fifth aspect of the embodiments of the present application, there is provided an electronic device, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the method described in the first aspect or the second aspect.

[0017] According to a sixth aspect of an embodiment of the present application, a computer storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method described in the first aspect or the second aspect is implemented.

[0018] According to the fingerprint image acquisition solution provided in the embodiment of the present application, the fingerprint module acquires multiple fingerprint images through multiple acquisition parameters and then sends them to the processing unit for processing. The process of acquiring each fingerprint image includes an image acquisition step, a caching step and an image transmission step. When acquiring adjacent first fingerprint images and second fingerprint images, the start time of the second fingerprint image acquisition step is between the end time of the image acquisition step corresponding to the first fingerprint image and the end time of the image transmission step corresponding to the first fingerprint image. Therefore, multiple fingerprint images can be acquired in parallel through different acquisition parameters. Compared with the prior art, since part of the acquisition process of adjacent fingerprint images in multiple fingerprint images is performed in parallel, the overall acquisition time is less when the same number of fingerprint images are acquired, so as to reduce the total time required for fingerprint recognition and / or fingerprint carrier status recognition, and improve user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0020] Figure 1 is a schematic diagram of a fingerprint image acquisition method provided in an embodiment of the present application; Figure 2 is a schematic diagram of another fingerprint image acquisition method provided in an embodiment of the present application; Figure 3 is a schematic diagram of a fingerprint image processing method provided in an embodiment of the present application; Figure 4 is a schematic diagram of another fingerprint image processing method provided in an embodiment of the present application; Figure 5 is a schematic diagram of another fingerprint image processing method provided in an embodiment of the present application; Figure 6 is a schematic diagram of a fingerprint image acquisition device provided in an embodiment of the present application; Figure 7 is a schematic diagram of a fingerprint image processing device provided in an embodiment of the present application; Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0021] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the embodiments of the present application should fall within the scope of protection of the embodiments of the present application.

[0022] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0023] It should be understood that although the terms first, second, third, etc. may be used in the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0024] As mentioned above, fingerprint recognition is a biometric technology. Since fingerprint recognition is widely used in many fields such as smartphone unlocking, financial transactions, and access control, it is crucial to avoid illegal unlocking caused by fake fingerprints and foreign body attacks in daily applications, as well as the information leakage derived from them. At present, after the finger is pressed on the recognition area of ​​the fingerprint module, multiple fingerprint image acquisitions and fingerprint image processing are performed serially through different acquisition parameters, so that fingerprint recognition and fingerprint anti-counterfeiting are performed respectively through the processing results of multiple fingerprint images. For example: fingerprint image 1 is collected, fingerprint image 1 is processed, fingerprint recognition is performed according to the processing results of fingerprint image 1, and then fingerprint image 2 is collected, fingerprint image 2 is processed, and fingerprint anti-counterfeiting verification is performed according to the processing results of fingerprint image 2. However, it takes a long time to perform multiple fingerprint image acquisitions and fingerprint image processing serially through different acquisition parameters, resulting in a poor user experience when performing fingerprint recognition and fingerprint anti-counterfeiting.

[0025] The embodiment of the present application provides a fingerprint image acquisition method, in which a fingerprint module acquires multiple fingerprint images through multiple acquisition parameters and then sends them to a processing unit for processing. The process of acquiring each fingerprint image includes an image acquisition step, a caching step and an image transmission step. When acquiring adjacent first fingerprint images and second fingerprint images, the start time of the image acquisition step of the second fingerprint image is between the end time of the image acquisition step corresponding to the first fingerprint image and the end time of the image transmission step corresponding to the first fingerprint image. Therefore, multiple fingerprint images can be acquired in parallel through different acquisition parameters. Compared with the prior art, since part of the acquisition process of adjacent fingerprint images in multiple fingerprint images is performed in parallel, the overall acquisition time is shorter when acquiring the same number of fingerprint images, thereby reducing the total time required for fingerprint recognition and / or fingerprint carrier status recognition, and improving user experience.

[0026] The fingerprint image acquisition method and fingerprint image processing method provided by the present application are described below through examples.

[0027] Figure 1 is a schematic diagram of a fingerprint image acquisition method provided in an embodiment of the present application, such as Figure 1As shown, the fingerprint image acquisition method includes: acquiring multiple fingerprint images through multiple acquisition parameters and then sending them to a processing unit for processing, wherein the fingerprint image is acquired and sent through the following steps: an image acquisition step 101: acquiring the fingerprint image through the corresponding acquisition parameters, a caching step 102: caching the fingerprint image, and an image transmission step 103: sending the cached fingerprint image to the processing unit.

[0028] The start time of the second fingerprint image acquisition step 101 is within the first target time period corresponding to the first fingerprint image. The first target time period starts at the end time of the first fingerprint image acquisition step 101 and ends at the end time of the first fingerprint image transmission step 103. The first fingerprint image and the second fingerprint image are two adjacently acquired fingerprint images among multiple fingerprint images, and the first fingerprint image is acquired before the second fingerprint image. Compared with the serial acquisition of fingerprints in the prior art, the first target time period is the time consumption optimized by this solution in acquiring fingerprint images.

[0029] The second fingerprint image acquisition step 101 is between the end time of the first fingerprint image acquisition step 101 and the end time of the first fingerprint image transmission step 103. It should be understood that since there is only one fingerprint module, the fingerprint module can only acquire one fingerprint image at a time, and the start time of the second fingerprint image acquisition step 101 needs to be later than the end time of the first fingerprint image acquisition step 101, for example Figure 1 As shown, fingerprint image 1 and fingerprint image 2 are adjacent fingerprint images, and the start time of fingerprint image 2's image acquisition step 101 is located at the end time of fingerprint image 1's image acquisition step 101; fingerprint image 3 and fingerprint image 2 are adjacent fingerprint images, and the start time of fingerprint image 3's image acquisition step 101 is located at the end time of fingerprint image 2's image acquisition step 101. Figure 1 This is just an example. Specifically, the start time of the fingerprint image 2 capture step 101 may also be at the end time of the fingerprint image 1 cache step 102.

[0030] It should be noted that, when the fingerprint module is an ultrasonic fingerprint module, the acquisition parameters may include ultrasonic emission frequency, ultrasonic reception delay and number of integration operations, etc., and when the fingerprint module is an optical fingerprint module, the acquisition parameters may indicate aperture size and exposure time, etc. The specific acquisition parameters can be set as needed according to the type of fingerprint module. The acquisition parameters corresponding to the first fingerprint image and the second fingerprint image may be the same or different, that is, the acquisition parameters corresponding to some fingerprint images in multiple fingerprint images may be the same. For example: multiple fingerprint images can be collected using the same acquisition parameters to perform fingerprint recognition through multiple fingerprint images.

[0031] In an embodiment of the present application, the fingerprint module collects multiple fingerprint images through multiple collection parameters and then sends them to the processing unit for processing. The process of collecting each fingerprint image includes a collection step 101, a cache step 102 and a transmission step 103. When collecting adjacent first fingerprint images and second fingerprint images, the start time of the second fingerprint image collection step 101 is between the end time of the collection step 101 corresponding to the first fingerprint image and the end time of the transmission step 103 corresponding to the first fingerprint image. Therefore, multiple fingerprint images can be collected in parallel through different collection parameters. Compared with the prior art, since part of the collection process of adjacent fingerprint images in multiple fingerprint images is carried out in parallel, the overall collection time is less when the same number of fingerprint images are collected, so as to reduce the total time required for fingerprint recognition and / or fingerprint carrier status recognition, and improve user experience.

[0032] In one possible implementation, if the cache space of the fingerprint module is greater than or equal to the first space threshold, the start time of the second fingerprint image acquisition step is within the first target time period corresponding to the first fingerprint image, and the first space threshold is greater than or equal to the space occupancy of a fingerprint image. If the cache space corresponding to the fingerprint module is less than the first space threshold, the start time of the second fingerprint image acquisition step is the end time of the first fingerprint image transmission step.

[0033] The fingerprint module has a corresponding cache space. When the cache space of the fingerprint module is less than the first space threshold, a complete fingerprint image cannot be cached in the cache space. At this time, after the fingerprint module collects the fingerprint image, it performs the cache step and the image transmission step at the same time. After sending part of the fingerprint image in the image transmission step, it continues to cache the remaining part of the fingerprint image to realize the collection and sending of the fingerprint image. At this time, if the second fingerprint image is collected, the data corresponding to the second fingerprint image will overwrite the data corresponding to the part of the first fingerprint image that is being cached or has been cached in the cache space, resulting in the loss of the fingerprint image, and it is impossible to collect multiple fingerprint images. Therefore, when the cache space corresponding to the fingerprint module is less than the first space threshold, the start time of the second fingerprint image collection step is the end time of the first fingerprint image transmission step, that is, the second fingerprint image is collected after the first fingerprint image is sent to the processing unit. Figure 2 is a schematic diagram of another fingerprint image acquisition method provided in an embodiment of the present application, such as Figure 2 As shown, when the cache space of the fingerprint module is less than the first space threshold, the start time of the image acquisition step 101 of the fingerprint image 2 is the end time of the image transmission step 103 of the fingerprint image 1, and the start time of the image acquisition step 101 of the fingerprint image 3 is the end time of the image transmission step 103 of the fingerprint image 2.

[0034] When the cache space of the fingerprint module is greater than or equal to the first space threshold, a complete fingerprint image can be cached in the cache space. At this time, after the fingerprint module collects the fingerprint image, it first performs the cache step and then the image transmission step to realize the collection and transmission of the fingerprint image. Since the cache space is sufficient to completely cache the first fingerprint image, the image collection step corresponding to the second fingerprint image and the cache step or image transmission step corresponding to the first fingerprint image can be performed in parallel. For example Figure 1 That is, the start time of the image acquisition step of the second fingerprint image is between the end time of the image acquisition step of the first fingerprint image and the end time of the image transmission step.

[0035] In the embodiment of the present application, the start time of the second fingerprint image acquisition step is determined based on whether the cache space of the fingerprint module can meet the needs of completely caching a fingerprint image. This can prevent the cache step of the second fingerprint image from overlapping with the cache step of the first fingerprint image, resulting in the data of the first fingerprint image being overwritten by the data of the second fingerprint image, thereby ensuring that multiple fingerprint images can be acquired normally.

[0036] In one possible implementation, when a fingerprint image is collected using corresponding collection parameters, a collection signal sent by a processing unit can be received, wherein when the collection parameters corresponding to the first fingerprint image and the second fingerprint image are different, the collection signals corresponding to the first fingerprint image and the second fingerprint image are sent by different processing cores of the processing unit, and the fingerprint image is collected according to the collection parameters indicated by the collection signal.

[0037] The processing unit will send a capture signal to the fingerprint module through different processing cores. The capture signal can indicate the capture parameters used by the fingerprint module when capturing the fingerprint image. For example, when the fingerprint module is an ultrasonic fingerprint module, the capture signal can indicate the capture parameters such as the transmission frequency and receiving delay of the ultrasonic signal. A single processing core of the processing unit can only control the fingerprint module to capture fingerprint images in series. For example, after the processing core 1 of the processing unit controls the fingerprint module to capture fingerprint image 1 through parameter 1, the fingerprint module caches fingerprint image 1 and sends it to the processing unit. After the processing core 1 of the processing unit completes the processing of fingerprint image 1, the processing core 1 controls the fingerprint module to capture fingerprint image 2 with parameter 1 or parameter 2. When the capture signal is sent through different processing cores of the processing unit, the fingerprint module can be controlled to capture multiple fingerprint images in parallel. For example, after the processing core 1 of the processing unit controls the fingerprint module to capture fingerprint image 1 through parameter 1, when the fingerprint module caches fingerprint image 1, the processing core 2 controls the fingerprint module to capture fingerprint image 2 through parameter 2, so as to realize the parallel execution of some steps of fingerprint image capture, for example: Figure 1 shown.

[0038] In an embodiment of the present application, a capture signal sent by a processing unit is received, and a fingerprint image is captured according to the capture parameters indicated by the capture signal. Since the capture signal is sent in parallel by different processing cores of the processing unit, the capture step of the second fingerprint image and the caching step of the first fingerprint image or the image transmission step of the first fingerprint image can be controlled in parallel by different processing cores of the processing unit, which can reduce the time required for capturing multiple fingerprint images with multiple capture parameters and improve user experience.

[0039] Figure 3 is a schematic diagram of a fingerprint image processing method provided in an embodiment of the present application, such as Figure 3 As shown, the processing unit receives multiple fingerprint images sent by the fingerprint module and processes the multiple fingerprint images, wherein the fingerprint images are processed through the following steps 301 to 302: Processing step 301: Processing the fingerprint image, reporting step 302: Outputting the processing result of the fingerprint image.

[0040] The start time of the processing step 301 of the second fingerprint image is within the second target time period corresponding to the first fingerprint image. The second target time period starts at the start time of the processing step 301 of the first fingerprint image and ends at the end time of the reporting step 302 of the first fingerprint image. The first fingerprint image and the second fingerprint image are two adjacent fingerprint images received among multiple fingerprint images, and the first fingerprint image is received before the second fingerprint image. The multiple fingerprint images are obtained by the fingerprint image acquisition method in any of the above embodiments. Compared with the serial processing of fingerprint images in the prior art, the second target time period is the time consumption optimized by this solution in processing fingerprint images.

[0041] The processing step 301 may include image processing and algorithm processing. The image processing may include synthesis, noise reduction and other processing of the fingerprint image. The algorithm processing may include fingerprint recognition and other biometric identification operations based on the fingerprint image after image processing. The adjacently received fingerprint images may be processed in parallel at least partially. Specifically, the second fingerprint image is received adjacently to the first fingerprint image, and the processing step 301 of the second fingerprint image is partially parallel to the processing step 301 or the reporting step 302 of the first fingerprint image, that is, the start time of the processing step 301 of the second fingerprint image is between the start time of the processing step 301 of the first fingerprint image and the end time of the reporting step 302 of the first fingerprint image.

[0042] In an embodiment of the present application, multiple fingerprint images sent by the fingerprint module are received. When processing the adjacent first fingerprint image and the second fingerprint image, the processing step 301 of the second fingerprint image is located between the start time of the processing step 301 of the first fingerprint image and the end time of the reporting step 302 of the first fingerprint image. The multiple fingerprint images can be processed in parallel. Compared with the prior art, since the multiple fingerprint images are processed in parallel, the time required for processing the multiple fingerprint images is less, and the start time of the image acquisition step 101 of the second fingerprint image is located between the end time of the image acquisition step 101 corresponding to the first fingerprint image and the end time of the image transmission step 103 corresponding to the first fingerprint image. In this way, multiple fingerprint images can be acquired in parallel and processed in parallel, which can reduce the time required for acquiring and processing multiple fingerprint images and improve user experience.

[0043] In one possible implementation, when processing multiple fingerprint images, the multiple fingerprint images can be processed in parallel by multiple processing cores of a processing unit, wherein the start time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image, or, the multiple fingerprint images can be processed serially by a single processing core of the processing unit, wherein the start time of the processing step of the second fingerprint image is the end time of the reporting step of the first fingerprint image.

[0044] When processing multiple fingerprint images, multiple fingerprint images can be processed in parallel through multiple processing cores. Figure 4 is a schematic diagram of another fingerprint image processing method provided in an embodiment of the present application, such as Figure 4 As shown, fingerprint image 2 and fingerprint image 1 are adjacent fingerprint images, the start time of image acquisition step 101 of fingerprint image 2 is at the start time of cache step 102 of fingerprint image 1, fingerprint image 1 completes image transmission step 103 and is transmitted to the processing unit, and the processing core 1 of the processing unit executes processing step 301 on fingerprint image 1, at this time, fingerprint image 2 completes image transmission step 103 and is transmitted to the processing unit, and the processing core 2 of the processing unit executes processing step 301 on fingerprint image 2 to realize parallel processing, and the principle of fingerprint image 3 is similar and will not be repeated here.

[0045] Alternatively, since the processing core of the electronic device includes processing cores of different specifications, the fingerprint processing process can be run on the processing core with stronger computing power of the processing unit. Figure 5 is a schematic diagram of another fingerprint image processing method provided in an embodiment of the present application, such as Figure 5As shown, fingerprint image 2 and fingerprint image 1 are adjacent fingerprint images, the start time of fingerprint image 2 image acquisition step 101 is the start time of fingerprint image 1 cache step 102, fingerprint image 1 is first transmitted to the processing unit, and the processing core 1 of the processing unit executes processing step 301 on fingerprint image 1. At this time, fingerprint image 2 is transmitted to the processing unit, and the processing core 1 of the processing unit executes the reporting step 302 of fingerprint image 1, and then executes the processing step 301 of fingerprint image 2, and after executing the reporting step 302 of fingerprint image 2, executes the processing step 301 of fingerprint image 3.

[0046] In the embodiment of the present application, multiple fingerprint images can be processed in parallel by multiple processing cores of the processing unit, or multiple fingerprint images can be processed serially by a single processing core of the processing unit. When there are more idle processing cores of the processing unit, multiple fingerprint images can be processed in parallel by multiple processing cores of the processing unit, or when multiple processing cores of the processing unit are occupied, multiple fingerprint images can be processed serially by a single processing core, thereby realizing the processing of multiple fingerprint images and reducing the time required to process multiple fingerprint images.

[0047] In a possible implementation, multiple processing cores of the processing unit send image acquisition signals to the fingerprint module, so that the fingerprint module acquires multiple fingerprint images according to the image acquisition signals, wherein the image acquisition signals sent by different processing cores correspond to different acquisition parameters.

[0048] The multiple processing cores of the processing unit can respectively send image acquisition signals to the fingerprint module, so as to control the fingerprint module to acquire fingerprint images through the multiple processing cores of the processing unit. For example, image acquisition signal 1 is sent to the fingerprint module through processing core 1. After the fingerprint module completes the image acquisition step of fingerprint image 1 according to image acquisition signal 1, image acquisition signal 2 is sent to the fingerprint module through processing core 2. The fingerprint module executes the image acquisition step of fingerprint image 2 according to image acquisition signal 2 while executing the cache step of fingerprint image 1. The image acquisition signals sent by different processing cores indicate different acquisition parameters. For example, different image acquisition signals can indicate different ultrasonic emission frequencies, ultrasonic reception delays, etc.

[0049] In an embodiment of the present application, a capture signal is sent to the fingerprint module through multiple processing cores of the processing unit, so that the fingerprint module captures multiple fingerprint images according to the capture signal. Therefore, the fingerprint module can be controlled by different processing cores of the processing unit to capture the adjacent first fingerprint image and the second fingerprint image, respectively, so that the start time of the second fingerprint image capture step is between the end time of the capture step corresponding to the first fingerprint image and the end time of the image transmission step corresponding to the first fingerprint image, so that multiple fingerprint images can be captured in parallel, reducing the time required for capturing multiple fingerprint images through different capture parameters.

[0050] In one possible implementation, when image acquisition signals are sent to the fingerprint module through multiple processing cores of the processing unit, multiple threads that are executed concurrently by multiple processing cores can be created through a process running in the trust domain of the processing unit, and different threads send image acquisition signals corresponding to different acquisition parameters to the fingerprint module. Alternatively, image acquisition signals can be sent to the fingerprint module through multiple processes running concurrently in multiple trust domains of the processing unit, wherein different processes send image acquisition signals corresponding to different acquisition parameters to the fingerprint module, and different trust domains are created in different processing cores included in the processing unit.

[0051] Trust Area (TA): TA is a secure area created on a processing unit that provides an isolated execution environment. Programs and data running in TA are isolated from the main operating system to avoid interference from malware, ensuring the security of sensitive data (such as biometric data). The fingerprint program related to the fingerprint module runs in the trust area. The trust area can be set on a single processing core of the fingerprint module. Multiple threads are created by a single process corresponding to the fingerprint program running in the trust area, and multiple processing cores are called to execute the created multiple threads concurrently. Image acquisition signals are sent to the fingerprint module in parallel through multiple threads, so that the image acquisition signals are sent to the fingerprint module through multiple processing cores of the processing unit. At this time, multiple processing cores of the processor are called by the process corresponding to the fingerprint program running on a single processing core.

[0052] The trust domain can also be set on multiple processing cores, each of which is provided with a trust domain, and each trust domain runs a fingerprint program, that is, multiple processes corresponding to the fingerprint program are running on the processing unit, each process runs on a processing core, and multiple processes concurrently send image acquisition signals to the fingerprint module, thereby realizing the sending of image acquisition signals to the fingerprint module through the multiple processing cores of the processing unit.

[0053] In an embodiment of the present application, a process running on a single processing core can be used to create multiple threads that are executed concurrently by multiple processing cores, or multiple processes running concurrently in multiple trust domains running on multiple processing cores of a processing unit can be used to send image acquisition signals to a fingerprint module through multiple processing cores. As a result, the fingerprint module can be controlled to acquire multiple fingerprint images in parallel through the multiple processing cores of the processing unit, thereby reducing the time required to acquire multiple fingerprint images.

[0054] In one possible implementation, a fingerprint recognition result can be determined based on a processing result corresponding to at least some of the fingerprint images among a plurality of fingerprint images, and / or a carrier state of a fingerprint carrier can be determined based on a processing result corresponding to at least some of the fingerprint images among a plurality of fingerprint images, wherein the fingerprint carrier is a medium that carries the fingerprint corresponding to the fingerprint image.

[0055] The fingerprint recognition result can be determined based on the processing results corresponding to some of the fingerprint images in the multiple fingerprint images. The fingerprint recognition result may include whether the fingerprint recognition is passed. When the fingerprint image matches the fingerprint template, the recognition is output as passed. When the fingerprint image does not match the fingerprint template, the recognition is output as failed.

[0056] The carrier state of the fingerprint carrier can also be determined based on the processing results corresponding to some fingerprint images among multiple fingerprint images. The carrier state can be whether the fingerprint carrier is the binary differentiation result of the finger, the medium classification of the fingerprint carrier, the physical state of the fingerprint carrier, etc., thereby realizing fingerprint anti-counterfeiting or fingerprint derivation operations.

[0057] In an embodiment of the present application, a fingerprint recognition result can be determined based on a processing result corresponding to at least some of the fingerprint images in a plurality of fingerprint images, and / or a carrier state of a fingerprint carrier can be determined based on a processing result corresponding to at least some of the fingerprint images in a plurality of fingerprint images. Thus, a plurality of fingerprint images can be collected by different collection parameters, and fingerprint recognition and / or carrier state recognition of the fingerprint carrier can be performed based on the plurality of fingerprint images. Fingerprint derivative operations such as fingerprint anti-counterfeiting can be performed while fingerprint recognition is being performed. Since the collection and / or processing of the plurality of fingerprint images are at least partially performed in parallel, the time required for fingerprint recognition and / or carrier state recognition of the fingerprint carrier can be reduced, thereby improving user experience.

[0058] Figure 6 Schematic diagram of a fingerprint image acquisition device provided by an embodiment of the present application, which is used to acquire multiple fingerprint images through multiple acquisition parameters and then send them to a processing unit for processing, wherein the acquisition and sending of fingerprint images include an image acquisition step, a cache step, and an image transmission step. Figure 6As shown, the fingerprint image acquisition device 600 includes: an image acquisition unit 601, which is used to perform an image acquisition step: acquiring a fingerprint image through corresponding acquisition parameters, a cache unit 602, which is used to perform a cache step: caching the fingerprint image, and a sending unit 603, which is used to perform an image transmission step: sending the cached fingerprint image to the processing unit, wherein the start time of the image acquisition step of the second fingerprint image is within the first target time period corresponding to the first fingerprint image, the first target time period starts with the end time of the image acquisition step of the first fingerprint image, and ends with the end time of the image transmission step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two fingerprint images collected adjacently from multiple fingerprint images, and the first fingerprint image is collected before the second fingerprint image.

[0059] In the embodiment of the present application, the image acquisition unit 601 can be used to execute step 101 in the above method embodiment, the cache unit 602 can be used to execute step 102 in the above method embodiment, and the sending unit 603 can be used to execute step 103 in the above method embodiment.

[0060] In one possible implementation, if the cache space of the fingerprint module is greater than or equal to the first space threshold, the start time of the second fingerprint image acquisition step is within the first target time period corresponding to the first fingerprint image, and the first space threshold is equal to the space occupancy of a fingerprint image. If the cache space corresponding to the fingerprint module is less than the first space threshold, the start time of the second fingerprint image acquisition step is the end time of the first fingerprint image transmission step.

[0061] In a possible implementation, the image acquisition unit 601 can also receive an image acquisition signal sent by the processing unit, wherein, when the acquisition parameters corresponding to the first fingerprint image and the second fingerprint image are different, the image acquisition signals corresponding to the first fingerprint image and the second fingerprint image are sent by different processing cores of the processing unit, and the fingerprint image is acquired according to the acquisition parameters indicated by the image acquisition signal.

[0062] Figure 7 is a schematic diagram of a fingerprint image processing device provided in an embodiment of the present application, which is used to receive multiple fingerprint images sent by a fingerprint module and process the multiple fingerprint images, wherein the fingerprint image processing includes a processing step and a reporting step. Figure 7As shown, the fingerprint image processing device 700 includes: a computing unit 701, which is used to execute a processing step: processing the fingerprint image, and a reporting unit 702, which is used to execute a reporting step: outputting the processing result of the fingerprint image, wherein the starting time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image, the second target time period takes the starting time of the processing step of the first fingerprint image as the starting point, and takes the ending time of the reporting step of the first fingerprint image as the ending point, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images received from multiple fingerprint images, and the first fingerprint image is received before the second fingerprint image, and the multiple fingerprint images are obtained by the fingerprint image acquisition method in any of the above embodiments.

[0063] In the embodiment of the present application, the calculation unit 701 may be used to execute step 301 in the above method embodiment, and the reporting unit 702 may be used to execute step 302 in the above method embodiment.

[0064] In a possible implementation, the computing unit 701 can also process multiple fingerprint images in parallel through multiple processing cores of the processing unit, wherein the start time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image; or, through a single processing core of the processing unit, process multiple fingerprint images in series, wherein the start time of the processing step of the second fingerprint image is the end time of the reporting step of the first fingerprint image.

[0065] In a possible implementation, the fingerprint image processing device 700 can send an image acquisition signal to the fingerprint module through multiple processing cores of the processing unit, so that the fingerprint module acquires multiple fingerprint images according to the image acquisition signal, wherein the image acquisition signals sent by different processing cores have different acquisition parameters.

[0066] In one possible implementation, the fingerprint image processing device 700 can create multiple threads that are executed concurrently by multiple processing cores through a process running in the trust domain of the processing unit, and different threads send image acquisition signals corresponding to different acquisition parameters to the fingerprint module; or, send image acquisition signals to the fingerprint module through multiple processes running concurrently in multiple trust domains of the processing unit, wherein different processes send image acquisition signals corresponding to different acquisition parameters to the fingerprint module, and different trust domains are created in different processing cores included in the processing unit.

[0067] In a possible implementation, the fingerprint image processing device 700 can determine the fingerprint recognition result based on the processing results corresponding to at least some of the fingerprint images among the multiple fingerprint images, and / or determine the carrier state of the fingerprint carrier based on the processing results corresponding to at least some of the fingerprint images among the multiple fingerprint images, wherein the fingerprint carrier is a medium that carries the fingerprint corresponding to the fingerprint image.

[0068] Reference Figure 8 , shows a schematic diagram of the structure of an electronic device according to an embodiment of the present application. The specific embodiment of the present application does not limit the specific implementation of the electronic device.

[0069] like Figure 8 As shown, the electronic device may include: a processor (processor) 802 , a communication interface (Communications Interface) 804 , a memory (memory) 806 , and a communication bus 808 .

[0070] in: The processor 802 , the communication interface 804 , and the memory 806 communicate with each other via a communication bus 808 .

[0071] The communication interface 804 is used to communicate with other electronic devices or servers.

[0072] The processor 802 is used to execute the program 810, and specifically can execute the relevant steps in the above-mentioned fingerprint image acquisition method or fingerprint image processing method embodiment.

[0073] Specifically, the program 810 may include program codes, which include computer operation instructions.

[0074] The processor 802 may be a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the smart device may be processors of the same type, such as one or more CPUs; one or more GPUs; or different types of processors, such as one or more CPUs, one or more GPUs, and one or more ASICs.

[0075] The memory 806 is used to store the program 810. The memory 806 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0076] The program 810 may be specifically used to enable the processor 802 to execute the fingerprint image acquisition method or the fingerprint image processing method in any of the aforementioned embodiments.

[0077] The specific implementation of each step in program 810 can refer to the corresponding description of the corresponding steps and units in any of the above-mentioned fingerprint image acquisition method or fingerprint image processing method embodiments, which will not be repeated here. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the above-mentioned method embodiments, which will not be repeated here.

[0078] In an embodiment of the present application, the fingerprint module collects multiple fingerprint images through multiple collection parameters and then sends them to the processing unit for processing. The process of collecting each fingerprint image includes a collection step, a caching step and a transmission step. When collecting adjacent first fingerprint images and second fingerprint images, the start time of the second fingerprint image collection step is between the end time of the collection step corresponding to the first fingerprint image and the end time of the transmission step corresponding to the first fingerprint image. Therefore, multiple fingerprint images can be collected in parallel through different collection parameters. Compared with the prior art, since part of the collection process of adjacent fingerprint images in multiple fingerprint images is carried out in parallel, the overall collection time is less when collecting the same number of fingerprint images, so as to reduce the total time required for fingerprint recognition and / or fingerprint carrier status recognition, and improve user experience. An embodiment of the present application also provides a computer program product, including computer instructions, which instruct a computing device to execute operations corresponding to any one of the above-mentioned multiple method embodiments.

[0079] It should be pointed out that, according to the needs of implementation, the various components / steps described in the embodiments of the present application can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present application.

[0080] The above-mentioned method according to the embodiment of the present application can be implemented in hardware, firmware, or implemented as software or computer code that can be stored in a recording medium (such as a CD ROM, RAM, floppy disk, hard disk or magneto-optical disk), or implemented as a computer code originally stored in a remote recording medium or a non-temporary machine-readable medium downloaded through a network and to be stored in a local recording medium, so that the method described herein can be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor or programmable or dedicated hardware (such as an ASIC or FPGA). It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component (for example, RAM, ROM, flash memory, etc.) that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor or hardware, the fingerprint image acquisition method or fingerprint image processing method described herein is implemented. In addition, when a general-purpose computer accesses the code for implementing the fingerprint image acquisition method or fingerprint image processing method shown herein, the execution of the code converts the general-purpose computer into a dedicated computer for executing the fingerprint image acquisition method or fingerprint image processing method shown herein.

[0081] Those of ordinary skill in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present application.

[0082] The above implementation methods are only used to illustrate the embodiments of the present application, and are not limitations on the embodiments of the present application. Ordinary technicians in the relevant technical field can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application. Therefore, all equivalent technical solutions also belong to the scope of the embodiments of the present application. The scope of patent protection of the embodiments of the present application should be limited by the claims.

Claims

1. A fingerprint image acquisition method, characterized in that: include: After collecting multiple fingerprint images through multiple collection parameters, they are sent to the processing unit for processing, wherein the fingerprint images are collected and sent through the following steps: Image acquisition step: acquiring the fingerprint image by corresponding acquisition parameters; Cache step: cache the fingerprint image; Image transmission step: sending the cached fingerprint image to the processing unit; Among them, the starting time of the image capturing step of the second fingerprint image is within the first target time period corresponding to the first fingerprint image, the first target time period starts with the end time of the image capturing step of the first fingerprint image, and ends with the end time of the image transmission step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two fingerprint images captured adjacently among the multiple fingerprint images, and the first fingerprint image is captured before the second fingerprint image.

2. The method according to claim 1, characterized in that If the cache space of the fingerprint module is greater than or equal to the first space threshold, the start time of the step of capturing the second fingerprint image is within the first target time period corresponding to the first fingerprint image, and the first space threshold is equal to the space occupied by one fingerprint image; If the cache space corresponding to the fingerprint module is smaller than the first space threshold, the start time of the image acquisition step of the second fingerprint image is the end time of the image transmission step of the first fingerprint image.

3. The method according to claim 1, characterized in that The collecting of the fingerprint image by using corresponding collection parameters includes: receiving an image acquisition signal sent by the processing unit, wherein when the acquisition parameters corresponding to the first fingerprint image and the second fingerprint image are different, the image acquisition signals corresponding to the first fingerprint image and the second fingerprint image are sent by different processing cores of the processing unit; The fingerprint image is acquired according to acquisition parameters indicated by the acquisition signal.

4. A fingerprint image processing method, characterized in that: include: Receive multiple fingerprint images sent by the fingerprint module and process the multiple fingerprint images, wherein the fingerprint images are processed by the following steps: Processing step: processing the fingerprint image; Reporting step: outputting the processing result of the fingerprint image; Among them, the starting time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image, the second target time period starts at the starting time of the processing step of the first fingerprint image, and ends at the end time of the reporting step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images received among the multiple fingerprint images, and the first fingerprint image is received before the second fingerprint image, and the multiple fingerprint images are obtained by the fingerprint image acquisition method described in any one of claims 1-3.

5. The method according to claim 4, characterized in that The processing of the multiple fingerprint images comprises: Processing the multiple fingerprint images in parallel by using multiple processing cores of a processing unit, wherein a start time of a processing step of the second fingerprint image is within a second target time period corresponding to the first fingerprint image; or, The multiple fingerprint images are processed in series through a single processing core of the processing unit, wherein the start time of the processing step of the second fingerprint image is the end time of the reporting step of the first fingerprint image.

6. The method according to claim 4, characterized in that The method further comprises: A plurality of processing cores of a processing unit sends an image acquisition signal to the fingerprint module, so that the fingerprint module acquires the plurality of fingerprint images according to the image acquisition signal, wherein the image acquisition signals sent by different processing cores correspond to different acquisition parameters.

7. The method according to claim 6, characterized in that The sending of the image acquisition signal to the fingerprint module through the multiple processing cores of the processing unit includes: By running a process in the trust domain of the processing unit, a plurality of threads executed concurrently by a plurality of processing cores are created, and different threads send the acquisition signals corresponding to different acquisition parameters to the fingerprint module; or, The image acquisition signal is sent to the fingerprint module through multiple processes running concurrently in multiple trust domains of the processing unit, wherein different processes send the image acquisition signals corresponding to different acquisition parameters to the fingerprint module, and different trust domains are created in different processing cores included in the processing unit.

8. The method according to claim 4, characterized in that The method further comprises: Determine a fingerprint recognition result based on processing results corresponding to at least some of the multiple fingerprint images, and / or determine a carrier state of a fingerprint carrier based on processing results corresponding to at least some of the multiple fingerprint images, wherein the fingerprint carrier is a medium that carries the fingerprint corresponding to the fingerprint image.

9. A fingerprint image acquisition device, characterized in that: Used to collect multiple fingerprint images through multiple collection parameters and then send them to the processing unit for processing, wherein the collection and sending of the fingerprint images include image collection steps, cache steps and image transmission steps; The fingerprint image acquisition device comprises: An image acquisition unit, used to perform an image acquisition step: acquiring the fingerprint image by corresponding acquisition parameters; A cache unit, used to perform a cache step: cache the fingerprint image; A sending unit, used to execute the image transmission step: sending the cached fingerprint image to the processing unit; Among them, the starting time of the image capturing step of the second fingerprint image is within the first target time period corresponding to the first fingerprint image, the first target time period starts with the end time of the image capturing step of the first fingerprint image, and ends with the end time of the image transmission step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two fingerprint images captured adjacently among the multiple fingerprint images, and the first fingerprint image is captured before the second fingerprint image.

10. A fingerprint image processing device, characterized in that: Used to receive multiple fingerprint images sent by the fingerprint module and process the multiple fingerprint images, wherein the processing of the fingerprint images includes a processing step and a reporting step; The fingerprint image processing device comprises: A computing unit, configured to execute a processing step: processing the fingerprint image; A reporting unit, used to perform a reporting step: output the processing result of the fingerprint image; Among them, the starting time of the processing step of the second fingerprint image is within the second target time period corresponding to the first fingerprint image, the second target time period starts at the starting time of the processing step of the first fingerprint image, and ends at the end time of the reporting step of the first fingerprint image, the first fingerprint image and the second fingerprint image are two adjacent fingerprint images received among the multiple fingerprint images, and the first fingerprint image is received before the second fingerprint image, and the multiple fingerprint images are obtained by the fingerprint image acquisition method described in any one of claims 1-3.

11. An electronic device, characterized in that: include: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to execute the fingerprint image acquisition method described in any one of claims 1-3, or execute the fingerprint image processing method described in any one of claims 4-8.

12. A computer storage medium, characterized in that: A computer program is stored thereon, and when the program is executed by a processor, the fingerprint image acquisition method as described in any one of claims 1 to 3 is implemented, or the fingerprint image processing method as described in any one of claims 4 to 8 is implemented.

Images