Image processing method, device, equipment and storage medium

By using the two stages of image processing in the biological recognition solution on mobile phones or smart watches, combined with multiple exposure processing, solve the decline in image quality in darker or strong light scenes. The problem has achieved more efficient image collection.

CN113903060BActive Publication Date: 2025-01-28BEIJING JIIOV TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111091558.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-09-17
Publication Date
2025-01-28
Estimated Expiration
2041-09-17

AI Technical Summary

Technical Problem

In the prior art, biometric solutions on mobile phones or smart watches operate in trusted execution environments, resulting in a decrease in image quality when collecting fingerprint images in dark or strong light scenes, resulting in excessive acquisition time.

Method used

Through a image processing method, the quality of the image is used to improve the quality of the image. The specific steps include the first phase of the exposure diagram read to obtain the intermediate image information, and obtain the image in the second stage processing. The processing results, at the same time, control the exposure unit for multiple exposure processing during the processing process to improve image collection efficiency.

Benefits of technology

This method reduces image collection time to a certain extent, reduces the time when the user's fingers are placed on the screen, and the image acquisition efficiency is improved, especially in dark or strong light scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113903060B_ABST
    Figure CN113903060B_ABST
Patent Text Reader

Abstract

The present application provides an image processing method, apparatus, device and storage medium, the image processing method comprising: performing image processing on a read Nth exposure image; reading an N+1th exposure image from an exposure unit according to an image fetching instruction; controlling the exposure unit to perform an N+2th exposure processing on a target to be collected to obtain an N+2th exposure image; after the image processing of the Nth exposure image is completed, N is incremented by 1, and returning to the step of performing image processing on the read Nth exposure image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of image processing, and in particular to an image processing method, apparatus, device and storage medium. Background Art

[0002] Currently, biometric solutions on mobile phones or smart watches generally run in a Trusted Execution Environment (TEE) with limited performance, in which all processes can only be executed serially. Figure 1 As shown, the control unit controls the exposure unit to perform exposure to obtain an exposure image. The control unit reads the exposure image from the exposure unit, and then sends the read exposure image to the processing subunit for comparison. If the comparison fails, the control unit controls the exposure unit to perform exposure again, and the cycle continues.

[0003] For some special scenes, such as dark or bright scenes, the light signal in the non-fingerprint area will interfere with the light metering system. The light metering system may give an incorrect exposure time, causing the collected fingerprint image to be overexposed or underexposed, thereby reducing the image quality of the collected fingerprint image.

[0004] It can be seen that in special scenarios, due to the degradation of the quality of the collected image, the terminal in the TEE environment may continue to collect fingerprints, which requires the user to place the finger on the terminal for a long time, otherwise it will be difficult to successfully match. It can be seen that there is a technical problem in the prior art that the time for collecting fingerprint images is too long. Summary of the invention

[0005] Based on this, an image processing method, device, equipment and storage medium for image alignment are proposed to solve the technical problem of too long time for image acquisition in the prior art.

[0006] In a first aspect, an image processing method is provided, comprising:

[0007] Performing image processing on the Nth exposure image read;

[0008] Read the N+1th exposure image from the exposure unit according to the image fetching instruction;

[0009] Control the exposure unit to perform an N+2th exposure process on the target to be collected, to obtain an N+2th exposure image;

[0010] After the image processing of the Nth exposure image is completed, N is incremented by 1, and the process returns to the step of performing image processing on the read Nth exposure image.

[0011] The above-mentioned image processing method first performs image processing on the Nth exposure image read; then reads the N+1th exposure image from the exposure unit according to the image acquisition instruction; and controls the exposure unit to perform the N+2th exposure processing on the target to be collected to obtain the N+2th exposure image; finally, after the image processing of the Nth exposure image is completed, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned. It can be seen that while performing the Nth image processing, the N+2th exposure image can be obtained, and the serial process is: after obtaining the Nth exposure image, the Nth image processing is performed, that is, while performing the Nth image processing, only the Nth exposure image can be obtained. Therefore, compared with the serial process, the time required for multiple exposures will be less, which reduces the image collection time to a certain extent, and when the target to be collected is a fingerprint, the user no longer needs to place the finger on the terminal for a long time to collect more exposure images, which reduces the time the user's finger is placed on the screen to a certain extent.

[0012] In some embodiments of the present invention, the image processing comprises:

[0013] Performing the first stage processing on the N-th exposure image to obtain intermediate image information;

[0014] The intermediate image information is subjected to second-stage processing to obtain an image processing result.

[0015] The above embodiment illustrates the image processing, that is, the image processing is divided into two stages of processing, and intermediate image information and image processing results are obtained, so that various subsequent operations can use the staged information data.

[0016] In some embodiments of the present invention, the step of reading the N+1th exposure image from the exposure unit according to the image fetching instruction includes:

[0017] When N is greater than or equal to 2, after the first stage processing of the Nth exposure image is completed, the N+1th exposure image is read from the exposure unit according to the image fetching instruction.

[0018] The above embodiment explains that when the image processing is performed in stages, the timing of reading the N+1th exposure image is to be started after the first stage processing of the Nth exposure image is completed.

[0019] In some embodiments of the present invention, when N=1, when starting to perform the first stage processing on the Nth exposure image, the exposure unit is controlled to perform the N+1th exposure processing on the target to be captured.

[0020] In the above embodiment, since the processing subunit and the exposure unit are two different units, when the processing subunit starts to perform the first stage processing on the Nth exposure image, the exposure unit can also be controlled to perform the N+1th exposure processing on the target to be collected, so that the processing subunit and the exposure unit can execute separately and simultaneously, thereby reducing the time that the user's finger is placed on the screen to a certain extent.

[0021] In some embodiments of the present invention, controlling the exposure unit to perform an N+2th exposure process on the target to be collected includes:

[0022] When the second stage processing of the intermediate image information corresponding to the Nth exposure image begins, the exposure unit is controlled to perform the N+2th exposure processing on the target to be collected.

[0023] The above embodiment describes the exposure timing of the N+2th exposure, that is, when the second stage processing of the intermediate image information corresponding to the Nth exposure image begins, the exposure unit is controlled to perform the N+2th exposure processing on the target to be collected.

[0024] In some embodiments of the present invention, performing the second stage processing on the intermediate image information to obtain an image processing result includes:

[0025] A fused image is obtained based on the intermediate image information corresponding to the Nth exposure image.

[0026] The above embodiment describes the processing result of the second stage processing. The fused image can be obtained through the second stage processing, thereby realizing continuous fusion.

[0027] In some embodiments of the present invention, obtaining a fused image based on the intermediate image information corresponding to the Nth exposure image includes:

[0028] A fused image is obtained according to the intermediate image information corresponding to the N-th exposure image and at least one intermediate image information before the N-th exposure image.

[0029] The above embodiment describes that the fused object includes the intermediate image information corresponding to the Nth exposure image and at least one intermediate image information before the Nth exposure image.

[0030] In some embodiments of the present invention, obtaining the fused image according to the intermediate image information corresponding to the N-th exposure image and at least one intermediate image information before the N-th exposure image includes:

[0031] A fused image is obtained based on the intermediate image information corresponding to the Nth exposure image and the intermediate image information corresponding to the 1st exposure image to the N-1th exposure image.

[0032] In the above embodiment, fusion is performed based on all exposure images, so that a completely continuous fused image can be obtained.

[0033] In some embodiments of the present invention, performing the second stage processing on the intermediate image information to obtain an image processing result includes:

[0034] Obtaining a fused image based on the intermediate image information corresponding to the Nth exposure image;

[0035] Performing comparison processing on the fused image to obtain a comparison result of the fused image;

[0036] After the image processing of the Nth exposure image is completed, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned, including: when the comparison result of the fused image is a comparison failure, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned.

[0037] In the above embodiment, the image processing result is the comparison result of the fused image. When the comparison fails, the next cycle is entered, and when the comparison succeeds, the next cycle is exited.

[0038] In some embodiments of the present invention, performing the second stage processing on the intermediate image information to obtain an image processing result includes:

[0039] When N is less than K, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image;

[0040] When N is greater than or equal to K, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image; a comparison process is performed on the fused image to obtain a comparison result of the fused image; after the image processing of the Nth exposure image is completed, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned, including: when the comparison result of the fused image is a comparison failure, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned.

[0041] In the above embodiment, when N is less than K, the quality of the fused image is improved by continuous fusion. When N is greater than or equal to K, fusion is performed first and then comparison is performed. If the comparison fails, the next cycle is performed, and if the comparison succeeds, the cycle is exited.

[0042] In some embodiments of the present invention, the first stage of processing includes feature extraction, and the second stage of processing includes feature comparison;

[0043] The performing the first stage processing on the Nth exposure image to obtain intermediate image information includes: extracting features from a fused image obtained based on the Nth exposure image to obtain fused features;

[0044] The performing the second stage processing on the intermediate image information to obtain the image processing result includes: performing feature comparison on the fusion feature to obtain the comparison result corresponding to the Nth exposure image;

[0045] After the image processing of the Nth exposure image is completed, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned, including: when the comparison result corresponding to the Nth exposure image is a comparison failure, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned.

[0046] The above embodiment illustrates that the first stage of processing includes feature extraction, and the second stage of processing includes feature comparison. The next cycle is performed only when the feature comparison fails.

[0047] In some embodiments of the present invention, the target to be collected includes a fingerprint, and the exposure image includes a fingerprint exposure image.

[0048] The above embodiments illustrate application scenarios.

[0049] In a second aspect, an image processing device is provided, comprising:

[0050] A processing module, used for performing image processing on the read Nth exposure image;

[0051] An image fetching module, used for reading the N+1th exposure image from the exposure unit according to the image fetching instruction;

[0052] An exposure module, used for controlling the exposure unit to perform an N+2th exposure process on the target to be collected, to obtain an N+2th exposure image;

[0053] The return module is used to, after the image processing of the Nth exposure image is completed, accumulate N by 1 and return to the step of performing image processing on the read Nth exposure image.

[0054] In some embodiments of the present invention, the image processing apparatus further includes: an image processing module, configured to:

[0055] Performing the first stage processing on the N-th exposure image to obtain intermediate image information;

[0056] The intermediate image information is subjected to a second-stage processing to obtain an image processing result.

[0057] In some embodiments of the present invention, the image acquisition module is specifically used to:

[0058] When N is greater than or equal to 2, after the first stage processing of the Nth exposure image is completed, the N+1th exposure image is read from the exposure unit according to the image fetching instruction.

[0059] In some embodiments of the present invention, the image processing device further includes: an N=1 module, which is used to: when N=1, when starting the first stage processing of the Nth exposure image, control the exposure unit to perform the N+1th exposure processing on the target to be collected.

[0060] In some embodiments of the present invention, the exposure module is specifically used for:

[0061] When the second stage processing of the intermediate image information corresponding to the Nth exposure image begins, the exposure unit is controlled to perform the N+2th exposure processing on the target to be collected.

[0062] In some embodiments of the present invention, the image processing module is specifically used to:

[0063] A fused image is obtained based on the intermediate image information corresponding to the Nth exposure image.

[0064] In some embodiments of the present invention, the image processing module is specifically used to:

[0065] A fused image is obtained according to the intermediate image information corresponding to the N-th exposure image and at least one intermediate image information before the N-th exposure image.

[0066] In some embodiments of the present invention, the image processing module is specifically used to:

[0067] A fused image is obtained based on the intermediate image information corresponding to the Nth exposure image and the intermediate image information corresponding to the 1st exposure image to the N-1th exposure image.

[0068] In some embodiments of the present invention, the image processing module is specifically used to:

[0069] Obtaining a fused image based on the intermediate image information corresponding to the Nth exposure image;

[0070] Performing comparison processing on the fused image to obtain a comparison result of the fused image;

[0071] The return module is specifically used to: when the comparison result of the fused image is a comparison failure, N is incremented by 1, and the step of performing image processing on the read Nth exposure image is returned.

[0072] In some embodiments of the present invention, the image processing module is specifically used to:

[0073] When N is less than K, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image;

[0074] When N is greater than or equal to K, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image; a comparison process is performed on the fused image to obtain a comparison result of the fused image; and the return module is specifically used to: when the comparison result of the fused image is a comparison failure, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned.

[0075] In some embodiments of the present invention, the first stage of processing includes feature extraction, and the second stage of processing includes feature comparison;

[0076] The image processing module is specifically used to: extract features from the fused image obtained based on the Nth exposure image to obtain fused features;

[0077] The image processing module is specifically used to: perform feature comparison on the fusion features to obtain a comparison result corresponding to the Nth exposure image;

[0078] The return module is specifically used to: when the comparison result corresponding to the Nth exposure image is a comparison failure, N is incremented by 1, and the step of performing image processing on the read Nth exposure image is returned.

[0079] In some embodiments of the present invention, the target to be collected includes a fingerprint, and the exposure image includes a fingerprint exposure image.

[0080] According to a third aspect, a device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the image processing method described above when executing the computer program.

[0081] In a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer program instructions, and when the computer program instructions are read and executed by a processor, the steps of the image processing method described above are executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0082] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0083] Figure 1 A schematic diagram of serial logic provided by an embodiment of the present application;

[0084] Figure 2 A schematic diagram of the implementation flow of the image processing method provided in the embodiment of the present application;

[0085] Figure 3 A schematic diagram of a terminal display target area provided in an embodiment of the present application;

[0086] Figure 4 A schematic diagram of the process of an image processing method provided in an embodiment of the present application;

[0087] Figure 5 A schematic diagram of the process of an image processing method provided in an embodiment of the present application;

[0088] Figure 6 A schematic diagram of the process of an image processing method provided in an embodiment of the present application;

[0089] Figure 7 A schematic diagram of the process of an image processing method provided in an embodiment of the present application;

[0090] Figure 8 A schematic diagram of the process of an image processing method provided in an embodiment of the present application;

[0091] Fig. 9 A schematic diagram of the process of an image processing method provided in an embodiment of the present application;

[0092] Fig.10 A schematic diagram of obtaining a fused image according to the image quality of an image region provided in an embodiment of the present application;

[0093] Fig.11 A schematic diagram of the process of an image processing method provided in an embodiment of the present application;

[0094] Fig.12 A schematic diagram of the process of an image processing method provided in an embodiment of the present application;

[0095] Fig.13 A schematic diagram of the process of an image processing method provided in an embodiment of the present application;

[0096] Fig.14 A schematic diagram of the process of an image processing method provided in an embodiment of the present application;

[0097] Fig.15 A schematic diagram of the process of an image processing method provided in an embodiment of the present application;

[0098] Fig.16 A schematic diagram of the structure of an image processing device provided in an embodiment of the present application;

[0099] Fig.17 This is a block diagram of the internal structure of the device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0100] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0101] In one embodiment, an image processing method is provided. The execution subject of the image processing method described in the embodiment of the present invention is a device that can implement the image processing method described in the embodiment of the present invention, and the device may include but is not limited to a terminal and a server. Furthermore, the execution subject of the image processing method described in the embodiment of the present invention includes a control unit in a terminal or a server, and the terminal may be an electronic device. Exemplarily, the terminal includes a desktop terminal and a mobile terminal. The desktop terminal includes but is not limited to a desktop computer and a car computer; the mobile terminal includes but is not limited to a mobile phone, a tablet, a laptop computer, a smart watch, a smart bracelet, a smart wearable device, and an attendance device. The server includes a high-performance computer and a high-performance computer cluster. The image processing method described in the embodiment of the present invention can be applied to but is not limited to fingerprint collection scenarios. The following mainly takes the fingerprint collection scenario as an example to illustrate the image processing method described in the embodiment of the present invention.

[0102] like Figure 2 As shown, an image processing method is provided, comprising:

[0103] Step 100, performing image processing on the read Nth exposure image.

[0104] The Nth exposure image is an exposure image obtained after the target to be collected is exposed for the Nth time; image processing is processing of the image, such as image recognition, anti-counterfeiting detection, etc.

[0105] In one example, after reading the Nth exposure image, the control unit performs image processing on the Nth exposure image.

[0106] In one example, the control unit includes a processing subunit, that is, the processing subunit is a part of the control unit. After reading the Nth exposure image, the control unit sends the read Nth exposure image to the processing subunit for image processing. The following takes the processing subunit performing image processing as an example to illustrate the embodiment of the present invention.

[0107] Step 200 , reading the N+1th exposure image from the exposure unit according to the image fetching instruction.

[0108] The image fetching instruction is an instruction to fetch an image from the exposure unit; the exposure unit is a unit that can expose the target to be collected and obtain an exposure image, for example, the exposure unit includes an image sensor; the N+1th exposure image is an exposure image obtained after the N+1th exposure of the target to be collected.

[0109] Step 300: Control the exposure unit to perform an N+2th exposure process on the target to be collected to obtain an N+2th exposure image.

[0110] The target to be collected is the target to be collected; the N+2th exposure image is the exposure image obtained after the target to be collected is exposed for the N+2th time.

[0111] For example, a target area is set on the terminal, and the target in the target area is the target to be collected. For example, if the target in the target area is a finger, the target to be collected is a fingerprint, or if the target in the target area is a face, the target to be collected is a face.

[0112] In order to avoid unnecessary collection and thus waste system resources and increase system power consumption, when a target is located in the target area, the type of the target is first confirmed. When the type of the target located in the target area is a specified type, the target is confirmed to be a target to be collected, for example, the specified type is a fingerprint type.

[0113] Being located in the target area may mean that the target is within a certain distance directly above the target area, for example, the target is within 1 centimeter directly above the target area; or, the target is within the target area and in contact with the target area, for example, the target touches the target area.

[0114] The target area can be set on the front of the terminal (i.e. the side facing the user for a long time), such as Figure 3 As shown, the target area is set at the upper left corner position A, the lower right corner position B or the center position C of the terminal screen. The target area can also be set on the back of the terminal (i.e., the side that is long-term facing away from the user). Exemplarily, the target area is set at the upper left corner position, the lower right corner position or the center position on the back of the terminal.

[0115] In one example, the application scenario is an under-screen fingerprint scenario, the target to be collected is a fingerprint, the exposure image is a fingerprint exposure image, and the device includes an under-screen fingerprint module. When the under-screen fingerprint module includes an exposure unit and a control unit, the execution subject of the image processing method described in the embodiment of the present invention is the under-screen fingerprint module; when the under-screen fingerprint module includes an exposure unit and the control unit is located in an electronic device, the image processing method described in the embodiment of the present invention is executed by a processor in the electronic device; when the processing subunit for image processing in the control unit is located in the electronic device, and other subunits in the control unit are located in the under-screen fingerprint module, the image processing method described in the embodiment of the present invention is partially executed by the processor in the electronic device and partially executed by the under-screen fingerprint module. The under-screen fingerprint module is set below the target area on the device screen. When the finger touches the target area on the device screen, the under-screen fingerprint module is triggered to perform corresponding fingerprint collection and processing operations.

[0116] Step 400, after the image processing of the Nth exposure image is completed, N is incremented by 1, and the process returns to the step of performing image processing on the read Nth exposure image.

[0117] After the processing subunit receives the Nth exposure image sent by the control unit, it performs image processing on the Nth exposure image. After the processing subunit completes the image processing on the Nth exposure image, the control unit controls N to accumulate 1, and then returns to step 100 to perform the next cycle. Figure 4 As shown. When N=1, the first exposure image t1 is sent to the processing subunit (the processing subunit starts to process t1), and the second exposure image t2 is read according to the image fetching instruction. After reading, the exposure unit is controlled to perform the third exposure processing to obtain the third exposure image t3. After the image processing of the first exposure image t1 is completed, N=2, the second exposure image t2 is sent to the processing subunit (the processing subunit starts to process t2), and the third exposure image t3 is read according to the image fetching instruction. After reading, the exposure unit is controlled to perform the fourth exposure processing to obtain the fourth exposure image t4. After the image processing of the second exposure image t2 is completed, N=3, and the cycle is repeated. In one example, when N is equal to a preset value, the cycle is stopped. In another example, when a predetermined condition is met, the cycle is stopped, for example, the predetermined condition is that the image comparison is successful or the image meets the target clarity requirement.

[0118] In one example, if Figure 5As shown, the acquisition of the first exposure image t1 and the second exposure image t2 is explained. Before the read Nth exposure image is subjected to image processing in step 100, the method further includes: when it is detected that a target touches a target area, determining the type of the target; when the type of the target is a specified type, determining that the target is a target to be collected, controlling the exposure unit to perform the first exposure on the target to be collected, and obtaining the first exposure image t1; generating an image acquisition instruction; reading the first exposure image t1 from the exposure unit according to the image acquisition instruction; controlling the exposure unit to perform the second exposure on the target to be collected, and obtaining the second exposure image t2; and entering step 100.

[0119] The above-mentioned image processing method first performs image processing on the Nth exposure image read; then reads the N+1th exposure image from the exposure unit according to the image acquisition instruction; and controls the exposure unit to perform the N+2th exposure processing on the target to be collected to obtain the N+2th exposure image; finally, after the image processing of the Nth exposure image is completed, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned. It can be seen that while performing the Nth image processing, the N+2th exposure image can be obtained, and the serial process is: after obtaining the Nth exposure image, the Nth image processing is performed, that is, while performing the Nth image processing, only the Nth exposure image can be obtained. Therefore, compared with the serial process, the time required for multiple exposures will be less, which reduces the image collection time to a certain extent, and when the target to be collected is a fingerprint, the user no longer needs to place the finger on the terminal for a long time to collect more exposure images, which reduces the time the user's finger is placed on the screen to a certain extent.

[0120] In one embodiment, the image processing includes:

[0121] Performing the first stage processing on the N-th exposure image to obtain intermediate image information;

[0122] The intermediate image information is subjected to a second-stage processing to obtain an image processing result.

[0123] Image processing is divided into two stages: first stage processing and second stage processing. By performing the first stage processing on the Nth exposure image, intermediate image information can be obtained, wherein the intermediate image information refers to the information data obtained during the entire image processing process, rather than the information data finally obtained from the entire image processing. After obtaining the intermediate image information, the second stage processing is performed on the intermediate image information to obtain the image processing result, that is, the final result of the image processing.

[0124] In one example, the first stage of processing is image preprocessing, which includes image enhancement. Accordingly, the intermediate image information is the enhanced image of the Nth exposure image; the second stage of processing is image comparison. Accordingly, the image processing result is the image comparison result. The image comparison includes: comparing the enhanced image of the Nth exposure image with multiple preset images to obtain the similarity between the enhanced image of the Nth exposure image and each preset image, obtaining the maximum similarity from the similarity between the enhanced image of the Nth exposure image and each preset image, and obtaining the image comparison result according to the maximum similarity. For example, the preset image corresponding to the maximum similarity is Zhang San's fingerprint exposure image, so the image comparison result is Zhang San.

[0125] The above embodiment illustrates the image processing, that is, the image processing is divided into two stages of processing, and intermediate image information and image processing results are obtained, so that various subsequent operations can use the staged information data.

[0126] In one embodiment, the step 200 of reading the N+1th exposure image from the exposure unit according to the image fetching instruction includes:

[0127] When N is greater than or equal to 2, after the first stage processing of the Nth exposure image is completed, the N+1th exposure image is read from the exposure unit according to the image fetching instruction.

[0128] In one example, when N is greater than or equal to 2, the processing subunit sends an image fetching instruction to the control unit after completing the first stage processing of the Nth exposure image; after receiving the image fetching instruction, the control unit reads the N+1th exposure image from the exposure unit according to the image fetching instruction.

[0129] like Figure 6 As shown, when N=2, the read second exposure image t2 is sent to the processing subunit, and the processing subunit performs the first stage processing on the second exposure image t2. After the first stage processing of the second exposure image t2 is completed, the image fetching instruction is sent to the control unit. The control unit reads the third exposure image t3 according to the image fetching instruction. After reading the third exposure image t3, the exposure unit is controlled to perform the fourth exposure processing to obtain the fourth exposure image t4. After the second stage processing of the processing subunit is completed, N=3; the read third exposure image t3 is sent to the processing subunit, and the processing subunit performs the first stage processing on the third exposure image t3. After the first stage processing of the third exposure image t3 is completed, the image fetching instruction is sent to the control unit. The control unit reads the fourth exposure image t4 according to the image fetching instruction. After reading the fourth exposure image t4, the exposure unit is controlled to perform the fifth exposure processing to obtain the fifth exposure image t5. After the second stage processing of the processing subunit is completed, N=4, and the cycle is repeated.

[0130] at the same time, Figure 6 The following also illustrates how the first exposure image t1 and the second exposure image t2 are obtained, and the processing when N=1. Figure 5 Next, the processing when N=1 is described, including: sending the first exposure image t1 to the processing subunit for the first stage of processing, after the first stage of processing is completed, reading the second exposure image t2 from the exposure unit according to the image fetching instruction; after the second exposure image t2 is read, controlling the exposure unit to perform the third exposure to obtain the third exposure image t3; after the second stage of processing of the processing subunit is completed, N=2; enter step 100.

[0131] The above embodiment explains that when the image processing is performed in stages, the timing of reading the N+1th exposure image is to be started after the first stage processing of the Nth exposure image is completed.

[0132] In one embodiment, when N=1, when starting to perform the first stage processing on the Nth exposure image, the exposure unit is controlled to perform the N+1th exposure processing on the target to be collected.

[0133] like Figure 7 As shown in FIG. 1 , when N=1, when the processing subunit starts to perform the first stage processing on the first exposure image t1, the exposure unit is controlled to perform the second exposure processing on the target to be collected, that is, the first stage processing on the first exposure image t1 and the second exposure processing are started at the same time. Figure 6 There are five steps: t1 exposure, t1 image acquisition, t2 exposure, sending t1 and t1 first stage processing. Since t2 exposure and t1 first stage processing are carried out simultaneously, the time the user's finger is placed on the screen is reduced to a certain extent.

[0134] In the above embodiment, since the processing subunit and the exposure unit are two different units, when the processing subunit starts to perform the first stage processing on the Nth exposure image, the exposure unit can also be controlled to perform the N+1th exposure processing on the target to be collected, so that the processing subunit and the exposure unit can execute separately and simultaneously, thereby reducing the time that the user's finger is placed on the screen to a certain extent.

[0135] In one embodiment, the step 300 of controlling the exposure unit to perform the N+2th exposure process on the target to be collected includes:

[0136] When the second stage processing of the intermediate image information corresponding to the Nth exposure image begins, the exposure unit is controlled to perform the N+2th exposure processing on the target to be collected.

[0137] like Figure 8As shown, the read first exposure image t1 is sent to the processing subunit, and then the processing subunit starts the first stage processing, and reads the second exposure image t2 from the exposure unit according to the image fetching instruction, that is, the first stage processing and reading the second exposure image t2 from the exposure unit are started at the same time; after the processing subunit completes the first stage processing, the second stage processing is started, and when the second stage processing is started, the exposure unit is controlled to perform the third exposure processing (that is, the second stage processing and the third exposure processing are started at the same time), and the third exposure image t3 is obtained. After the second stage processing is completed, N=2; the read second exposure image t2 is sent to the processing subunit, and then the processing subunit starts the first stage processing, and reads the third exposure image t3 from the exposure unit according to the image fetching instruction. After the processing subunit completes the first stage processing, the second stage processing is started, and when the second stage processing is started, the exposure unit is controlled to perform the fourth exposure processing to obtain the fourth exposure image t4. After the second stage processing is completed, N=3, and the cycle is repeated.

[0138] The above embodiment describes the exposure timing of the N+2th exposure, that is, when the second stage processing of the intermediate image information corresponding to the Nth exposure image begins, the exposure unit is controlled to perform the N+2th exposure processing on the target to be collected.

[0139] In one embodiment, performing the second stage processing on the intermediate image information to obtain an image processing result includes:

[0140] A fused image is obtained based on the intermediate image information corresponding to the Nth exposure image.

[0141] In one example, the first stage is image enhancement, and correspondingly, the intermediate image information is an enhanced image. The second stage is image fusion, and the image fusion includes: determining the number of weights according to the number of enhanced images to be fused; determining the weight of each enhanced image to be fused; and obtaining a fused image according to the weight of each enhanced image to be fused and each enhanced image to be fused. For example, there are three enhanced images to be fused: T1, T2, and T3, and the weights of the three enhanced images to be fused are w1, w2, and w3, so the fused image is: T1×w1+T2×w2+T3×w3. Determining the weight of the enhanced image to be fused includes: determining the weight of the enhanced image to be fused according to the image quality of the enhanced image to be fused, for example, the higher the image quality of the enhanced image, the greater the weight corresponding to the enhanced image, and vice versa, the lower the image quality of the enhanced image, the smaller the weight corresponding to the enhanced image.

[0142] like Fig. 9As shown, when N=1, the first stage is image enhancement, that is, the first exposure image t1 is enhanced to obtain enhanced t1, and the second stage is image denoising on the enhanced image t1 to obtain a denoised image, that is, denoised t1, and the denoised t1 is used as the fused image 1 when N=1; when N is greater than or equal to 2, the first stage is image enhancement, and the second stage is image fusion. When N=2, the fused image 1 is fused with the enhanced image t2 to obtain the fused image 2; when N=3, the enhanced image 3 and the fused image 2 can be fused, and the cycle is repeated.

[0143] In one example, the first stage of processing includes image quality calculation of the image area of ​​the Nth exposure image, and accordingly, the intermediate image information is the image quality of each image area in the Nth exposure image; the second stage of processing includes effective area identification, effective area extraction and effective area stitching. The image quality calculation of the image area of ​​the Nth exposure image includes: dividing the Nth exposure image into a preset number of image areas; calculating the image quality of each image area, for example, calculating the image quality of the image area based on the clarity and brightness of the image area. Effective area identification refers to selecting a high-quality image area from the image area of ​​the exposure image to be fused. Effective area extraction refers to segmenting a high-quality image area from the image area of ​​the exposure image to be fused. Effective area stitching refers to stitching the segmented high-quality image areas to obtain a fused image.

[0144] For example Fig.10 As shown, N=3, the first stage of processing: the image quality of the four image areas in the third exposure image is calculated to obtain the intermediate image information corresponding to the third exposure image, that is, the image quality of the four image areas in the third exposure image; assuming that the exposure images to be fused include the first exposure image, the second exposure image, and the third exposure image (because the image quality of the four image areas in the first exposure image and the image quality of the four image areas in the second exposure image have been obtained when N=1 and N=2, the calculation of the image quality of the four image areas in the first exposure image and the image quality of the four image areas in the second exposure image will not be described in detail here), so the second stage of processing is: first, according to the image quality of the image areas in the first exposure image, the second exposure image, and the third exposure image, select high-quality image areas, such as Fig.10 As shown, the high-quality image areas are 31, 32, 23 and 14. It should be noted that Fig.10 In the above formula, ij->m means that the quality score of image area ij is m, i refers to the i-th exposure image, and j refers to the j-th image area in the exposure image. Then, image area 31, image area 32, image area 23 and image area 14 are segmented from the three exposure images, and effective area extraction is achieved. Finally, the segmented four image areas are spliced ​​to obtain a fused image.

[0145] In one example, if Fig.11 As shown, when N=1, since there is no object that can be fused, at this time, the first stage processing is image enhancement to obtain enhancement t1, and the second stage processing includes: performing image quality calculation of the image area of ​​the enhanced image of the first exposure image to obtain the image quality of each image area in the first exposure image t1, and taking the enhanced image of the first exposure image t1 as the fused image when N=1; when N is greater than or equal to 2, the first stage processing is performing image quality calculation of the image area of ​​the Nth exposure image to obtain the image quality of each image area in the Nth exposure image, and the second stage processing includes: obtaining a high-quality image area according to the image quality of each image area in the Nth exposure image and the N-1th exposure image; segmenting a high-quality image area from the Nth exposure image and the N-1th exposure image; and splicing the segmented high-quality image areas to obtain a fused image.

[0146] The above embodiment describes the processing result of the second stage processing. The fused image can be obtained through the second stage processing, thereby realizing continuous fusion.

[0147] In one embodiment, obtaining the fused image based on the intermediate image information corresponding to the Nth exposure image includes:

[0148] A fused image is obtained according to the intermediate image information corresponding to the N-th exposure image and at least one intermediate image information before the N-th exposure image.

[0149] For example, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image and the intermediate image information corresponding to the N-1th exposure image; for another example, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image, the intermediate image information corresponding to the N-1th exposure image and the intermediate image information corresponding to the N-2th exposure image.

[0150] The above embodiment describes that the fused object includes the intermediate image information corresponding to the Nth exposure image and at least one intermediate image information before the Nth exposure image.

[0151] In one embodiment, obtaining the fused image according to the intermediate image information corresponding to the N-th exposure image and at least one intermediate image information before the N-th exposure image includes:

[0152] A fused image is obtained based on the intermediate image information corresponding to the Nth exposure image and the intermediate image information corresponding to the 1st exposure image to the N-1th exposure image.

[0153] The fused image is obtained according to the intermediate image information of the first exposure image, the second exposure image, the third exposure image, ..., the N-1 exposure image and the N exposure image. For example, N weights are determined, namely w1, w2, ... wN, and the N exposure images are respectively: T1, T2, ... TN, so the fused image is: T1×w1+T2×w2+...+TN×wN.

[0154] In the above embodiment, fusion is performed based on all exposure images, so that a completely continuous fused image can be obtained.

[0155] In one embodiment, performing the second stage processing on the intermediate image information to obtain an image processing result includes:

[0156] Obtaining a fused image based on the intermediate image information corresponding to the Nth exposure image;

[0157] Performing comparison processing on the fused image to obtain a comparison result of the fused image;

[0158] After the image processing of the Nth exposure image is completed, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned, including: when the comparison result of the fused image is a comparison failure, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned.

[0159] Take the first stage of image enhancement as an example, Fig.12 As shown, when N=1, the first exposure image t1 is first enhanced to obtain an enhanced image of the first exposure image, that is, enhanced t1, and then a comparison process is performed based on the enhanced image of the first exposure image t1 to obtain a comparison result of the enhanced image of the first exposure image t1. If the comparison fails, N=2; when N is greater than or equal to 2, the first stage of processing is: image enhancement is performed on the Nth exposure image to obtain an enhanced image of the Nth exposure image; the second stage of processing is to obtain a fused image based on the enhanced image of the Nth exposure image, for example, the enhanced image of the Nth exposure image and the enhanced image of the N-1th exposure image are fused to obtain a fused image, and then the fused image is compared to obtain a comparison result. If the comparison fails, N is accumulated by 1. If the comparison is successful, the loop is exited.

[0160] In one example, assuming that the first stage of processing is to perform image quality calculation on the image area of ​​the Nth exposure image to obtain the image quality of each image area in the Nth exposure image, the second stage of processing may include: effective area identification, effective area extraction, effective area stitching (to obtain a fused image) and fused image comparison.

[0161] In the above embodiment, the image processing result is the comparison result of the fused image. When the comparison fails, the next cycle is entered, and when the comparison succeeds, the next cycle is exited.

[0162] In one embodiment, performing the second stage processing on the intermediate image information to obtain an image processing result includes:

[0163] When N is less than K, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image;

[0164] When N is greater than or equal to K, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image; a comparison process is performed on the fused image to obtain a comparison result of the fused image; after the image processing of the Nth exposure image is completed, N is incremented by 1, and the step of sending the read Nth exposure image to the processing subunit for image processing is returned, including: when the comparison result of the fused image is a comparison failure, N is incremented by 1, and the step of sending the read Nth exposure image to the processing subunit for image processing is returned.

[0165] In one example, the first stage of processing is image enhancement, such as Fig.13 As shown, K=4, when N=1, the first exposure image t1 is sent to the processing subunit, and the processing subunit performs image enhancement processing to obtain enhancement t1. In the second stage of processing, the enhancement t1 is directly used as the fused image 1 when N=1; when N=2, the first stage of processing is to perform image enhancement on the second exposure image t2 to obtain enhancement t2, and the second stage of processing is to realize the fusion of fused image 1 and enhancement t2 according to the formula T1×w1+T2×w2 to obtain fused image 2; when N=3, the first stage of processing is to perform image enhancement on the third exposure image t3 to obtain enhancement t3, and the second stage of processing is to realize the fusion of fused image 2 and enhancement t3 according to the formula T1×w1+T2×w2 to obtain a fused image 3; when N=4, the first stage of processing is to perform image enhancement on the fourth exposure image t4 to obtain enhanced t4, and the second stage of processing includes: according to the formula T1×w1+T2×w2, the fusion of fused image 3 and enhanced t4 is realized to obtain fused image 4, and the fusion image 4 is compared to obtain the comparison result of fused image 4. If the comparison fails, then N=5; when N=5, the first stage of processing is to perform image enhancement on the fifth exposure image t5 to obtain enhanced t5, and the second stage of processing includes: according to the formula T1×w1+T2×w2, the fusion of fused image 4 and enhanced t5 is realized to obtain fused image 5, and the fusion image 5 is compared to obtain the comparison result of fused image 5. If the comparison fails, then N=6. Cycle in sequence.

[0166] In the above embodiment, when N is less than K, the quality of the fused image is improved by continuous fusion. When N is greater than or equal to K, fusion is performed first and then comparison is performed. If the comparison fails, the next cycle is performed, and if the comparison succeeds, the cycle is exited.

[0167] In one embodiment, the first stage of processing includes feature extraction, and the second stage of processing includes feature comparison;

[0168] The performing the first stage processing on the Nth exposure image to obtain intermediate image information includes: extracting features from a fused image obtained based on the Nth exposure image to obtain fused features;

[0169] The performing the second stage processing on the intermediate image information to obtain the image processing result includes: performing feature comparison on the fusion feature to obtain the comparison result corresponding to the Nth exposure image;

[0170] After the image processing of the Nth exposure image is completed, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned, including: when the comparison result corresponding to the Nth exposure image is a comparison failure, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned.

[0171] In one example, if Fig.14As shown, when N=1, the first exposure image t1 is sent to the processing subunit, and then the second exposure image t2 is read from the exposure unit according to the image fetching instruction. After receiving the first exposure image t1, the processing subunit first performs a first-stage processing on the first exposure image t1, including: extracting features from the first exposure image t1 to obtain image features of the first exposure image t1, i.e., t1 features, and then performs a second-stage processing, including: performing feature comparison on the image features of the first exposure image t1 to obtain a comparison result corresponding to the first exposure image t1. The comparison result is failure, so N=2. When N=2, the second exposure image t2 is sent to the processing subunit, and then the third exposure image t3 is read from the exposure unit according to the image fetching instruction. After receiving the second exposure image t2, the processing subunit first performs the first stage processing on the second exposure image t2, including: fusing the first exposure image t1 and the second exposure image t2 to obtain a fused image; extracting features from the fused image to obtain fused features, and then performing the second stage processing, including: performing feature comparison on the fused features to obtain a comparison result corresponding to the second exposure image t2. The comparison result is failure, so N=3. When N=3, the third exposure image t3 is sent to the processing subunit, and then the fourth exposure image t4 is read from the exposure unit according to the image fetching instruction. After receiving the third exposure image t3, the processing subunit first performs the first stage processing on the third exposure image t3, including: fusing the second exposure image t2 and the third exposure image t3 to obtain a fused image; extracting features from the fused image to obtain fused features, and then performing the second stage processing, including: performing feature comparison on the fused features to obtain the comparison result corresponding to the third exposure image t3, and the comparison result is failure, so N=4. The loop is looped in sequence until the comparison is successful and the loop is exited. It should be noted that the fusion in the first stage processing process can be based not only on the Nth exposure image and the N-1th exposure image, but also on the Nth exposure image and at least one exposure image before the Nth exposure image.

[0172] In one example, if Fig.15 As shown, after the first stage of processing is completed, the exposure image of the N+1th time is read from the exposure unit according to the image fetching instruction, and then the second stage of processing is started, and the exposure processing of the N+2th time is started at the same time. No further details are given here.

[0173] The above embodiment illustrates that the first stage of processing includes feature extraction, and the second stage of processing includes feature comparison. The next cycle is performed only when the feature comparison fails.

[0174] In one embodiment, Fig.16 As shown, an image processing device 1600 is provided, comprising:

[0175] The processing module 1601 is used to perform image processing on the read Nth exposure image;

[0176] The image fetching module 1602 is used to read the N+1th exposure image from the exposure unit according to the image fetching instruction;

[0177] An exposure module 1603 is used to control the exposure unit to perform an N+2th exposure process on the target to be collected to obtain an N+2th exposure image;

[0178] The return module 1604 is used to, after the image processing of the Nth exposure image is completed, increment N by 1 and return to the step of performing image processing on the read Nth exposure image.

[0179] In some embodiments of the present invention, the image processing apparatus 1600 further includes: an image processing module, configured to:

[0180] Performing the first stage processing on the N-th exposure image to obtain intermediate image information;

[0181] The intermediate image information is subjected to a second-stage processing to obtain an image processing result.

[0182] In some embodiments of the present invention, the image acquisition module 1602 is specifically used to:

[0183] When N is greater than or equal to 2, after the first stage processing of the Nth exposure image is completed, the N+1th exposure image is read from the exposure unit according to the image fetching instruction.

[0184] In some embodiments of the present invention, the image processing device further includes: an N=1 module, which is used to: when N=1, when starting the first stage processing of the Nth exposure image, control the exposure unit to perform the N+1th exposure processing on the target to be collected.

[0185] In some embodiments of the present invention, the exposure module 1603 is specifically used for:

[0186] When the second stage processing of the intermediate image information corresponding to the Nth exposure image begins, the exposure unit is controlled to perform the N+2th exposure processing on the target to be collected.

[0187] In some embodiments of the present invention, the image processing module is specifically used to:

[0188] A fused image is obtained based on the intermediate image information corresponding to the Nth exposure image.

[0189] In some embodiments of the present invention, the image processing module is specifically used to:

[0190] A fused image is obtained according to the intermediate image information corresponding to the N-th exposure image and at least one intermediate image information before the N-th exposure image.

[0191] In some embodiments of the present invention, the image processing module is specifically used to:

[0192] A fused image is obtained based on the intermediate image information corresponding to the Nth exposure image and the intermediate image information corresponding to the 1st exposure image to the N-1th exposure image.

[0193] In some embodiments of the present invention, the image processing module is specifically used to:

[0194] Obtaining a fused image based on the intermediate image information corresponding to the Nth exposure image;

[0195] Performing comparison processing on the fused image to obtain a comparison result of the fused image;

[0196] The returning module 1604 is specifically used for: when the comparison result of the fused image is a comparison failure, N is incremented by 1, and the step of performing image processing on the read Nth exposure image is returned.

[0197] In some embodiments of the present invention, the image processing module is specifically used to:

[0198] When N is less than K, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image;

[0199] When N is greater than or equal to K, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image; a comparison process is performed on the fused image to obtain a comparison result of the fused image; the return module 1604 is specifically used to: when the comparison result of the fused image is a comparison failure, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned.

[0200] In some embodiments of the present invention, the first stage of processing includes feature extraction, and the second stage of processing includes feature comparison;

[0201] The image processing module is specifically used to: extract features from the fused image obtained based on the Nth exposure image to obtain fused features;

[0202] The image processing module is specifically used to: perform feature comparison on the fusion features to obtain a comparison result corresponding to the Nth exposure image;

[0203] The returning module 1604 is specifically used for: when the comparison result corresponding to the Nth exposure image is a comparison failure, N is incremented by 1, and the step of performing image processing on the read Nth exposure image is returned.

[0204] In some embodiments of the present invention, the target to be collected includes a fingerprint, and the exposure image includes a fingerprint exposure image.

[0205] In one embodiment, Fig.17 As shown, a device is provided, which may be a terminal or a server, and an under-screen fingerprint module is provided in the device, wherein the terminal may be an electronic device. The device includes a processor, a memory and a network interface connected via a system bus, the memory includes a non-volatile storage medium and an internal memory, the non-volatile storage medium of the device stores an operating system, and may also store a computer program, which, when executed by the processor, enables the processor to implement an image processing method. The non-volatile memory may include a read-only memory (ROM), a programmable ROM (PROM), an electrically programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM) or a flash memory. The volatile memory may include a random access memory (RAM) or an external cache memory. As an illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM). The internal memory may also store a computer program, which, when executed by the processor, enables the processor to execute the image processing method. Fig.17 The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the device to which the scheme of the present application is applied. The specific device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0206] The image processing method provided in the present application can be implemented in the form of a computer program. The computer program can be Fig.17 The memory of the device can store various program templates constituting the image processing apparatus, such as the processing module 1601 and the image acquisition module 1602.

[0207] A device comprises a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the following steps:

[0208] Performing image processing on the Nth exposure image read;

[0209] Read the N+1th exposure image from the exposure unit according to the image fetching instruction;

[0210] Control the exposure unit to perform an N+2th exposure process on the target to be collected, to obtain an N+2th exposure image;

[0211] After the image processing of the Nth exposure image is completed, N is incremented by 1, and the process returns to the step of performing image processing on the read Nth exposure image.

[0212] In one embodiment, a computer-readable storage medium is provided, storing a computer program, and when the computer program is executed by a processor, the processor performs the following steps:

[0213] Performing image processing on the Nth exposure image read;

[0214] Read the N+1th exposure image from the exposure unit according to the image fetching instruction;

[0215] Control the exposure unit to perform an N+2th exposure process on the target to be collected, to obtain an N+2th exposure image;

[0216] After the image processing of the Nth exposure image is completed, N is incremented by 1, and the process returns to the step of performing image processing on the read Nth exposure image.

[0217] It should be noted that the above-mentioned image processing method, image processing device, equipment and computer-readable storage medium belong to a general inventive concept, and the contents in the embodiments of the image processing method, image processing device, equipment and computer-readable storage medium are applicable to each other.

[0218] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0219] In addition, the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0220] Furthermore, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0221] In this document, relational terms such as first and second, etc. are used merely to distinguish one entity or operation from another entity or operation, but do not necessarily require or imply any such actual relationship or order between these entities or operations.

[0222] The above description is only an embodiment of the present application and is not intended to limit the protection scope of the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. An image processing method, characterized in that: include: Performing image processing on the Nth exposure image read; Read the N+1th exposure image from the exposure unit according to the image fetching instruction; While performing image processing on the Nth exposure image, controlling the exposure unit to perform an N+2th exposure process on the target to be collected to obtain an N+2th exposure image; After the image processing of the Nth exposure image is completed, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned, wherein the image processing includes: at least one of image enhancement, image fusion, image comparison, feature extraction, and feature comparison.

2. The image processing method according to claim 1, characterized in that: The image processing comprises: Performing the first stage processing on the N-th exposure image to obtain intermediate image information; The intermediate image information is subjected to a second-stage processing to obtain an image processing result.

3. The image processing method according to claim 2, characterized in that: The step of reading the N+1th exposure image from the exposure unit according to the image fetching instruction comprises: When N is greater than or equal to 2, after the first stage processing of the Nth exposure image is completed, the N+1th exposure image is read from the exposure unit according to the image fetching instruction.

4. The image processing method according to claim 2, characterized in that: When N=1, when the first stage processing of the Nth exposure image begins, the exposure unit is controlled to perform the N+1th exposure processing on the target to be collected.

5. The image processing method according to any one of claims 2 to 4, characterized in that: The controlling the exposure unit to perform an N+2th exposure process on the target to be collected includes: When the second stage processing of the intermediate image information corresponding to the Nth exposure image begins, the exposure unit is controlled to perform the N+2th exposure processing on the target to be collected.

6. The image processing method according to any one of claims 2 to 5, characterized in that: The performing the second stage processing on the intermediate image information to obtain an image processing result includes: A fused image is obtained based on the intermediate image information corresponding to the Nth exposure image.

7. The image processing method according to claim 6, characterized in that: The obtaining of a fused image based on the intermediate image information corresponding to the Nth exposure image includes: A fused image is obtained according to the intermediate image information corresponding to the N-th exposure image and at least one intermediate image information before the N-th exposure image.

8. The image processing method according to claim 7, characterized in that: The obtaining of the fused image according to the intermediate image information corresponding to the N-th exposure image and at least one intermediate image information before the N-th exposure image comprises: A fused image is obtained based on the intermediate image information corresponding to the Nth exposure image and the intermediate image information corresponding to the 1st exposure image to the N-1th exposure image.

9. The image processing method according to any one of claims 2 to 5, characterized in that: The performing the second stage processing on the intermediate image information to obtain an image processing result includes: Obtaining a fused image based on the intermediate image information corresponding to the Nth exposure image; Performing comparison processing on the fused image to obtain a comparison result of the fused image; After the image processing of the Nth exposure image is completed, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned, including: when the comparison result of the fused image is a comparison failure, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned.

10. The image processing method according to any one of claims 2 to 5, characterized in that: The performing the second stage processing on the intermediate image information to obtain an image processing result includes: When N is less than K, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image; When N is greater than or equal to K, a fused image is obtained based on the intermediate image information corresponding to the Nth exposure image; a comparison process is performed on the fused image to obtain a comparison result of the fused image; after the image processing of the Nth exposure image is completed, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned, including: when the comparison result of the fused image is a comparison failure, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned.

11. The image processing method according to any one of claims 2 to 5, characterized in that: The first stage of processing includes feature extraction, and the second stage of processing includes feature comparison; The performing the first stage processing on the Nth exposure image to obtain intermediate image information includes: extracting features from a fused image obtained based on the Nth exposure image to obtain fused features; The performing the second stage processing on the intermediate image information to obtain the image processing result includes: performing feature comparison on the fusion feature to obtain the comparison result corresponding to the Nth exposure image; After the image processing of the Nth exposure image is completed, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned, including: when the comparison result corresponding to the Nth exposure image is a comparison failure, N is accumulated by 1, and the step of performing image processing on the read Nth exposure image is returned.

12. The image processing method according to any one of claims 1 to 11, characterized in that: The target to be collected includes a fingerprint, and the exposure image includes a fingerprint exposure image.

13. An image processing device, characterized in that: include: A processing module, used for performing image processing on the read Nth exposure image; An image fetching module, used for reading the N+1th exposure image from the exposure unit according to the image fetching instruction; An exposure module, used for controlling the exposure unit to perform an N+2th exposure process on the target to be collected while performing image processing on the Nth exposure image, so as to obtain an N+2th exposure image; A return module is used to return the step of performing image processing on the read Nth exposure image after the image processing of the Nth exposure image is completed, N is accumulated by 1, and the image processing includes: at least one of image enhancement, image fusion, image comparison, feature extraction, and feature comparison.

14. A device, characterized in that The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the image processing method according to any one of claims 1 to 12 when executing the computer program.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, and when the computer program instructions are read and executed by a processor, the steps of the image processing method according to any one of claims 1 to 12 are executed.

Citation Information

Patent Citations

  • Image capturing apparatus, image capturing method, and storage medium to generate a panoramic image having a high dynamic range

    CN110248114A

  • Fingerprint and finger vein-based joint identification processing method and system

    CN111368780A