A dual-fingerprint verification device, a control method and device thereof, and a storage medium

Abstract

The application discloses a control method and device of a dual-fingerprint verification device, the dual-fingerprint verification device and a storage medium, and the method comprises the following steps: when a first fingerprint collection module and a second fingerprint collection module simultaneously collect fingerprint images of the same fingerprint surface of a human finger, acquiring a first fingerprint image and a second fingerprint image; respectively matching and comparing the first fingerprint image and the second fingerprint image with a fingerprint image library; when the first fingerprint image and the second fingerprint image are matched, superimposing and comparing the first fingerprint image and the second fingerprint image; and performing similarity comparison on non-superimposed fingerprint areas in the obtained first fingerprint image and second fingerprint image; and determining whether the first fingerprint image and the second fingerprint image are successfully double-verified according to the similarity comparison result of the superimposed fingerprint area and the non-superimposed fingerprint area. According to the scheme, the dual-fingerprint verification is performed on the fingerprints collected by two different manners at the same time, the single fingerprint collection manner is prevented from being cracked, and the security is improved.

Description

Technical Field

[0001] This invention belongs to the field of fingerprint recognition technology, and specifically relates to a control method, device, dual fingerprint verification device, and storage medium for a dual fingerprint verification device. Background Technology

[0002] With the widespread adoption of fingerprint recognition technology, some electronic devices now feature fingerprint unlocking capabilities, i.e., fingerprint recognition functionality. To ensure greater sensitivity, fingerprint recognition functions have a certain threshold error range, and most fingerprint recognition modules (i.e., modules with fingerprint recognition capabilities) also include liveness detection and self-learning functions. However, fingerprint recognition modules typically use a single fingerprint acquisition method. The liveness detection and self-learning functions of these modules can be compromised by physical fingerprint attacks, significantly impacting the security of the fingerprint recognition function.

[0003] The above content is only used to help understand the technical solution of the present invention and does not represent an admission that the above content is prior art. Summary of the Invention

[0004] The purpose of this invention is to provide a control method, apparatus, dual fingerprint verification device, and storage medium for a dual fingerprint verification device. This addresses the problem that fingerprint recognition modules typically use a single fingerprint acquisition method, and the liveness detection and self-learning functions of these modules can be compromised by physical fingerprint attacks, significantly impacting the security of fingerprint recognition. The invention achieves dual fingerprint verification by using fingerprints acquired in two different ways simultaneously, preventing the single fingerprint acquisition method from being compromised and greatly improving the security of fingerprint recognition.

[0005] This invention provides a control method for a dual fingerprint verification device, wherein the dual fingerprint verification device includes: a first fingerprint acquisition module and a second fingerprint acquisition module; the control method for the dual fingerprint verification device includes: when the first fingerprint acquisition module and the second fingerprint acquisition module simultaneously acquire fingerprint images of the same fingerprint surface of a human finger, acquiring a first fingerprint image acquired by the first fingerprint acquisition module and acquiring a second fingerprint image acquired by the second fingerprint acquisition module; based on a pre-recorded fingerprint image library, matching and comparing the first fingerprint image and the second fingerprint image with the pre-recorded fingerprint image library respectively to obtain a matching comparison result; and when the matching comparison result is that both the first fingerprint image and the second fingerprint image match the corresponding fingerprint images in the pre-recorded fingerprint image library, a result is obtained. If the first fingerprint image and the second fingerprint image are compared for overlap, the overlapping and non-overlapping fingerprint regions in the first and second fingerprint images are obtained. The non-overlapping fingerprint regions in the first and second fingerprint images are then compared for similarity to obtain a similarity comparison result. Based on the similarity comparison results of the overlapping and non-overlapping fingerprint regions in the first and second fingerprint images, it is determined whether the dual verification of the first and second fingerprint images is successful. If the dual verification of the first and second fingerprint images is successful, it is determined that the fingerprint image of the same fingerprint surface of the human finger matches the corresponding fingerprint image in the pre-recorded fingerprint image database.

[0006] In some embodiments, the first fingerprint acquisition module includes a capacitive fingerprint signal acquisition module; the second fingerprint acquisition module includes an ultrasonic fingerprint signal acquisition module; wherein, in the dual fingerprint verification device, the capacitive fingerprint signal acquisition module is located at the top layer of the dual fingerprint verification device, the ultrasonic fingerprint signal acquisition module is located at the bottom layer of the dual fingerprint verification device, and the capacitive fingerprint signal acquisition module and the ultrasonic fingerprint signal acquisition module are isolated by a medium; when the same fingerprint surface of the human finger presses the capacitive fingerprint signal acquisition module, the capacitive fingerprint signal acquisition module and the ultrasonic fingerprint signal acquisition module simultaneously acquire fingerprint images of the same fingerprint surface of the human finger to obtain the first fingerprint image and the second fingerprint image.

[0007] In some implementations, based on a pre-recorded fingerprint image library, the first fingerprint image and the second fingerprint image are matched and compared with the pre-recorded fingerprint image library to obtain a matching comparison result. This includes: calling the pre-recorded fingerprint image library; matching the first fingerprint image with any fingerprint image in the pre-recorded fingerprint image library; if the matching degree between the first fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree, then the first fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library; and matching the second fingerprint image with the pre-recorded fingerprint image library. The fingerprint image is matched against any fingerprint image in the pre-entered fingerprint image library. If the matching degree between the second fingerprint image and any fingerprint image in the pre-entered fingerprint image library reaches a preset matching degree, then the second fingerprint image is considered to match the corresponding fingerprint image in the pre-entered fingerprint image library. The matching comparison result is either that both the first fingerprint image and the second fingerprint image match the corresponding fingerprint image in the pre-entered fingerprint image library, or that at least one of the first fingerprint image and the second fingerprint image does not match the corresponding fingerprint image in the pre-entered fingerprint image library.

[0008] In some embodiments, comparing the first fingerprint image with the second fingerprint image to obtain overlapping and non-overlapping fingerprint regions in the first and second fingerprint images includes: dividing the image regions of the first fingerprint image and the second fingerprint image into one or more regions according to a predetermined division method; for each of the divided regions, comparing the fingerprint images of the first fingerprint image region and the second fingerprint image region in the same region; if the fingerprint images of the first fingerprint image region and the second fingerprint image region in the same region can overlap, then determining that the first fingerprint image is the overlapping fingerprint image region. If the image regions of the first and second fingerprint images overlap in the same area, then the image regions of the first and second fingerprint images are determined to be non-overlapping areas in the same area. Specifically, all overlapping areas between the image regions of the first and second fingerprint images are denoted as overlapping fingerprint regions of the first and second fingerprint images; all non-overlapping areas between the image regions of the first and second fingerprint images are denoted as non-overlapping fingerprint regions in the first and second fingerprint images.

[0009] In some embodiments, the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: one or more non-overlapping regions between the image regions of the first fingerprint image and the image regions of the second fingerprint image, denoted as one or more non-overlapping sub-fingerprint regions; performing a similarity comparison on the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image to obtain a similarity comparison result includes: for each non-overlapping sub-fingerprint region in the first fingerprint image and the second fingerprint image, individually fitting and comparing the similarity between each non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image; if the fitting and comparison similarity between any non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image reaches a set similarity threshold, then it is considered that the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image are similar. Non-overlapping fingerprint regions are considered matching regions. If the similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image does not reach a set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered non-matching regions. Specifically, for non-overlapping fingerprint regions in the first and second fingerprint images, all matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are recorded as matching fingerprint regions of non-overlapping fingerprint regions in the first and second fingerprint images. All non-matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are recorded as non-matching fingerprint regions of non-overlapping fingerprint regions in the first and second fingerprint images.

[0010] In some embodiments, the similarity comparison result of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image includes: matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image; determining whether the dual verification of the first fingerprint image and the second fingerprint image is successful based on the similarity comparison result of the overlapping fingerprint regions and the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image includes: determining the overlapping fingerprint regions and the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image as dual-matching fingerprint regions in the first fingerprint image and the second fingerprint image; The sum of the double-matching fingerprint regions in the first and second fingerprint images, and the non-matching fingerprint regions in the non-overlapping fingerprint regions of the first and second fingerprint images, is determined as the complete fingerprint region in the first and second fingerprint images. The ratio of the double-matching fingerprint region in the first and second fingerprint images to the complete fingerprint region in the first and second fingerprint images is determined as the complete fingerprint matching rate of the first and second fingerprint images. If the complete fingerprint matching rate of the first and second fingerprint images reaches the set fingerprint matching rate, the double verification of the first and second fingerprint images is considered successful. If the complete fingerprint matching rate of the first and second fingerprint images does not reach the set fingerprint matching rate, the double verification of the first and second fingerprint images is considered unsuccessful.

[0011] In some implementations, the method further includes: upon successful dual verification of the first fingerprint image and the second fingerprint image, performing self-learning on the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in a pre-recorded fingerprint image library, thereby improving the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restoring the real fingerprints of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realizing the updating of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

[0012] In accordance with the above method, another aspect of the present invention provides a control device for a dual fingerprint verification device, wherein the dual fingerprint verification device includes: a first fingerprint acquisition module and a second fingerprint acquisition module; the control device for the dual fingerprint verification device includes: an acquisition unit configured to acquire a first fingerprint image acquired by the first fingerprint acquisition module and a second fingerprint image acquired by the second fingerprint acquisition module when the first fingerprint acquisition module and the second fingerprint acquisition module simultaneously acquire fingerprint images of the same fingerprint surface of a human finger; a control unit further configured to match and compare the first fingerprint image and the second fingerprint image with a pre-recorded fingerprint image library based on a pre-recorded fingerprint image library to obtain a matching comparison result; the control unit is further configured to, when the matching comparison result is that both the first fingerprint image and the second fingerprint image match the fingerprint images in the pre-recorded fingerprint image library... In the event of a fingerprint image matching result, the first fingerprint image and the second fingerprint image are compared to obtain overlapping and non-overlapping fingerprint regions in the first and second fingerprint images. The control unit is further configured to perform a similarity comparison on the non-overlapping fingerprint regions in the first and second fingerprint images to obtain a similarity comparison result. The control unit is further configured to determine whether the dual verification of the first and second fingerprint images is successful based on the similarity comparison results of the overlapping and non-overlapping fingerprint regions in the first and second fingerprint images. If the dual verification of the first and second fingerprint images is successful, the fingerprint image of the same fingerprint surface of the human finger is determined to match the corresponding fingerprint image in the pre-recorded fingerprint image library.

[0013] In some embodiments, the first fingerprint acquisition module includes a capacitive fingerprint signal acquisition module; the second fingerprint acquisition module includes an ultrasonic fingerprint signal acquisition module; wherein, in the dual fingerprint verification device, the capacitive fingerprint signal acquisition module is located at the top layer of the dual fingerprint verification device, the ultrasonic fingerprint signal acquisition module is located at the bottom layer of the dual fingerprint verification device, and the capacitive fingerprint signal acquisition module and the ultrasonic fingerprint signal acquisition module are isolated by a medium; when the same fingerprint surface of the human finger presses the capacitive fingerprint signal acquisition module, the capacitive fingerprint signal acquisition module and the ultrasonic fingerprint signal acquisition module simultaneously acquire fingerprint images of the same fingerprint surface of the human finger to obtain the first fingerprint image and the second fingerprint image.

[0014] In some embodiments, the control unit, based on a pre-recorded fingerprint image library, performs matching and comparison between the first fingerprint image and the second fingerprint image and the pre-recorded fingerprint image library respectively to obtain a matching comparison result, including: calling the pre-recorded fingerprint image library; matching the first fingerprint image with any fingerprint image in the pre-recorded fingerprint image library; if the matching degree between the first fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree, then the first fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library; and matching the second fingerprint image... The second fingerprint image is matched against any fingerprint image in the pre-recorded fingerprint image library. If the matching degree between the second fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree, then the second fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library. The matching comparison result is either that both the first fingerprint image and the second fingerprint image match the corresponding fingerprint image in the pre-recorded fingerprint image library, or that at least one of the first fingerprint image and the second fingerprint image does not match the corresponding fingerprint image in the pre-recorded fingerprint image library.

[0015] In some embodiments, the control unit compares the first fingerprint image with the second fingerprint image to obtain overlapping and non-overlapping fingerprint regions in the first and second fingerprint images. This includes: dividing the image regions of the first and second fingerprint images into one or more regions according to a predetermined division method; for each of the divided regions, comparing the fingerprint images of the first and second fingerprint images in the same region of one or more regions; if the fingerprint images of the first and second fingerprint images in the same region overlap, then determining that the first fingerprint image... The image regions of the first fingerprint image and the image regions of the second fingerprint image overlap in the same area; if the image regions of the first fingerprint image and the second fingerprint image cannot overlap in the same area, then the image regions of the first fingerprint image and the second fingerprint image are determined to be non-overlapping in the same area; wherein, all overlapping areas of the image regions of the first fingerprint image and the second fingerprint image are denoted as overlapping fingerprint regions of the first fingerprint image and the second fingerprint image; and all non-overlapping areas of the image regions of the first fingerprint image and the second fingerprint image are denoted as non-overlapping fingerprint regions of the first fingerprint image and the second fingerprint image.

[0016] In some embodiments, the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: one or more non-overlapping regions between the image regions of the first fingerprint image and the image regions of the second fingerprint image, denoted as one or more non-overlapping sub-fingerprint regions; the control unit performs a similarity comparison on the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image to obtain a similarity comparison result, including: for each non-overlapping sub-fingerprint region in the first fingerprint image and the second fingerprint image, individually fitting and comparing the similarity between each non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image; if the fitting and comparison similarity between any non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image reaches a set similarity threshold, then it is considered that the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image are similar. The corresponding non-overlapping fingerprint regions of the images are considered matching regions. If the fitting similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image does not reach a set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered non-matching regions. Specifically, for non-overlapping fingerprint regions in the first and second fingerprint images, all matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are denoted as matching fingerprint regions of non-overlapping fingerprint regions in the first and second fingerprint images. All non-matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are denoted as non-matching fingerprint regions of non-overlapping fingerprint regions in the first and second fingerprint images.

[0017] In some implementations, the similarity comparison result of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image includes: matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image; the control unit determines whether the dual verification of the first fingerprint image and the second fingerprint image is successful based on the similarity comparison result of the overlapping fingerprint regions and the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, including: determining the overlapping fingerprint regions and the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image as dual-matching fingerprint regions in the first fingerprint image and the second fingerprint image. The sum of the double-matching fingerprint regions and the non-matching fingerprint regions in the first and second fingerprint images is determined as the complete fingerprint region in the first and second fingerprint images. The ratio of the double-matching fingerprint region in the first and second fingerprint images to the complete fingerprint region in the first and second fingerprint images is determined as the complete fingerprint matching rate of the first and second fingerprint images. If the complete fingerprint matching rate of the first and second fingerprint images reaches the set fingerprint matching rate, the double verification of the first and second fingerprint images is considered successful. If the complete fingerprint matching rate of the first and second fingerprint images does not reach the set fingerprint matching rate, the double verification of the first and second fingerprint images is considered unsuccessful.

[0018] In some embodiments, the control unit is further configured to, upon successful dual verification of the first fingerprint image and the second fingerprint image, perform self-learning on the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, so as to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in a pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprints of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the updating of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

[0019] In conjunction with the above-mentioned device, the present invention further provides a dual fingerprint verification device, comprising: a control device for the dual fingerprint verification device described above.

[0020] In conjunction with the above method, the present invention further provides a storage medium comprising a stored program, wherein, when the program is executed, the device on which the storage medium is located executes the control method of the dual fingerprint verification device described above.

[0021] Therefore, the solution of this invention employs a capacitive fingerprint acquisition module and an ultrasonic fingerprint acquisition module to simultaneously acquire the same fingerprint image from the same cross-section of a human finger, obtaining both a capacitive and an ultrasonic fingerprint image. These images are then matched with a pre-recorded human finger fingerprint image to determine overlapping and non-overlapping regions. If both matching results meet a set error threshold, the non-overlapping fingerprint regions in the capacitive and ultrasonic images are compared regionally to determine matching and non-matching regions. Based on the overlapping and non-overlapping regions, the final matching result between the capacitive and ultrasonic fingerprint images and the human finger is determined, thus confirming whether fingerprint verification of the human finger is successful. Therefore, by using fingerprints acquired simultaneously through two different methods for dual fingerprint verification, the vulnerability of a single fingerprint acquisition method can be prevented, significantly improving the security of fingerprint recognition. Meanwhile, the solution of the present invention can improve the security of identity authentication by performing self-learning to improve the fingerprint details of highly overlapping fingerprints in the fingerprint images acquired by the capacitive fingerprint acquisition module and the ultrasonic fingerprint acquisition module.

[0022] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention.

[0023] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0024] Figure 1 This is a flowchart illustrating an embodiment of the control method for the dual fingerprint verification device of the present invention;

[0025] Figure 2 This is a schematic flowchart of an embodiment of the method of the present invention, which compares and matches a first fingerprint image and a second fingerprint image with the pre-recorded fingerprint image library.

[0026] Figure 3 This is a flowchart illustrating an embodiment of the method of the present invention that involves comparing a first fingerprint image with a second fingerprint image.

[0027] Figure 4This is a flowchart illustrating an embodiment of the method of the present invention for comparing the similarity of non-overlapping fingerprint regions in a first fingerprint image and a second fingerprint image;

[0028] Figure 5 This is a flowchart illustrating an embodiment of the method of the present invention for determining whether dual verification of the first fingerprint image and the second fingerprint image is successful.

[0029] Figure 6 This is a schematic diagram of the structure of a control device of the dual fingerprint verification device of the present invention;

[0030] Figure 7 A cross-sectional structural schematic diagram of an embodiment of a dual fingerprint acquisition device;

[0031] Figure 8 This is a schematic diagram of a dual fingerprint comparison and recognition process in a dual fingerprint verification device, which performs fingerprint recognition and fingerprint improvement based on a preset fingerprint comparison and recognition strategy.

[0032] Referring to the accompanying drawings, the reference numerals in the embodiments of the present invention are as follows:

[0033] 10-Capacitive fingerprint signal acquisition module; 20-Pressure plate; 30-Ultrasonic fingerprint signal acquisition module; 31-Acoustic coupling medium; 32-Ultrasonic sensor element; 33-Display substrate; 102-Acquisition unit; 104-Control unit. Detailed Implementation

[0034] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this invention, and not all of them. Based on the embodiments of this invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this invention.

[0035] According to embodiments of the present invention, a control method for a dual fingerprint verification device is provided, such as... Figure 1 The diagram shows a flowchart of an embodiment of the method of the present invention. The dual fingerprint verification device includes: a first fingerprint acquisition module and a second fingerprint acquisition module. The first fingerprint acquisition module is, for example, a capacitive fingerprint signal acquisition module 10, and the second fingerprint acquisition module is, for example, an ultrasonic fingerprint signal acquisition module 30. The first fingerprint acquisition module and the second fingerprint acquisition module are capable of simultaneously acquiring fingerprint images of the same fingerprint surface of a human finger to obtain a first fingerprint image and a second fingerprint image. Specifically, the same fingerprint surface of a human finger can be the fingerprint surface of the same cross-section of the human finger.

[0036] In some embodiments, the first fingerprint acquisition module includes a capacitive fingerprint signal acquisition module 10. The second fingerprint acquisition module includes an ultrasonic fingerprint signal acquisition module 30.

[0037] In the dual fingerprint verification device, the capacitive fingerprint signal acquisition module 10 is located on the top layer of the dual fingerprint verification device, and the ultrasonic fingerprint signal acquisition module 30 is located on the bottom layer of the dual fingerprint verification device. The capacitive fingerprint signal acquisition module 10 and the ultrasonic fingerprint signal acquisition module 30 are isolated by a medium, which can be a pressure plate 20.

[0038] When the capacitive fingerprint signal acquisition module 10 is pressed on the same fingerprint surface of the human finger, the capacitive fingerprint signal acquisition module 10 and the ultrasonic fingerprint signal acquisition module 30 simultaneously acquire fingerprint images of the same fingerprint surface of the human finger to obtain the first fingerprint image and the second fingerprint image.

[0039] Specifically, Figure 7 This is a cross-sectional structural diagram of one embodiment of a dual fingerprint acquisition device. Figure 7 The dual fingerprint acquisition device shown includes: a capacitive fingerprint signal acquisition module 10, a pressure plate 20, and an ultrasonic fingerprint signal acquisition module 30. The ultrasonic fingerprint signal acquisition module 30 includes: an acoustic coupling medium 31, an ultrasonic sensor element 32, and a display substrate 33.

[0040] See Figure 7 In the example shown, arranged from top to bottom, the capacitive fingerprint signal acquisition module 10 is located on the top layer of the dual fingerprint acquisition device, the ultrasonic fingerprint signal acquisition module 30 is located on the bottom layer, and the pressure plate 20 is located between the capacitive fingerprint signal acquisition module 10 and the ultrasonic fingerprint signal acquisition module 30. In the ultrasonic fingerprint signal acquisition module 30, the acoustic coupling medium 31 is located on the top layer, the display substrate 33 is located on the bottom layer, and the ultrasonic sensor element 32 is located in the acoustic coupling medium 31 and close to the display substrate 33.

[0041] like Figure 1 As shown, in the solution of the present invention, the control method of the dual fingerprint verification device includes steps S110 to S150.

[0042] In step S110, when the first fingerprint acquisition module and the second fingerprint acquisition module simultaneously acquire fingerprint images of the same fingerprint surface of a human finger, the first fingerprint image acquired by the first fingerprint acquisition module is obtained, and the second fingerprint image acquired by the second fingerprint acquisition module is obtained.

[0043] See Figure 7 In the example shown, when a human finger is pressed on the dual fingerprint acquisition device, the valleys and ridges of the finger form an equivalent capacitor with the capacitor plates in the capacitive fingerprint signal acquisition module 10. The distance from the surface valleys of the human finger to the capacitor plates in the capacitive fingerprint signal acquisition module 10 is greater than the distance from the surface ridges of the human finger to the capacitor plates in the capacitive fingerprint signal acquisition module 10, and the charge on the capacitor from the surface valleys of the human finger is less than the charge on the capacitor from the surface ridges of the human finger. The controller in the dual fingerprint verification device acquires a fingerprint image by detecting the difference between the charge on the capacitor from the surface valleys of the human finger and the charge on the capacitor from the surface ridges of the human finger. The raised portion of the fingerprint at the fingertip is the ridge, i.e., the surface ridge of the human finger, and the recessed portion of the fingerprint at the fingertip is the valley, i.e., the surface valley of the human finger.

[0044] The charge detection circuit of the controller detects the amount of charge. The capacitance signal acquisition module is a common capacitive fingerprint module, which contains multiple capacitor plates. The finger and the capacitor plates form an equivalent capacitor. The capacitor formed by the ridges on the finger surface has a greater charge than the capacitor formed by the valleys. The fingerprint image is formed based on the magnitude of the acquired charge.

[0045] While the capacitive fingerprint signal acquisition module 10 is operating, the ultrasonic fingerprint signal acquisition module 30 also begins its acquisition process simultaneously. Ultrasonic waves are emitted from the ultrasonic sensor element 32, penetrating the acoustic coupling medium 32, the pressure plate 20, and the capacitive fingerprint signal acquisition module 10 to reach the surface of the human finger. When the human finger presses against the capacitive fingerprint signal acquisition module 10, the ridge portion of the finger's surface directly contacts the module, while a portion of air remains between the valley portion and the module. The pressure plate 20 is a common structure for ultrasonic fingerprint modules; in this invention, it isolates the two modules to facilitate sound wave propagation. After reaching the ridge and valley portions of the finger's surface, the ultrasonic waves are reflected back through the air gap between the valley portion and the module, reaching the ultrasonic sensor element 32. The ultrasonic sensor element 32 detects the difference between the reflected and emitted waves to obtain a fingerprint image of the ridge and valley portions of the finger's surface, which is then displayed on the display substrate 33. Here, the ridges also produce echoes, but the ridges are in direct contact with the module, while the valleys are separated from the module by air, resulting in different echoes. When the fingerprint's ridges and valleys come into contact with the sound waves, there is a difference in the medium (air), causing the energy of the echoes to differ. The supersonic sensor detects the electrical signals generated by the energy difference in the echoes to distinguish the fingerprint's ridges and valleys, thus forming a fingerprint image.

[0046] At this time, both fingerprint acquisition modules (i.e., capacitive fingerprint signal acquisition module 10 and ultrasonic fingerprint signal acquisition module 30) acquire the corresponding fingerprint images, which are then transmitted via... Figure 1 The preset fingerprint comparison and recognition strategy shown performs fingerprint recognition and fingerprint refinement. In related solutions, fingerprint recognition technology only recognizes a single fingerprint image. However, the fingerprint recognition strategy of this invention, because the images collected by two different acquisition sensors are not exactly the same, can prevent interference image cracking and can also refine the fingerprint more accurately.

[0047] In step S120, based on the pre-recorded fingerprint image library, the first fingerprint image and the second fingerprint image are matched and compared with the pre-recorded fingerprint image library to obtain the matching comparison result.

[0048] In some implementations, the specific process of matching and comparing the first fingerprint image and the second fingerprint image with the pre-recorded fingerprint image library in step S120 to obtain the matching and comparison results is described in the following exemplary description.

[0049] The following is combined with Figure 2 The schematic diagram shows an embodiment of the method of the present invention in which the first fingerprint image and the second fingerprint image are matched and compared with the pre-recorded fingerprint image library. The specific process of matching and comparing the first fingerprint image and the second fingerprint image with the pre-recorded fingerprint image library in step S120 is further explained, including steps S210 to S230.

[0050] Step S210: Call the pre-recorded fingerprint image library.

[0051] Step S220: Match the first fingerprint image with any fingerprint image in the pre-recorded fingerprint image library. If the matching degree between the first fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree, then the first fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library.

[0052] Step S230: Match the second fingerprint image with any fingerprint image in the pre-recorded fingerprint image library. If the matching degree between the second fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree, then the second fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library.

[0053] The matching comparison result is either that both the first fingerprint image and the second fingerprint image match the corresponding fingerprint image in the pre-recorded fingerprint image library, or that at least one of the first fingerprint image and the second fingerprint image does not match the corresponding fingerprint image in the pre-recorded fingerprint image library.

[0054] Specifically, Figure 8 This is a schematic diagram illustrating a dual fingerprint comparison and recognition process in a dual fingerprint verification device, illustrating fingerprint recognition and fingerprint refinement based on a preset fingerprint comparison and recognition strategy. Figure 8 As shown, the dual fingerprint verification device performs fingerprint recognition and fingerprint improvement based on a preset fingerprint comparison and recognition strategy, including the following dual fingerprint comparison and recognition process:

[0055] Step 1: When a human finger presses the dual fingerprint verification device, the capacitive fingerprint signal acquisition module 10 and the ultrasonic fingerprint signal acquisition module 30 simultaneously acquire the same fingerprint image on the same cross-section of the human finger. The fingerprint image acquired by the capacitive fingerprint signal acquisition module 10 is recorded as the capacitive fingerprint image, and the fingerprint image acquired by the ultrasonic fingerprint signal acquisition module 30 is recorded as the ultrasonic fingerprint image. Then, proceed to Step 2. Of course, the solution of this invention is to acquire fingerprints using ultrasonic and capacitive methods on the same fingerprint cross-section. Different implementation devices can also acquire the same fingerprint simultaneously using other acquisition methods, such as using optical and ultrasonic methods to acquire fingerprints at the same time.

[0056] Step 2: The dual fingerprint comparison and recognition strategy begins after fingerprint images are acquired by the two acquisition modules (capacitive fingerprint signal acquisition module 10 and ultrasonic fingerprint signal acquisition module 30). Initially, the separately acquired fingerprint image is matched with the previously entered fingerprint. If either fingerprint image does not match, the recognition is deemed a failure. Only when both fingerprint images match successfully does the process proceed to the next step, i.e., step 3.

[0057] For example, the system determines whether the matching degree between a capacitive fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree. If yes, the capacitive fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library; otherwise, the capacitive fingerprint image is considered not to match any fingerprint image in the pre-recorded fingerprint image library, and the recognition verification is considered to have failed. Similarly, the system determines whether the matching degree between an ultrasonic fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree. If yes, the ultrasonic fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library; otherwise, the ultrasonic fingerprint image is considered not to match any fingerprint image in the pre-recorded fingerprint image library, and the recognition verification is considered to have failed.

[0058] In step S130, if the matching comparison result shows that both the first fingerprint image and the second fingerprint image match the corresponding fingerprint images in the pre-recorded fingerprint image database, the first fingerprint image and the second fingerprint image are compared for overlap to obtain overlapping and non-overlapping fingerprint regions in the first and second fingerprint images, which are taken as the overlap comparison result. The overlap comparison result includes: the overlapping regions (areas where the fingerprint images in the first and second fingerprint images overlap) and the non-overlapping regions (areas where the fingerprint images in the first and second fingerprint images do not overlap).

[0059] In some embodiments, the specific process of comparing the first fingerprint image with the second fingerprint image in step S130 to obtain the overlapping fingerprint regions and non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image is described in the following exemplary description.

[0060] The following is combined with Figure 3 The schematic diagram shown is a flowchart of an embodiment of the method of the present invention that compares the first fingerprint image with the second fingerprint image. It further illustrates the specific process of comparing the first fingerprint image with the second fingerprint image in step S130, including steps S310 to S340.

[0061] Step S310: Divide the image area of ​​the first fingerprint image and the image area of ​​the second fingerprint image into one or more regions according to a set division method.

[0062] Step S320: For one or more regions obtained by division, the fingerprint images of each identical region in one or more regions of the first fingerprint image are compared and overlapped. The comparison results are as follows.

[0063] Step S330: If the image regions of the first fingerprint image and the second fingerprint image overlap in the same region, then the image regions of the first fingerprint image and the second fingerprint image are determined to be overlapping regions in the same region.

[0064] Step S340: If the image regions of the first fingerprint image and the second fingerprint image cannot overlap in the same region, then the image regions of the first fingerprint image and the second fingerprint image are determined to be non-overlapping regions in the same region.

[0065] Specifically, all overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as the overlapping fingerprint regions of the first fingerprint image and the second fingerprint image. All non-overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as the non-overlapping fingerprint regions of the first fingerprint image and the second fingerprint image.

[0066] Specifically, such as Figure 8 As shown, the dual fingerprint verification device performs fingerprint recognition and fingerprint improvement based on a preset fingerprint comparison and recognition strategy. The dual fingerprint comparison and recognition process also includes: Step 3, where the capacitive fingerprint image matches the corresponding fingerprint image in the pre-recorded fingerprint image library, and the ultrasonic fingerprint image matches the corresponding fingerprint image in the pre-recorded fingerprint image library, the capacitive fingerprint image and the ultrasonic fingerprint image are matched separately with the corresponding fingerprint images in the pre-recorded fingerprint image library. If the separate match is successful, the device proceeds to dual matching.

[0067] During dual matching, capacitive fingerprint images and ultrasonic fingerprint images are compared by overlap. For example, the entire fingerprint image of both acquired images is divided into N M*M square image regions. Individual M*M images of the same region are compared; those that are completely identical are considered to overlap. N and M are positive integers. Considering that although capacitive and ultrasonic fingerprint images are acquired from the same part of the human finger at the same time, they are acquired using different methods, so the resulting capacitive and ultrasonic fingerprint images will not be completely overlapping. Therefore, by comparing the capacitive and ultrasonic fingerprint images by overlap, the overlapping parts of the fingerprint images in the capacitive and ultrasonic images are marked as overlapping regions, and the non-overlapping parts are marked as multiple non-overlapping regions. Multiple non-overlapping regions refer to the N regions minus the overlapping region. For example, assuming the above division results in 10 1mm*1mm images, there is 1 overlapping region and the other 9 are non-overlapping regions.

[0068] In step S140, the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image are compared for similarity to obtain a similarity comparison result. The similarity comparison result is either the similarity between the non-overlapping regions in the first fingerprint image and the second fingerprint image reaches a set similarity threshold, or the similarity between the non-overlapping regions in the first fingerprint image and the second fingerprint image does not reach the set similarity threshold.

[0069] In some embodiments, the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: one or more non-overlapping regions between the image regions of the first fingerprint image and the image regions of the second fingerprint image, referred to as one or more non-overlapping sub-fingerprint regions.

[0070] The specific process of comparing the similarity of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image in step S140 to obtain the similarity comparison result is illustrated in the following exemplary description.

[0071] The following is combined with Figure 4 The schematic diagram shown is a flowchart of an embodiment of the method of the present invention for comparing the similarity of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. It further illustrates the specific process of comparing the similarity of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image in step S140, including steps S410 to S430.

[0072] Step S410: For each non-overlapping sub-fingerprint region in the non-overlapping fingerprint regions of the first fingerprint image and the second fingerprint image, the similarity of each non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image is fitted and compared individually. The fitting and comparison similarity is as follows.

[0073] Step S420: If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image reaches a set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be matching regions.

[0074] Step S430: If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image does not reach a set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be non-matching regions.

[0075] Specifically, for non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, all matching regions between any non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image are denoted as the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

[0076] All non-matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are denoted as non-matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

[0077] Specifically, such as Figure 8 As shown, the dual fingerprint verification device performs fingerprint recognition and fingerprint improvement based on a preset fingerprint comparison and recognition strategy. The dual fingerprint comparison and recognition process also includes: In step 3, each non-overlapping region in the multiple non-overlapping regions is individually fitted and compared for similarity. For example, the similarity between an online image and a portrait image can be compared, although the judgment logic needs to be adjusted. When fitting and comparing the similarity of each non-overlapping region individually, a similarity threshold A% is set. If the similarity obtained from the individual comparison of each non-overlapping region reaches A%, it is marked as a matching fingerprint region; otherwise, it is marked as a non-matching fingerprint region. Then, step 4 is executed. The value of A% can be adjusted according to the actual effect; it can be between 1% and 99%, but in practice, it will certainly not be set too low.

[0078] In step S150, based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, it is determined whether the dual verification of the first fingerprint image and the second fingerprint image is successful. If the dual verification of the first fingerprint image and the second fingerprint image is successful, it is determined that the fingerprint image of the same fingerprint surface of the human finger matches the corresponding fingerprint image in the pre-recorded fingerprint image library.

[0079] The present invention provides a dual fingerprint verification device that simultaneously acquires the same fingerprint image on the same cross-section of a human finger using a capacitive fingerprint acquisition module (such as capacitive fingerprint signal acquisition module 10) and an ultrasonic fingerprint acquisition module (such as ultrasonic fingerprint signal acquisition module 30). The fingerprint images are then compared using an image comparison strategy to achieve identification. Specifically, capacitive fingerprint acquisition works by detecting the difference in charge at the fingerprint ridges after the human finger directly contacts the acquisition module (such as capacitive fingerprint signal acquisition module 10), thus forming a fingerprint image. Ultrasonic fingerprint acquisition utilizes the penetrating power of ultrasound to non-contactly measure the fingerprint image. Ultrasonic waves emitted by the ultrasonic fingerprint acquisition module (such as ultrasonic fingerprint signal acquisition module 30) penetrate the medium to reach the fingerprint ridges, and the returning ultrasound waves are detected to form a fingerprint image. The fingerprint images acquired by the capacitive fingerprint acquisition module (such as capacitive fingerprint signal acquisition module 10) are compared, and a preset comparison strategy determines the final identification result, thus avoiding the risk of physical cracking when a single fingerprint acquisition module is used. In this way, dual fingerprint verification is performed by comparing fingerprint images of the same fingerprint obtained by two different methods within the same time period. Specifically, the fingerprint images of the same fingerprint obtained by two different methods within the same time period are compared and identified, and the final comparison and identification result is given according to the set comparison strategy. This prevents a single fingerprint acquisition method from being cracked, solves the problem that a single fingerprint acquisition method is easy to acquire and crack, and greatly improves the security of fingerprint recognition function.

[0080] In some implementations, the similarity comparison results of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

[0081] The specific process of determining whether the dual verification of the first fingerprint image and the second fingerprint image is successful based on the similarity comparison results of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image and the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image in step S150 is illustrated in the following exemplary description.

[0082] The following is combined with Figure 5 The schematic diagram shown is a flowchart of an embodiment of the method of the present invention for determining whether the dual verification of the first fingerprint image and the second fingerprint image is successful. It further illustrates the specific process of determining whether the dual verification of the first fingerprint image and the second fingerprint image is successful in step S150, including steps S510 to S550.

[0083] Step S510: The overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, as well as the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, are determined as the dual-matching fingerprint regions in the first fingerprint image and the second fingerprint image.

[0084] Step S520: The sum of the double-matching fingerprint regions in the first fingerprint image and the second fingerprint image, and the non-matching fingerprint regions in the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, is determined as the complete fingerprint region in the first fingerprint image and the second fingerprint image.

[0085] Step S530: The ratio of the double-matching fingerprint regions in the first fingerprint image and the second fingerprint image to the complete fingerprint regions in the first fingerprint image and the second fingerprint image is determined as the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image.

[0086] Step S540: If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image reaches the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered successful.

[0087] Step S550: If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image does not reach the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered unsuccessful.

[0088] Specifically, such as Figure 8As shown, the dual fingerprint verification device performs fingerprint recognition and fingerprint improvement based on a preset fingerprint comparison and recognition strategy. The dual fingerprint comparison and recognition process also includes: Step 4: After the acquired capacitive fingerprint image and ultrasonic fingerprint image are compared individually in Step 1 and then compared twice in Steps 2 and 3, they are divided into overlapping fingerprint regions, matching fingerprint regions, and non-matching fingerprint regions. These overlapping, matching, and non-matching fingerprint regions are then integrated and calculated into a single complete fingerprint region. Within this complete fingerprint region, overlapping and matching fingerprint regions are classified as matched, while non-matching fingerprint regions are classified as non-matching, and the complete fingerprint matching rate is calculated. For example, a fingerprint can be divided into N images (N is a positive integer). Each image region is compared individually, and after comparison, overlapping, matching, and non-matching regions are marked. Finally, these regions are combined back into the original complete fingerprint, and the matching rate is calculated. In other words, the integrated calculation refers to the previous division into N regions for standardization; here, the marked N regions are combined back into the original fingerprint. The matching rate is equal to the ratio of the sum of overlapping and matching regions to the sum of overlapping, matching, and non-matching regions. For example, if the region is divided into 10 regions, with 1 overlapping region and 7 matching regions, then the matching rate = (7+1) / 10 = 80%.

[0089] After obtaining the complete fingerprint matching rate, a matching rate threshold B% is set. If the complete fingerprint matching rate reaches B%, the recognition and verification are considered successful; otherwise, the recognition and verification are considered unsuccessful. For successfully recognized fingerprint images, step 5 can be executed to self-learn the overlapping parts to improve the corresponding fingerprint images in the pre-recorded fingerprint images. The value of B% can be adjusted according to the actual results; it can range from 1% to 99%, but it will certainly not be set too low in practice.

[0090] In some embodiments, the control method of the dual fingerprint verification device described in the present invention further includes: when the dual verification of the first fingerprint image and the second fingerprint image is successful, performing self-learning on the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, so as to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprint of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the update of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

[0091] Specifically, such as Figure 8As shown, the dual fingerprint verification device performs fingerprint recognition and fingerprint improvement based on a preset fingerprint comparison and recognition strategy. The dual fingerprint comparison and recognition process also includes: Step 5, determining the successfully recognized fingerprint and separating and storing the overlapping fingerprint regions. After multiple successful recognitions, and after M (M is a positive integer) overlaps in the same overlapping region, the fingerprint image of the overlapping region is self-learned and added to the original recorded fingerprint image, achieving a more detailed fingerprint effect. Single fingerprint physical cracking occurs during the initial matching stage, where interference images are successfully recognized within the error threshold, and are subsequently supplemented multiple times by self-learning. However, the multi-comparison fingerprint image obtained through the scheme of this invention effectively prevents a single fingerprint from being successfully recognized within the error range without being able to identify the interference image, effectively preventing physical interference fingerprint cracking.

[0092] For example: First-level comparison: Verification of individual fingerprint modules. If a single fingerprint module's image is affected by interfering substances, the two fingerprint modules may produce different results—one recognizing and the other not. This prevents simple image interference from being cracked. Second-level comparison: If the interfering image deceives the initial match, the passed image is further subdivided for comparison, i.e., region-based comparison. The impact of interfering images on details will vary significantly between the two acquisition methods. Therefore, region-based comparison can prevent accidental cracking when both acquired images are interfered with. Third-level comparison: During region-based comparison, corresponding comparisons are also performed, distinguishing between overlap, matching, and non-matching. The interference area is located and narrowed down, and a certain threshold is set to exclude interfering images. Finally, the matching rate is obtained to pass fingerprint recognition, preventing interference images from being misidentified and cracked by fingerprints within the error range.

[0093] Of course, when using different identification and comparison strategies based on fingerprints obtained through two acquisition methods, the identification and comparison strategy of this invention aims to prevent interference image cracking and improve fingerprint details. Therefore, simple regional image comparison is used, while other implementations may use fingerprint feature comparison or more complex image comparison logic. Thus, the solution of this invention performs self-learning on highly overlapping fingerprints in the fingerprint images acquired by the capacitive fingerprint acquisition module (such as the capacitive fingerprint signal acquisition module 10) and the ultrasonic fingerprint acquisition module (such as the ultrasonic fingerprint signal acquisition module 30) to improve the original fingerprint details and restore the true fingerprint. This allows the dual fingerprint verification method to improve fingerprint details through self-learning, further enhancing the security of fingerprint recognition and thus greatly improving the security of identity authentication.

[0094] As can be seen, the dual fingerprint verification device provided by the present invention ensures that the collected fingerprints are from the same fingerprint state through a simultaneous dual fingerprint acquisition mechanism on the same side. After fingerprint acquisition, comparison and identification are performed to prevent single fingerprint acquisition methods from being cracked by physical fingerprint attacks, thus solving the problem that a single fingerprint acquisition method is easily cracked and greatly improving the security of fingerprint recognition. Simultaneously, by utilizing the highly overlapping portions of successfully identified fingerprints, the device self-learns and improves upon real fingerprints, supplementing the limitations of the recorded fingerprints and further enhancing the security of identity authentication.

[0095] The technical solution of this embodiment employs a capacitive fingerprint acquisition module and an ultrasonic fingerprint acquisition module to simultaneously acquire the same fingerprint image from the same cross-section of a human finger, resulting in capacitive and ultrasonic fingerprint images. These images are then matched with a pre-recorded human finger fingerprint image to identify overlapping and non-overlapping regions. If both matching results meet a set error threshold, the non-overlapping fingerprint regions in the capacitive and ultrasonic images are compared regionally to identify matching and non-matching regions. Based on the overlapping and non-overlapping regions, the final matching result between the capacitive and ultrasonic fingerprint images and the human finger is determined, thus confirming the success of fingerprint verification. Therefore, by using two different fingerprint acquisition methods simultaneously for dual fingerprint verification, the vulnerability of a single fingerprint acquisition method can be prevented, significantly enhancing the security of fingerprint recognition.

[0096] According to embodiments of the present invention, a control device for a dual fingerprint verification device corresponding to the control method for the dual fingerprint verification device is also provided. See also Figure 6 The diagram shows a structural schematic of an embodiment of the device of the present invention. The dual fingerprint verification device includes: a first fingerprint acquisition module and a second fingerprint acquisition module. The first fingerprint acquisition module is, for example, a capacitive fingerprint signal acquisition module 10, and the second fingerprint acquisition module is, for example, an ultrasonic fingerprint signal acquisition module 30. The first fingerprint acquisition module and the second fingerprint acquisition module are capable of simultaneously acquiring fingerprint images of the same fingerprint surface of a human finger to obtain a first fingerprint image and a second fingerprint image. Specifically, the same fingerprint surface of a human finger can be the fingerprint surface of the same cross-section of the human finger.

[0097] In some embodiments, the first fingerprint acquisition module includes a capacitive fingerprint signal acquisition module 10. The second fingerprint acquisition module includes an ultrasonic fingerprint signal acquisition module 30.

[0098] In the dual fingerprint verification device, the capacitive fingerprint signal acquisition module 10 is located on the top layer of the dual fingerprint verification device, and the ultrasonic fingerprint signal acquisition module 30 is located on the bottom layer of the dual fingerprint verification device. The capacitive fingerprint signal acquisition module 10 and the ultrasonic fingerprint signal acquisition module 30 are isolated by a medium, which can be a pressure plate 20.

[0099] When the capacitive fingerprint signal acquisition module 10 is pressed on the same fingerprint surface of the human finger, the capacitive fingerprint signal acquisition module 10 and the ultrasonic fingerprint signal acquisition module 30 simultaneously acquire fingerprint images of the same fingerprint surface of the human finger to obtain the first fingerprint image and the second fingerprint image.

[0100] Specifically, Figure 7 This is a cross-sectional structural diagram of one embodiment of a dual fingerprint acquisition device. Figure 7 The dual fingerprint acquisition device shown includes: a capacitive fingerprint signal acquisition module 10, a pressure plate 20, and an ultrasonic fingerprint signal acquisition module 30. The ultrasonic fingerprint signal acquisition module 30 includes: an acoustic coupling medium 31, an ultrasonic sensor element 32, and a display substrate 33.

[0101] See Figure 7 In the example shown, arranged from top to bottom, the capacitive fingerprint signal acquisition module 10 is located on the top layer of the dual fingerprint acquisition device, the ultrasonic fingerprint signal acquisition module 30 is located on the bottom layer, and the pressure plate 20 is located between the capacitive fingerprint signal acquisition module 10 and the ultrasonic fingerprint signal acquisition module 30. In the ultrasonic fingerprint signal acquisition module 30, the acoustic coupling medium 31 is located on the top layer, the display substrate 33 is located on the bottom layer, and the ultrasonic sensor element 32 is located in the acoustic coupling medium 31 and close to the display substrate 33.

[0102] like Figure 6 As shown, the control device of the dual fingerprint verification device of the present invention includes: an acquisition unit 102 and a control unit 104.

[0103] The acquisition unit 102 is configured to acquire the first fingerprint image acquired by the first fingerprint acquisition module and the second fingerprint acquisition module acquired by the second fingerprint acquisition module when the first fingerprint acquisition module and the second fingerprint acquisition module simultaneously acquire fingerprint images of the same fingerprint surface of a human finger. The specific functions and processing of the acquisition unit 102 are described in step S110.

[0104] See Figure 7In the example shown, when a human finger is pressed on the dual fingerprint acquisition device, the valleys and ridges of the finger form an equivalent capacitor with the capacitor plates in the capacitive fingerprint signal acquisition module 10. The distance from the surface valleys of the human finger to the capacitor plates in the capacitive fingerprint signal acquisition module 10 is greater than the distance from the surface ridges of the human finger to the capacitor plates in the capacitive fingerprint signal acquisition module 10, and the charge on the capacitor from the surface valleys of the human finger is less than the charge on the capacitor from the surface ridges of the human finger. The controller in the dual fingerprint verification device acquires a fingerprint image by detecting the difference between the charge on the capacitor from the surface valleys of the human finger and the charge on the capacitor from the surface ridges of the human finger. The raised portion of the fingerprint at the fingertip is the ridge, i.e., the surface ridge of the human finger, and the recessed portion of the fingerprint at the fingertip is the valley, i.e., the surface valley of the human finger.

[0105] While the capacitive fingerprint signal acquisition module 10 is operating, the ultrasonic fingerprint signal acquisition module 30 also begins its acquisition process simultaneously. Ultrasonic waves are emitted from the ultrasonic sensor element 32, penetrating the acoustic coupling medium 32, the pressure plate 20, and the capacitive fingerprint signal acquisition module 10 to reach the surface of the human finger. When the human finger presses against the capacitive fingerprint signal acquisition module 10, the ridges of the finger's surface directly contact the module, while some air remains between the valleys and the module. The ultrasonic waves, after reaching the ridges and valleys of the finger, are reflected back through the air gap and transmitted to the ultrasonic sensor element 32. The ultrasonic sensor element 32 detects the difference between the reflected and emitted waves to obtain a fingerprint image of the ridges and valleys of the finger's surface, which is then displayed on the display substrate 33. At this time, both fingerprint acquisition modules (capacitive fingerprint signal acquisition module 10 and ultrasonic fingerprint signal acquisition module 30) acquire corresponding fingerprint images, which are then used for fingerprint recognition and refinement using a preset fingerprint comparison and identification strategy. In related solutions, fingerprint recognition technology only recognizes a single fingerprint image. However, the fingerprint recognition strategy of this invention can prevent interference images from being cracked by comparison because the images collected by two different acquisition sensors are not exactly the same. At the same time, it can also refine and improve the fingerprint.

[0106] The control unit 104 is also configured to match and compare the first fingerprint image and the second fingerprint image with a pre-recorded fingerprint image library to obtain a matching comparison result. The specific functions and processing of this control unit 104 are described in step S120.

[0107] In some embodiments, the control unit 104, based on a pre-recorded fingerprint image database, performs matching and comparison between the first fingerprint image and the second fingerprint image and the pre-recorded fingerprint image database respectively to obtain matching and comparison results, including:

[0108] The control unit 104 is also specifically configured to call the pre-recorded fingerprint image library. The specific functions and processing of the control unit 104 are further described in step S210.

[0109] The control unit 104 is further configured to match the first fingerprint image with any fingerprint image in the pre-recorded fingerprint image library. If the matching degree between the first fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree, then the first fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library. The specific functions and processing of this control unit 104 are further described in step S220.

[0110] The control unit 104 is further configured to match the second fingerprint image with any fingerprint image in the pre-recorded fingerprint image library. If the matching degree between the second fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree, then the second fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library. The specific functions and processing of this control unit 104 are further described in step S230.

[0111] The matching comparison result is either that both the first fingerprint image and the second fingerprint image match the corresponding fingerprint image in the pre-recorded fingerprint image library, or that at least one of the first fingerprint image and the second fingerprint image does not match the corresponding fingerprint image in the pre-recorded fingerprint image library.

[0112] Specifically, Figure 8 This is a schematic diagram illustrating a dual fingerprint comparison and recognition process in a dual fingerprint verification device, illustrating fingerprint recognition and fingerprint refinement based on a preset fingerprint comparison and recognition strategy. Figure 8 As shown, the dual fingerprint verification device performs fingerprint recognition and fingerprint improvement based on a preset fingerprint comparison and recognition strategy, including the following dual fingerprint comparison and recognition process:

[0113] Step 1: When a human finger presses the dual fingerprint verification device, the capacitive fingerprint signal acquisition module 10 and the ultrasonic fingerprint signal acquisition module 30 simultaneously acquire the same fingerprint image on the same cross-section of the human finger. The fingerprint image acquired by the capacitive fingerprint signal acquisition module 10 is recorded as the capacitive fingerprint image, and the fingerprint image acquired by the ultrasonic fingerprint signal acquisition module 30 is recorded as the ultrasonic fingerprint image. Then, proceed to Step 2. Of course, the solution of this invention is to acquire fingerprints using ultrasonic and capacitive methods on the same fingerprint cross-section. Different implementation devices can also acquire the same fingerprint simultaneously using other acquisition methods, such as using optical and ultrasonic methods to acquire fingerprints at the same time.

[0114] Step 2: The dual fingerprint comparison and recognition strategy begins after fingerprint images are acquired by the two acquisition modules (capacitive fingerprint signal acquisition module 10 and ultrasonic fingerprint signal acquisition module 30). Initially, the separately acquired fingerprint image is matched with the previously entered fingerprint. If either fingerprint image does not match, the recognition is deemed a failure. Only when both fingerprint images match successfully does the process proceed to the next step, i.e., step 3.

[0115] For example, the system determines whether the matching degree between a capacitive fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree. If yes, the capacitive fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library; otherwise, the capacitive fingerprint image is considered not to match any fingerprint image in the pre-recorded fingerprint image library, and the recognition verification is considered to have failed. Similarly, the system determines whether the matching degree between an ultrasonic fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree. If yes, the ultrasonic fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library; otherwise, the ultrasonic fingerprint image is considered not to match any fingerprint image in the pre-recorded fingerprint image library, and the recognition verification is considered to have failed.

[0116] The control unit 104 is further configured to, when the matching comparison result shows that both the first fingerprint image and the second fingerprint image match the corresponding fingerprint images in the pre-recorded fingerprint image library, perform an overlay comparison between the first fingerprint image and the second fingerprint image to obtain overlapping and non-overlapping fingerprint regions in the first and second fingerprint images as the overlay comparison result. The overlay comparison result includes: the overlapping region (the area where the fingerprint images in the first and second fingerprint images overlap) and the non-overlapping region (the area where the fingerprint images in the first and second fingerprint images do not overlap). For the specific functions and processing of this control unit 104, please refer to step S130.

[0117] In some embodiments, the control unit 104 compares the first fingerprint image with the second fingerprint image to obtain overlapping and non-overlapping fingerprint regions in the first and second fingerprint images, including:

[0118] The control unit 104 is further configured to divide the image area of ​​the first fingerprint image and the image area of ​​the second fingerprint image into one or more regions according to a set division method. The specific functions and processing of the control unit 104 are further described in step S310.

[0119] The control unit 104 is further configured to perform an overlap comparison on the image regions of the first fingerprint image and the image regions of the second fingerprint image, for one or more regions that have been divided, comparing the fingerprint images of each identical region. The overlap comparison results are as follows. The specific functions and processing of the control unit 104 are further described in step S320.

[0120] The control unit 104 is further configured to determine that the image regions of the first fingerprint image and the second fingerprint image overlap in the same region if the image regions of the first fingerprint image and the second fingerprint image overlap. The specific functions and processing of the control unit 104 are further described in step S330.

[0121] The control unit 104 is further configured to determine that the image regions of the first fingerprint image and the second fingerprint image are non-overlapping regions in the same area if the image regions of the first fingerprint image and the second fingerprint image cannot overlap. The specific functions and processing of the control unit 104 are further described in step S340.

[0122] Specifically, all overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as the overlapping fingerprint regions of the first fingerprint image and the second fingerprint image. All non-overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as the non-overlapping fingerprint regions of the first fingerprint image and the second fingerprint image.

[0123] Specifically, such as Figure 8As shown, the dual fingerprint verification device performs fingerprint recognition and fingerprint improvement based on a preset fingerprint comparison and recognition strategy. The dual fingerprint comparison and recognition process also includes: Step 3, where the capacitive fingerprint image matches the corresponding fingerprint image in the pre-recorded fingerprint image library, and the ultrasonic fingerprint image matches the corresponding fingerprint image in the pre-recorded fingerprint image library, the capacitive fingerprint image and the ultrasonic fingerprint image are matched separately with the corresponding fingerprint images in the pre-recorded fingerprint image library. If the separate match is successful, the device proceeds to dual matching.

[0124] During dual matching, capacitive fingerprint images and ultrasonic fingerprint images are compared by overlay. Considering that although capacitive and ultrasonic fingerprint images are acquired from the same part of the human finger at the same time, they are acquired using different methods, so the resulting capacitive and ultrasonic fingerprint images will not be completely overlapping. Therefore, by comparing the capacitive and ultrasonic fingerprint images by overlay, the overlapping parts of the fingerprint images in the capacitive and ultrasonic images are marked as overlapping regions, and the non-overlapping parts are marked as multiple non-overlapping regions.

[0125] The control unit 104 is further configured to perform a similarity comparison on the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image to obtain a similarity comparison result. The similarity comparison result is either the similarity between the non-overlapping regions in the first fingerprint image and the second fingerprint image reaches a set similarity threshold, or the similarity between the non-overlapping regions in the first fingerprint image and the second fingerprint image does not reach the set similarity threshold. For the specific functions and processing of the control unit 104, please refer to step S140.

[0126] In some embodiments, the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: one or more non-overlapping regions between the image regions of the first fingerprint image and the image regions of the second fingerprint image, referred to as one or more non-overlapping sub-fingerprint regions.

[0127] The control unit 104 performs a similarity comparison on the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image to obtain a similarity comparison result, including:

[0128] The control unit 104 is further configured to, for each non-overlapping sub-fingerprint region in the first fingerprint image and the second fingerprint image, individually perform a similarity comparison between each non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image. The similarity comparison results are as follows. The specific functions and processing of this control unit 104 are further described in step S410.

[0129] The control unit 104 is further configured to consider any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image as a matching region if the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image reaches a set similarity threshold. The specific functions and processing of the control unit 104 are further described in step S420.

[0130] The control unit 104 is further configured to consider any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image as a non-matching region if the similarity between their fitting comparison does not reach a set similarity threshold. The specific functions and processing of the control unit 104 are further described in step S430.

[0131] Specifically, for non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, all matching regions between any non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image are denoted as the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

[0132] All non-matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are denoted as non-matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

[0133] Specifically, such as Figure 8 As shown, the dual fingerprint verification device performs fingerprint recognition and fingerprint improvement based on a preset fingerprint comparison and recognition strategy. The dual fingerprint comparison and recognition process further includes: in step 3, each of the multiple non-overlapping regions is individually fitted and compared for similarity. When fitting and comparing the similarity of each non-overlapping region individually, a similarity threshold A% is set. If the similarity obtained from the individual comparison of each non-overlapping region reaches A%, it is marked as a matching fingerprint region; otherwise, it is marked as a non-matching fingerprint region. Then, step 4 is executed.

[0134] The control unit 104 is further configured to determine whether the dual verification of the first fingerprint image and the second fingerprint image is successful based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. If the dual verification of the first fingerprint image and the second fingerprint image is successful, it is determined that the fingerprint image of the same fingerprint surface of the human finger matches the corresponding fingerprint image in the pre-recorded fingerprint image database. The specific functions and processing of this control unit 104 are further described in step S150.

[0135] The present invention provides a dual fingerprint verification device that simultaneously acquires the same fingerprint image on the same cross-section of a human finger using a capacitive fingerprint acquisition module (such as capacitive fingerprint signal acquisition module 10) and an ultrasonic fingerprint acquisition module (such as ultrasonic fingerprint signal acquisition module 30). The fingerprint images are then compared using an image comparison strategy to achieve identification. Specifically, capacitive fingerprint acquisition works by detecting the difference in charge at the fingerprint ridges after the human finger directly contacts the acquisition module (such as capacitive fingerprint signal acquisition module 10), thus forming a fingerprint image. Ultrasonic fingerprint acquisition utilizes the penetrating power of ultrasound to non-contactly measure the fingerprint image. Ultrasonic waves emitted by the ultrasonic fingerprint acquisition module (such as ultrasonic fingerprint signal acquisition module 30) penetrate the medium to reach the fingerprint ridges, and the returning ultrasound waves are detected to form a fingerprint image. The fingerprint images acquired by the capacitive fingerprint acquisition module (such as capacitive fingerprint signal acquisition module 10) are compared, and a preset comparison strategy determines the final identification result, thus avoiding the risk of physical device interference when a single fingerprint acquisition module is used. In this way, dual fingerprint verification is performed by comparing fingerprint images of the same fingerprint obtained by two different methods within the same time period. Specifically, the fingerprint images of the same fingerprint obtained by two different methods within the same time period are compared and identified, and the final comparison and identification result is given according to the set comparison strategy. This prevents a single fingerprint acquisition method from being cracked, solves the problem that a single fingerprint acquisition method is easy to acquire and crack, and greatly improves the security of fingerprint recognition function.

[0136] In some implementations, the similarity comparison results of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

[0137] The control unit 104 determines whether the dual verification of the first fingerprint image and the second fingerprint image is successful based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, including:

[0138] The control unit 104 is further configured to determine the overlapping fingerprint regions and the non-overlapping fingerprint regions in the first and second fingerprint images as dual-matching fingerprint regions in the first and second fingerprint images. The specific functions and processing of this control unit 104 are further described in step S510.

[0139] The control unit 104 is further configured to determine the sum of the double-matching fingerprint regions in the first fingerprint image and the second fingerprint image, and the non-matching fingerprint regions in the first fingerprint image and the second fingerprint image, as the complete fingerprint region in the first fingerprint image and the second fingerprint image. The specific functions and processing of this control unit 104 are further described in step S520.

[0140] The control unit 104 is further configured to determine the ratio of the dual-matching fingerprint region in the first fingerprint image and the second fingerprint image to the complete fingerprint region in the first fingerprint image and the second fingerprint image as the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image. The specific functions and processing of this control unit 104 are further described in step S530.

[0141] The control unit 104 is further configured to consider the dual verification of the first fingerprint image and the second fingerprint image as successful if the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image reaches a set fingerprint matching rate. The specific functions and processing of the control unit 104 are further described in step S540.

[0142] The control unit 104 is further configured to consider the dual verification of the first fingerprint image and the second fingerprint image as unsuccessful if the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image does not reach a set fingerprint matching rate. The specific functions and processing of the control unit 104 are further described in step S550.

[0143] Specifically, such as Figure 8As shown, the dual fingerprint verification device performs fingerprint recognition and fingerprint improvement based on a preset fingerprint comparison and recognition strategy. The dual fingerprint comparison and recognition process also includes: Step 4: After the acquired capacitive fingerprint image and ultrasonic fingerprint image are compared individually in Step 1 and then compared twice in Steps 2 and 3, they are divided into overlapping fingerprint regions, matching fingerprint regions, and non-matching fingerprint regions. These overlapping, matching, and non-matching fingerprint regions are then integrated into a single complete fingerprint region. Within this complete fingerprint region, overlapping and matching fingerprint regions are classified as matched, while non-matching fingerprint regions are classified as non-matching. The complete fingerprint matching rate is then calculated. For example, a fingerprint can be divided into N images (N is a positive integer). Each image region is compared individually, and after comparison, overlapping, matching, and non-matching regions are marked. Finally, these are combined into a single complete fingerprint, and the matching rate is calculated. This matching rate is equal to the ratio of the sum of overlapping and matching regions to the sum of overlapping, matching, and non-matching regions.

[0144] After obtaining the complete fingerprint matching rate, a matching rate threshold B% is set. If the complete fingerprint matching rate reaches B%, the recognition and verification are considered successful; otherwise, the recognition and verification are considered unsuccessful. For successfully recognized fingerprint images, step 5 can be executed to self-learn the overlapping parts to improve the corresponding fingerprint images in the pre-recorded fingerprint images.

[0145] In some embodiments, the control device of the dual fingerprint verification device of the present invention further includes: the control unit 104 is further configured to, upon successful dual verification of the first fingerprint image and the second fingerprint image, perform self-learning on the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, so as to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprints of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the updating of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

[0146] Specifically, such as Figure 8As shown, the dual fingerprint verification device performs fingerprint recognition and fingerprint refinement according to a preset fingerprint comparison and recognition strategy. The dual fingerprint comparison and recognition process also includes: Step 5, determining the successfully recognized fingerprint and separating and storing the overlapping fingerprint regions. After multiple successful recognitions, and after M (M is a positive integer) overlaps in the same overlapping region, the fingerprint image of the overlapping region is self-learned and added to the original recorded fingerprint image to achieve a refined fingerprint detail effect. Single fingerprint physical cracking occurs during the initial matching stage, where interference images are successfully recognized within the error threshold and are simultaneously supplemented by multiple self-learning attempts. However, the fingerprint images obtained through the multiple comparisons of the present invention effectively prevent single fingerprints from being successfully recognized within the error range without being able to identify interference images, effectively preventing physical interference fingerprint cracking. Of course, when using different implementation methods for recognition and comparison strategies based on fingerprints obtained through two acquisition methods, the purpose of the recognition and comparison strategy of the present invention is to prevent interference image cracking and refine fingerprint details. Therefore, simple regional image comparison is used; other implementation methods, such as fingerprint feature comparison or more complex image comparison logic, are also possible. Thus, the solution of this invention performs self-learning on highly overlapping fingerprints in the fingerprint images acquired by the capacitive fingerprint acquisition module (such as the capacitive fingerprint signal acquisition module 10) and the ultrasonic fingerprint acquisition module (such as the ultrasonic fingerprint signal acquisition module 30) to improve the original fingerprint details and restore the real fingerprint. This allows the dual fingerprint verification method to improve fingerprint details through self-learning, further enhancing the security of fingerprint recognition and thus greatly improving the security of identity authentication.

[0147] As can be seen, the dual fingerprint verification device provided by the present invention ensures that the collected fingerprints are from the same fingerprint state through a simultaneous dual fingerprint acquisition mechanism on the same side. After fingerprint acquisition, comparison and identification are performed to prevent single fingerprint acquisition methods from being cracked by physical fingerprint attacks, thus solving the problem that a single fingerprint acquisition method is easily cracked and greatly improving the security of fingerprint recognition. Simultaneously, by utilizing the highly overlapping portions of successfully identified fingerprints, the device self-learns and improves upon real fingerprints, supplementing the limitations of the recorded fingerprints and further enhancing the security of identity authentication.

[0148] Since the processing and functions implemented by the device in this embodiment are basically the same as the embodiments, principles and examples of the aforementioned methods, any details not covered in the description of this embodiment can be found in the relevant descriptions in the aforementioned embodiments, and will not be repeated here.

[0149] The technical solution of this invention employs a capacitive fingerprint acquisition module and an ultrasonic fingerprint acquisition module to simultaneously acquire the same fingerprint image from the same cross-section of a human finger, resulting in capacitive and ultrasonic fingerprint images. These images are then matched with pre-recorded human finger fingerprint images to identify overlapping and non-overlapping regions. If both matching results meet a set error threshold, the non-overlapping fingerprint regions in the capacitive and ultrasonic images are compared regionally to identify matching and non-matching regions. Based on the overlapping and non-overlapping regions, the final matching result between the capacitive and ultrasonic fingerprint images and the human finger is determined. This final matching result determines whether fingerprint verification of the human finger is successful, preventing single fingerprint acquisition methods from being compromised by physical fingerprint attacks. This solves the problem of single fingerprint acquisition methods being easily compromised, significantly improving the security of fingerprint recognition.

[0150] According to an embodiment of the present invention, a dual fingerprint verification device corresponding to a control device for a dual fingerprint verification device is also provided. This dual fingerprint verification device may include: the control device for the dual fingerprint verification device described above.

[0151] Since the processing and functions implemented by the dual fingerprint verification device in this embodiment are basically the same as those of the aforementioned device embodiments, principles and examples, any details not covered in this embodiment can be found in the relevant descriptions in the aforementioned embodiments, and will not be repeated here.

[0152] The technical solution of this invention employs a capacitive fingerprint acquisition module and an ultrasonic fingerprint acquisition module to simultaneously acquire the same fingerprint image from the same cross-section of a human finger, resulting in capacitive and ultrasonic fingerprint images. These images are then matched with pre-recorded human finger fingerprint images to identify overlapping and non-overlapping regions. If both matching results meet a set error threshold, the non-overlapping fingerprint regions in the capacitive and ultrasonic images are compared regionally to identify matching and non-matching regions. Based on the overlapping and non-overlapping regions, the final matching result between the capacitive and ultrasonic fingerprint images and the human finger is determined. This final matching result determines whether fingerprint verification of the human finger is successful, solving the problem of easy cracking of single fingerprint acquisition methods and significantly improving the security of fingerprint recognition.

[0153] According to an embodiment of the present invention, a storage medium corresponding to a control method for a dual fingerprint verification device is also provided. The storage medium includes a stored program, wherein the program controls the device where the storage medium is located to execute the control method for the dual fingerprint verification device described above when it is executed.

[0154] Since the processing and functions implemented by the storage medium in this embodiment are basically the same as the embodiments, principles and examples of the aforementioned methods, any details not covered in this embodiment can be found in the relevant descriptions in the aforementioned embodiments, and will not be repeated here.

[0155] The technical solution of this invention employs a capacitive fingerprint acquisition module and an ultrasonic fingerprint acquisition module to simultaneously acquire the same fingerprint image from the same cross-section of a human finger, resulting in capacitive and ultrasonic fingerprint images. These images are then matched with pre-recorded human finger fingerprint images to identify overlapping and non-overlapping regions. If both matching results meet a set error threshold, the non-overlapping fingerprint regions in the capacitive and ultrasonic images are compared regionally to identify matching and non-matching regions. Based on the overlapping and non-overlapping regions, the final matching result between the capacitive and ultrasonic fingerprint images and the human finger is determined. This final matching result confirms whether fingerprint verification of the human finger is successful, preventing the use of a single fingerprint acquisition method and significantly improving the security of fingerprint recognition.

[0156] In summary, it is readily understood by those skilled in the art that, without conflict, the aforementioned advantageous methods can be freely combined and superimposed.

[0157] The above description is merely an embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of the claims of the present invention.

Claims

1. A control method for a dual fingerprint verification device, characterized in that, The dual fingerprint verification device includes: a first fingerprint acquisition module and a second fingerprint acquisition module; The control method for the dual fingerprint verification device includes: When the first fingerprint acquisition module and the second fingerprint acquisition module simultaneously acquire fingerprint images of the same fingerprint surface of a human finger, the first fingerprint image acquired by the first fingerprint acquisition module is obtained, and the second fingerprint image acquired by the second fingerprint acquisition module is obtained. Based on a pre-recorded fingerprint image database, the first fingerprint image and the second fingerprint image are matched and compared with the pre-recorded fingerprint image database to obtain matching and comparison results; If the matching comparison result is that both the first fingerprint image and the second fingerprint image match the corresponding fingerprint images in the pre-recorded fingerprint image library, the first fingerprint image and the second fingerprint image are compared to obtain the overlapping fingerprint regions and non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. The similarity of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image is compared to obtain the similarity comparison results; Based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first and second fingerprint images, it is determined whether the dual verification of the first and second fingerprint images is successful. If the dual verification of the first and second fingerprint images is successful, it is determined that the fingerprint image of the same fingerprint surface of the human finger matches the corresponding fingerprint image in the pre-recorded fingerprint image library.

2. The control method for the dual fingerprint verification device according to claim 1, characterized in that, The first fingerprint acquisition module includes a capacitive fingerprint signal acquisition module (10); the second fingerprint acquisition module includes an ultrasonic fingerprint signal acquisition module (30). In the dual fingerprint verification device, the capacitive fingerprint signal acquisition module (10) is located at the top layer of the dual fingerprint verification device, the ultrasonic fingerprint signal acquisition module (30) is located at the bottom layer of the dual fingerprint verification device, and the capacitive fingerprint signal acquisition module (10) and the ultrasonic fingerprint signal acquisition module (30) are isolated by a medium. When the capacitive fingerprint signal acquisition module (10) is pressed on the same fingerprint surface of the human finger, the capacitive fingerprint signal acquisition module (10) and the ultrasonic fingerprint signal acquisition module (30) simultaneously acquire fingerprint images of the same fingerprint surface of the human finger to obtain the first fingerprint image and the second fingerprint image.

3. The control method for the dual fingerprint verification device according to claim 1 or 2, characterized in that, Based on a pre-recorded fingerprint image database, the first fingerprint image and the second fingerprint image are matched and compared with the pre-recorded fingerprint image database to obtain matching and comparison results, including: Call the pre-recorded fingerprint image library; The first fingerprint image is matched with any fingerprint image in the pre-recorded fingerprint image library. If the matching degree between the first fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree, then the first fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library. The second fingerprint image is matched with any fingerprint image in the pre-recorded fingerprint image library. If the matching degree between the second fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree, then the second fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library. The matching comparison result is either that both the first fingerprint image and the second fingerprint image match the corresponding fingerprint image in the pre-recorded fingerprint image library, or that at least one of the first fingerprint image and the second fingerprint image does not match the corresponding fingerprint image in the pre-recorded fingerprint image library.

4. The control method for the dual fingerprint verification device according to claim 1 or 2, characterized in that, The first fingerprint image and the second fingerprint image are compared to obtain overlapping and non-overlapping fingerprint regions in the first and second fingerprint images, including: The image regions of the first fingerprint image and the second fingerprint image are each divided into one or more regions according to a set division method; For one or more regions obtained by segmentation, the fingerprint images of each identical region in one or more regions of the first fingerprint image are compared and overlapped: If the image regions of the first fingerprint image and the second fingerprint image overlap in the same region, then the image regions of the first fingerprint image and the second fingerprint image are determined to be overlapping regions in the same region. If the image regions of the first fingerprint image and the second fingerprint image cannot overlap in the same region, then the image regions of the first fingerprint image and the second fingerprint image are determined to be non-overlapping regions in the same region. Specifically, all overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as overlapping fingerprint regions of the first fingerprint image and the second fingerprint image; and all non-overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as non-overlapping fingerprint regions of the first fingerprint image and the second fingerprint image.

5. The control method for the dual fingerprint verification device according to claim 3, characterized in that, The first fingerprint image and the second fingerprint image are compared to obtain overlapping and non-overlapping fingerprint regions in the first and second fingerprint images, including: The image regions of the first fingerprint image and the second fingerprint image are each divided into one or more regions according to a set division method; For one or more regions obtained by segmentation, the fingerprint images of each identical region in one or more regions of the first fingerprint image are compared and overlapped: If the image regions of the first fingerprint image and the second fingerprint image overlap in the same region, then the image regions of the first fingerprint image and the second fingerprint image are determined to be overlapping regions in the same region. If the image regions of the first fingerprint image and the second fingerprint image cannot overlap in the same region, then the image regions of the first fingerprint image and the second fingerprint image are determined to be non-overlapping regions in the same region. Specifically, all overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as overlapping fingerprint regions of the first fingerprint image and the second fingerprint image; and all non-overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as non-overlapping fingerprint regions of the first fingerprint image and the second fingerprint image.

6. The control method for the dual fingerprint verification device according to any one of claims 1, 2, and 5, characterized in that, The non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: one or more non-overlapping regions between the image regions of the first fingerprint image and the image regions of the second fingerprint image, referred to as one or more non-overlapping sub-fingerprint regions; The similarity of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image is compared to obtain similarity comparison results, including: For each non-overlapping sub-fingerprint region in the first fingerprint image and the second fingerprint image, the similarity of each non-overlapping fingerprint region in the first fingerprint image and the corresponding non-overlapping fingerprint region in the second fingerprint image is individually compared and fitted. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image reaches a set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be matching regions. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image does not reach the set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be non-matching regions. Specifically, for non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, all matching regions between any non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image are denoted as matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. All non-matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are denoted as non-matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

7. The control method for the dual fingerprint verification device according to claim 3, characterized in that, The non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: one or more non-overlapping regions between the image regions of the first fingerprint image and the image regions of the second fingerprint image, referred to as one or more non-overlapping sub-fingerprint regions; The similarity of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image is compared to obtain similarity comparison results, including: For each non-overlapping sub-fingerprint region in the first fingerprint image and the second fingerprint image, the similarity of each non-overlapping fingerprint region in the first fingerprint image and the corresponding non-overlapping fingerprint region in the second fingerprint image is individually compared and fitted. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image reaches a set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be matching regions. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image does not reach the set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be non-matching regions. Specifically, for non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, all matching regions between any non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image are denoted as matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. All non-matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are denoted as non-matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

8. The control method for the dual fingerprint verification device according to claim 4, characterized in that, The non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: one or more non-overlapping regions between the image regions of the first fingerprint image and the image regions of the second fingerprint image, referred to as one or more non-overlapping sub-fingerprint regions; The similarity of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image is compared to obtain similarity comparison results, including: For each non-overlapping sub-fingerprint region in the first fingerprint image and the second fingerprint image, the similarity of each non-overlapping fingerprint region in the first fingerprint image and the corresponding non-overlapping fingerprint region in the second fingerprint image is individually compared and fitted. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image reaches a set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be matching regions. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image does not reach the set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be non-matching regions. Specifically, for non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, all matching regions between any non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image are denoted as matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. All non-matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are denoted as non-matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

9. The control method for the dual fingerprint verification device according to any one of claims 1, 2, 5, 7, and 8, characterized in that, The similarity comparison results of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. Based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first and second fingerprint images, it is determined whether the dual verification of the first and second fingerprint images was successful, including: The overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, as well as the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, are determined as the dual matching fingerprint regions in the first fingerprint image and the second fingerprint image. The sum of the double-matching fingerprint regions in the first fingerprint image and the second fingerprint image, and the non-matching fingerprint regions in the first fingerprint image and the second fingerprint image, is determined as the complete fingerprint region in the first fingerprint image and the second fingerprint image. The ratio of the double-matched fingerprint regions in the first and second fingerprint images to the complete fingerprint regions in the first and second fingerprint images is determined as the complete fingerprint matching rate of the first and second fingerprint images: If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image reaches the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered successful. If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image does not reach the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered unsuccessful.

10. The control method for the dual fingerprint verification device according to claim 3, characterized in that, The similarity comparison results of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. Based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first and second fingerprint images, it is determined whether the dual verification of the first and second fingerprint images was successful, including: The overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, as well as the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, are determined as the dual matching fingerprint regions in the first fingerprint image and the second fingerprint image. The sum of the double-matching fingerprint regions in the first fingerprint image and the second fingerprint image, and the non-matching fingerprint regions in the first fingerprint image and the second fingerprint image, is determined as the complete fingerprint region in the first fingerprint image and the second fingerprint image. The ratio of the double-matched fingerprint regions in the first and second fingerprint images to the complete fingerprint regions in the first and second fingerprint images is determined as the complete fingerprint matching rate of the first and second fingerprint images: If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image reaches the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered successful. If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image does not reach the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered unsuccessful.

11. The control method for the dual fingerprint verification device according to claim 4, characterized in that, The similarity comparison results of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. Based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first and second fingerprint images, it is determined whether the dual verification of the first and second fingerprint images was successful, including: The overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, as well as the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, are determined as the dual matching fingerprint regions in the first fingerprint image and the second fingerprint image. The sum of the double-matching fingerprint regions in the first fingerprint image and the second fingerprint image, and the non-matching fingerprint regions in the first fingerprint image and the second fingerprint image, is determined as the complete fingerprint region in the first fingerprint image and the second fingerprint image. The ratio of the double-matched fingerprint regions in the first and second fingerprint images to the complete fingerprint regions in the first and second fingerprint images is determined as the complete fingerprint matching rate of the first and second fingerprint images: If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image reaches the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered successful. If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image does not reach the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered unsuccessful.

12. The control method for the dual fingerprint verification device according to claim 6, characterized in that, The similarity comparison results of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. Based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first and second fingerprint images, it is determined whether the dual verification of the first and second fingerprint images was successful, including: The overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, as well as the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, are determined as the dual matching fingerprint regions in the first fingerprint image and the second fingerprint image. The sum of the double-matching fingerprint regions in the first fingerprint image and the second fingerprint image, and the non-matching fingerprint regions in the first fingerprint image and the second fingerprint image, is determined as the complete fingerprint region in the first fingerprint image and the second fingerprint image. The ratio of the double-matched fingerprint regions in the first and second fingerprint images to the complete fingerprint regions in the first and second fingerprint images is determined as the complete fingerprint matching rate of the first and second fingerprint images: If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image reaches the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered successful. If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image does not reach the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered unsuccessful.

13. The control method for the dual fingerprint verification device according to any one of claims 1, 2, 5, 7, 8, 10 to 12, characterized in that, Also includes: If the dual verification of the first fingerprint image and the second fingerprint image is successful, the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image are self-learned to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprint of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the update of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

14. The control method for the dual fingerprint verification device according to claim 3, characterized in that, Also includes: If the dual verification of the first fingerprint image and the second fingerprint image is successful, the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image are self-learned to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprint of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the update of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

15. The control method for the dual fingerprint verification device according to claim 4, characterized in that, Also includes: If the dual verification of the first fingerprint image and the second fingerprint image is successful, the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image are self-learned to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprint of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the update of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

16. The control method for the dual fingerprint verification device according to claim 6, characterized in that, Also includes: If the dual verification of the first fingerprint image and the second fingerprint image is successful, the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image are self-learned to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprint of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the update of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

17. The control method for the dual fingerprint verification device according to claim 9, characterized in that, Also includes: If the dual verification of the first fingerprint image and the second fingerprint image is successful, the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image are self-learned to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprint of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the update of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

18. A control device for a dual fingerprint verification device, characterized in that, The dual fingerprint verification device includes: a first fingerprint acquisition module and a second fingerprint acquisition module; The control device of the dual fingerprint verification device includes: The acquisition unit is configured to acquire the first fingerprint image acquired by the first fingerprint acquisition module and the second fingerprint acquisition module acquired by the second fingerprint acquisition module when the first fingerprint acquisition module and the second fingerprint acquisition module simultaneously acquire fingerprint images of the same fingerprint surface of a human finger. The control unit is also configured to match and compare the first fingerprint image and the second fingerprint image with the pre-recorded fingerprint image library based on the pre-recorded fingerprint image library to obtain a matching comparison result; The control unit is further configured to, when the matching comparison result is that both the first fingerprint image and the second fingerprint image match the corresponding fingerprint images in the pre-recorded fingerprint image library, perform an overlap comparison between the first fingerprint image and the second fingerprint image to obtain overlapping fingerprint regions and non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. The control unit is further configured to perform a similarity comparison on the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image to obtain a similarity comparison result; The control unit is further configured to determine whether the dual verification of the first fingerprint image and the second fingerprint image is successful based on the similarity comparison results of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image and the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, so that if the dual verification of the first fingerprint image and the second fingerprint image is successful, the fingerprint image of the same fingerprint surface of the human finger matches the corresponding fingerprint image in the pre-recorded fingerprint image library.

19. The control device for the dual fingerprint verification device according to claim 18, characterized in that, The first fingerprint acquisition module includes a capacitive fingerprint signal acquisition module (10); the second fingerprint acquisition module includes an ultrasonic fingerprint signal acquisition module (30). In the dual fingerprint verification device, the capacitive fingerprint signal acquisition module (10) is located at the top layer of the dual fingerprint verification device, the ultrasonic fingerprint signal acquisition module (30) is located at the bottom layer of the dual fingerprint verification device, and the capacitive fingerprint signal acquisition module (10) and the ultrasonic fingerprint signal acquisition module (30) are isolated by a medium. When the capacitive fingerprint signal acquisition module (10) is pressed on the same fingerprint surface of the human finger, the capacitive fingerprint signal acquisition module (10) and the ultrasonic fingerprint signal acquisition module (30) simultaneously acquire fingerprint images of the same fingerprint surface of the human finger to obtain the first fingerprint image and the second fingerprint image.

20. The control device for the dual fingerprint verification device according to claim 18 or 19, characterized in that, The control unit, based on a pre-recorded fingerprint image database, matches and compares the first fingerprint image and the second fingerprint image with the pre-recorded fingerprint image database to obtain matching and comparison results, including: Call the pre-recorded fingerprint image library; The first fingerprint image is matched with any fingerprint image in the pre-recorded fingerprint image library. If the matching degree between the first fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree, then the first fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library. The second fingerprint image is matched with any fingerprint image in the pre-recorded fingerprint image library. If the matching degree between the second fingerprint image and any fingerprint image in the pre-recorded fingerprint image library reaches a preset matching degree, then the second fingerprint image is considered to match the corresponding fingerprint image in the pre-recorded fingerprint image library. The matching comparison result is either that both the first fingerprint image and the second fingerprint image match the corresponding fingerprint image in the pre-recorded fingerprint image library, or that at least one of the first fingerprint image and the second fingerprint image does not match the corresponding fingerprint image in the pre-recorded fingerprint image library.

21. The control device for the dual fingerprint verification device according to claim 18 or 19, characterized in that, The control unit compares the first fingerprint image with the second fingerprint image to obtain overlapping and non-overlapping fingerprint regions in the first and second fingerprint images, including: The image regions of the first fingerprint image and the second fingerprint image are each divided into one or more regions according to a set division method; For one or more regions obtained by segmentation, the fingerprint images of each identical region in one or more regions of the first fingerprint image are compared and overlapped: If the image regions of the first fingerprint image and the second fingerprint image overlap in the same region, then the image regions of the first fingerprint image and the second fingerprint image are determined to be overlapping regions in the same region. If the image regions of the first fingerprint image and the second fingerprint image cannot overlap in the same region, then the image regions of the first fingerprint image and the second fingerprint image are determined to be non-overlapping regions in the same region. Specifically, all overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as overlapping fingerprint regions of the first fingerprint image and the second fingerprint image; and all non-overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as non-overlapping fingerprint regions of the first fingerprint image and the second fingerprint image.

22. The control device for the dual fingerprint verification device according to claim 20, characterized in that, The control unit compares the first fingerprint image with the second fingerprint image to obtain overlapping and non-overlapping fingerprint regions in the first and second fingerprint images, including: The image regions of the first fingerprint image and the second fingerprint image are each divided into one or more regions according to a set division method; For one or more regions obtained by segmentation, the fingerprint images of each identical region in one or more regions of the first fingerprint image are compared and overlapped: If the image regions of the first fingerprint image and the second fingerprint image overlap in the same region, then the image regions of the first fingerprint image and the second fingerprint image are determined to be overlapping regions in the same region. If the image regions of the first fingerprint image and the second fingerprint image cannot overlap in the same region, then the image regions of the first fingerprint image and the second fingerprint image are determined to be non-overlapping regions in the same region. Specifically, all overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as overlapping fingerprint regions of the first fingerprint image and the second fingerprint image; and all non-overlapping areas between the image regions of the first fingerprint image and the image regions of the second fingerprint image are denoted as non-overlapping fingerprint regions of the first fingerprint image and the second fingerprint image.

23. The control device for the dual fingerprint verification device according to any one of claims 18, 19, and 22, characterized in that, The non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: one or more non-overlapping regions between the image regions of the first fingerprint image and the image regions of the second fingerprint image, referred to as one or more non-overlapping sub-fingerprint regions; The control unit performs a similarity comparison on the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image to obtain a similarity comparison result, including: For each non-overlapping sub-fingerprint region in the first fingerprint image and the second fingerprint image, the similarity of each non-overlapping fingerprint region in the first fingerprint image and the corresponding non-overlapping fingerprint region in the second fingerprint image is individually compared and fitted. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image reaches a set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be matching regions. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image does not reach the set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be non-matching regions. Specifically, for non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, all matching regions between any non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image are denoted as matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. All non-matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are denoted as non-matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

24. The control device for the dual fingerprint verification device according to claim 20, characterized in that, The non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: one or more non-overlapping regions between the image regions of the first fingerprint image and the image regions of the second fingerprint image, referred to as one or more non-overlapping sub-fingerprint regions; The control unit performs a similarity comparison on the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image to obtain a similarity comparison result, including: For each non-overlapping sub-fingerprint region in the first fingerprint image and the second fingerprint image, the similarity of each non-overlapping fingerprint region in the first fingerprint image and the corresponding non-overlapping fingerprint region in the second fingerprint image is individually compared and fitted. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image reaches a set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be matching regions. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image does not reach the set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be non-matching regions. Specifically, for non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, all matching regions between any non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image are denoted as matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. All non-matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are denoted as non-matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

25. The control device for the dual fingerprint verification device according to claim 21, characterized in that, The non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: one or more non-overlapping regions between the image regions of the first fingerprint image and the image regions of the second fingerprint image, referred to as one or more non-overlapping sub-fingerprint regions; The control unit performs a similarity comparison on the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image to obtain a similarity comparison result, including: For each non-overlapping sub-fingerprint region in the first fingerprint image and the second fingerprint image, the similarity of each non-overlapping fingerprint region in the first fingerprint image and the corresponding non-overlapping fingerprint region in the second fingerprint image is individually compared and fitted. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image reaches a set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be matching regions. If the fitting comparison similarity between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image does not reach the set similarity threshold, then the non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are considered to be non-matching regions. Specifically, for non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, all matching regions between any non-overlapping sub-fingerprint region of the first fingerprint image and the corresponding non-overlapping sub-fingerprint region of the second fingerprint image are denoted as matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. All non-matching regions between any non-overlapping fingerprint region of the first fingerprint image and the corresponding non-overlapping fingerprint region of the second fingerprint image are denoted as non-matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image.

26. The control device for the dual fingerprint verification device according to any one of claims 18, 19, 22, 24 to 25, characterized in that, The similarity comparison results of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. The control unit determines whether the dual verification of the first fingerprint image and the second fingerprint image is successful based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, including: The overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, as well as the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, are determined as the dual matching fingerprint regions in the first fingerprint image and the second fingerprint image. The sum of the double-matching fingerprint regions in the first fingerprint image and the second fingerprint image, and the non-matching fingerprint regions in the first fingerprint image and the second fingerprint image, is determined as the complete fingerprint region in the first fingerprint image and the second fingerprint image. The ratio of the double-matched fingerprint regions in the first and second fingerprint images to the complete fingerprint regions in the first and second fingerprint images is determined as the complete fingerprint matching rate of the first and second fingerprint images: If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image reaches the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered successful. If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image does not reach the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered unsuccessful.

27. The control device for the dual fingerprint verification device according to claim 20, characterized in that, The similarity comparison results of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. The control unit determines whether the dual verification of the first fingerprint image and the second fingerprint image is successful based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, including: The overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, as well as the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, are determined as the dual matching fingerprint regions in the first fingerprint image and the second fingerprint image. The sum of the double-matching fingerprint regions in the first fingerprint image and the second fingerprint image, and the non-matching fingerprint regions in the first fingerprint image and the second fingerprint image, is determined as the complete fingerprint region in the first fingerprint image and the second fingerprint image. The ratio of the double-matched fingerprint regions in the first and second fingerprint images to the complete fingerprint regions in the first and second fingerprint images is determined as the complete fingerprint matching rate of the first and second fingerprint images: If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image reaches the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered successful. If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image does not reach the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered unsuccessful.

28. The control device for the dual fingerprint verification device according to claim 21, characterized in that, The similarity comparison results of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. The control unit determines whether the dual verification of the first fingerprint image and the second fingerprint image is successful based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, including: The overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, as well as the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, are determined as the dual matching fingerprint regions in the first fingerprint image and the second fingerprint image. The sum of the double-matching fingerprint regions in the first fingerprint image and the second fingerprint image, and the non-matching fingerprint regions in the first fingerprint image and the second fingerprint image, is determined as the complete fingerprint region in the first fingerprint image and the second fingerprint image. The ratio of the double-matched fingerprint regions in the first and second fingerprint images to the complete fingerprint regions in the first and second fingerprint images is determined as the complete fingerprint matching rate of the first and second fingerprint images: If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image reaches the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered successful. If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image does not reach the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered unsuccessful.

29. The control device for the dual fingerprint verification device according to claim 23, characterized in that, The similarity comparison results of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image include: matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, and non-matching fingerprint regions of non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image. The control unit determines whether the dual verification of the first fingerprint image and the second fingerprint image is successful based on the similarity comparison results of overlapping fingerprint regions and non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, including: The overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, as well as the matching fingerprint regions of the non-overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, are determined as the dual matching fingerprint regions in the first fingerprint image and the second fingerprint image. The sum of the double-matching fingerprint regions in the first fingerprint image and the second fingerprint image, and the non-matching fingerprint regions in the first fingerprint image and the second fingerprint image, is determined as the complete fingerprint region in the first fingerprint image and the second fingerprint image. The ratio of the double-matched fingerprint regions in the first and second fingerprint images to the complete fingerprint regions in the first and second fingerprint images is determined as the complete fingerprint matching rate of the first and second fingerprint images: If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image reaches the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered successful. If the complete fingerprint matching rate of the first fingerprint image and the second fingerprint image does not reach the set fingerprint matching rate, then the dual verification of the first fingerprint image and the second fingerprint image is considered unsuccessful.

30. The control device for the dual fingerprint verification device according to any one of claims 18, 19, 22, 24, 25, 27 to 29, characterized in that, Also includes: The control unit is further configured to, upon successful dual verification of the first fingerprint image and the second fingerprint image, perform self-learning on the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, so as to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprint of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the update of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

31. The control device for the dual fingerprint verification device according to claim 20, characterized in that, Also includes: The control unit is further configured to, upon successful dual verification of the first fingerprint image and the second fingerprint image, perform self-learning on the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, so as to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprint of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the update of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

32. The control device for the dual fingerprint verification device according to claim 21, characterized in that, Also includes: The control unit is further configured to, upon successful dual verification of the first fingerprint image and the second fingerprint image, perform self-learning on the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, so as to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprint of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the update of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

33. The control device for the dual fingerprint verification device according to claim 23, characterized in that, Also includes: The control unit is further configured to, upon successful dual verification of the first fingerprint image and the second fingerprint image, perform self-learning on the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, so as to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprint of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the update of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

34. The control device for the dual fingerprint verification device according to claim 26, characterized in that, Also includes: The control unit is further configured to, upon successful dual verification of the first fingerprint image and the second fingerprint image, perform self-learning on the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image, so as to supplement the fingerprint images of the overlapping fingerprint regions in the first fingerprint image and the second fingerprint image into the fingerprint images of the human finger in the pre-recorded fingerprint image library, improve the fingerprint details of the fingerprint images of the human finger in the pre-recorded fingerprint image library, restore the real fingerprint of the fingerprint images of the human finger in the pre-recorded fingerprint image library, and realize the update of the fingerprint images of the human finger in the pre-recorded fingerprint image library.

35. A dual fingerprint verification device, characterized in that, include: The control device for the dual fingerprint verification device as described in any one of claims 18 to 34.

36. A storage medium, characterized in that, The storage medium includes a stored program, wherein, when the program is executed, it controls the device containing the storage medium to perform the control method of the dual fingerprint verification device according to any one of claims 1 to 17.

Images