Intelligent lock unlocking method, system and equipment based on fingerprints and finger veins and medium

Abstract

The invention relates to the technical field of intelligent lock application, and discloses an intelligent lock unlocking method, system and device based on fingerprints and finger veins and a medium, the method comprises the following steps: in response to a finger pressing operation of a target user on an intelligent lock, collecting a fingerprint image and a finger vein image of the target user; the fingerprint image and the finger vein image are recognized based on a preset feature library, a fingerprint recognition result and a finger vein recognition result are correspondingly obtained, and at least one standard fingerprint feature and one standard finger vein feature which are correspondingly collected when a legal user of the intelligent lock carries out identity registration are stored in the preset feature library; determining a control instruction and to-be-stored information based on the fingerprint recognition result and the finger vein recognition result; and performing opening and closing control on the intelligent lock based on the control instruction, and updating the preset feature library based on the to-be-stored information. According to the unlocking method, the unlocking requirement when the fingerprint or the finger vein of the legal user changes is considered, the unlocking efficiency of the intelligent lock can be improved, and then the unlocking experience of the user is improved.

Description

Technical Field

[0001] The present invention relates to the field of smart lock application technology, and in particular to a fingerprint and finger vein-based smart lock unlocking method, system, device and medium. Background Art

[0002] In recent years, as people's requirements for the security of smart lock identity authentication have become increasingly stringent, the demand for identity authentication technology has become more and more urgent. As the most secure and convenient identity recognition method, biometric recognition technology has received great attention and has been greatly developed under this attention.

[0003] Among existing biometric technologies, fingerprint recognition technology has been widely used in daily life. In the field of smart locks, the utilization rate of fingerprint recognition technology has exceeded 95%. In addition, finger vein recognition technology is becoming more and more popular in smart locks due to its contact characteristics.

[0004] However, in actual applications, fingerprint recognition technology often encounters changes in fingerprint patterns, such as scratches on the fingers, skin expansion and contraction due to sudden changes in weather temperature, and skin wear and tear due to long-term labor, which lead to the failure of fingerprint recognition; finger vein recognition technology also often encounters changes in the collected vein images, such as changes in the collected vein area, changes in the vein network due to strong pressure of the finger, which also lead to the failure of finger vein recognition.

[0005] Currently, for multiple biometric unlocking scenarios, the existing technology often uses the unlocking process of opening the door only when each biometric technology is passed. However, due to the possibility of contamination of the fingerprint or finger vein of the legitimate user, if the legitimate user's finger or finger skin is worn and cannot be restored, the fingerprint or finger vein corresponding to the user will change, which can easily lead to the failure of a single biometric recognition and the failure of the overall unlocking, seriously affecting the user's unlocking experience. Summary of the invention

[0006] In view of this, the present invention provides a smart lock unlocking method, system, device and medium based on fingerprint and finger vein to solve the existing unlocking needs of ignoring changes in the user's fingerprint or finger vein, which reduces the efficiency of legitimate user identity recognition, and thus seriously affects the unlocking efficiency of the smart lock, making it difficult to meet the use requirements of the smart lock.

[0007] In a first aspect, the present invention provides a method for unlocking a smart lock using fingerprints and finger veins, the method comprising:

[0008] In response to the target user's finger pressing operation on the smart lock, collecting the target user's fingerprint image and finger vein image;

[0009] The fingerprint image and the finger vein image are respectively identified based on the preset feature library, and the fingerprint recognition result and the finger vein recognition result are obtained accordingly, wherein the preset feature library stores at least one standard fingerprint feature and a standard finger vein feature correspondingly collected by the legitimate user of the smart lock when performing identity registration;

[0010] Determine the control instructions and information to be stored based on the fingerprint recognition results and the finger vein recognition results;

[0011] The smart lock is opened and closed based on the control instructions, and the preset feature library is updated based on the information to be stored.

[0012] The present invention takes into account the unlocking needs of legal users when their fingerprints or finger veins change. While controlling the normal unlocking of the smart lock according to the fingerprint recognition results and the finger vein recognition results, it also stores the changed fingerprints or finger veins, which helps to enrich the feature information of legal users, and further enhance the feature matching of legal users under different unlocking conditions. This can significantly improve the unlocking efficiency of the smart lock, greatly meet the use needs of the smart lock, and enhance the user's unlocking experience.

[0013] In an optional implementation, the fingerprint image and the finger vein image are respectively identified based on a preset feature library, and the fingerprint identification result and the finger vein identification result are obtained accordingly, including:

[0014] Determine whether the fingerprint image matches each standard fingerprint feature, and obtain the matching result between the fingerprint image and the standard fingerprint feature, and determine whether the finger vein image matches each standard finger vein feature, and obtain the matching result between the finger vein image and the standard finger vein feature;

[0015] When the fingerprint image matches the standard fingerprint feature, the fingerprint recognition result is determined to be passed; when the fingerprint image does not match the standard fingerprint feature, the fingerprint recognition result is determined to be failed;

[0016] When the finger vein image matches the standard finger vein feature, it is determined that the finger vein recognition result passes; when the finger vein image does not match the standard finger vein feature, it is determined that the finger vein recognition result fails.

[0017] The present invention determines the fingerprint recognition result by matching the fingerprint image with the standard fingerprint feature, and determines the finger vein recognition result by matching the finger vein image with the standard finger vein feature, which can ensure the accuracy of the target user's identity authentication and help improve the unlocking efficiency of the smart lock.

[0018] In an optional implementation, determining whether the fingerprint image matches each standard fingerprint feature, and correspondingly obtaining a matching result between the fingerprint image and the standard fingerprint feature, and determining whether the finger vein image matches each standard finger vein feature, and correspondingly obtaining a matching result between the finger vein image and the standard finger vein feature, include:

[0019] Extract features from the fingerprint image and the finger vein image respectively, and obtain fingerprint features to be matched and finger vein features to be matched accordingly;

[0020] Calculate the similarity between the fingerprint feature to be matched and each standard fingerprint feature, and select the first similarity with the largest similarity value from multiple similarities;

[0021] Calculate the similarity between the finger vein feature to be matched and each standard finger vein feature, and select the second similarity with the largest similarity value from multiple similarities;

[0022] Determine the matching result between the fingerprint image and the standard fingerprint feature based on the magnitude relationship between the first similarity and the first preset threshold; wherein, if the first similarity is greater than the first preset threshold, the fingerprint image matches the standard fingerprint feature; if the first similarity is not greater than the first preset threshold, the fingerprint image does not match the standard fingerprint feature;

[0023] The matching result between the finger vein image and the standard finger vein feature is determined based on the size relationship between the second similarity and the second preset threshold; wherein, if the second similarity is greater than the second preset threshold, the finger vein image matches the standard finger vein feature; if the second similarity is not greater than the second preset threshold, the finger vein image does not match the standard finger vein feature.

[0024] The present invention calculates and screens the maximum similarity between the fingerprint feature to be matched and the standard fingerprint feature, as well as the maximum similarity between the finger vein feature to be matched and the standard finger vein feature, and determines the corresponding matching results according to their size relationship with the corresponding preset thresholds, which can greatly ensure the accuracy of the matching results.

[0025] In an optional implementation, determining the control instruction and the information to be stored based on the fingerprint recognition result and the finger vein recognition result includes:

[0026] If the fingerprint recognition result is passed and the finger vein recognition result is passed, an unlock control instruction is generated and the information to be stored is determined to be empty;

[0027] If the fingerprint recognition result passes and the finger vein recognition result fails, an unlock control instruction is generated, and the finger vein feature to be matched is determined as information to be stored;

[0028] If the fingerprint recognition result fails and the finger vein recognition result passes, an unlock control instruction is generated, and the fingerprint feature to be matched is determined as information to be stored;

[0029] If the fingerprint recognition result fails and the finger vein recognition result fails, a locking control instruction is generated and the information to be stored is determined to be empty.

[0030] The present invention is designed to assume that the identity of the target user is legitimate when any fingerprint or finger vein recognition result passes, and stores the other recognition result that does not pass the corresponding finger vein feature or fingerprint feature, which helps to enrich the feature information of the legitimate user, takes into account the unlocking needs of the legitimate user when the fingerprint or finger vein changes, enhances the feature matching of the legitimate user under different unlocking conditions, and further improves the unlocking efficiency of the smart lock.

[0031] In an optional implementation, the smart lock is opened and closed based on the control instruction, including:

[0032] If the control command is an unlocking control command, the smart lock is controlled to perform an unlocking operation;

[0033] If the control instruction is a locking control instruction, the smart lock will be controlled to remain in the locked state.

[0034] The present invention can realize flexible and efficient opening and closing control of the smart lock by designing the unlocking control instructions and the locking control instructions, which helps to meet the use requirements of the smart lock.

[0035] In an optional implementation, updating the preset feature library based on the information to be stored includes:

[0036] Check whether the information to be stored is empty;

[0037] If the information to be stored is not empty, the information to be stored is saved in the standard fingerprint feature or standard finger vein feature of the target user in the preset feature library.

[0038] When the present invention detects that the information to be stored is not empty, the corresponding information to be stored is saved, which can take into account the unlocking scenarios in which the fingerprint or finger vein of the legitimate user changes in actual applications, and helps to enrich the feature information of the legitimate user, thereby enhancing the feature matching of the legitimate user under different unlocking conditions.

[0039] In an optional implementation, collecting a fingerprint image and a finger vein image of a target user includes:

[0040] The fingerprint image and finger vein map of the target user are collected by a preset finger information collection device installed on the smart lock, wherein the preset finger information collection device integrates a fingerprint collector and a finger vein collector.

[0041] The present invention collects the fingerprint image and finger vein image of the target user through an integrated finger information collection device integrating a fingerprint collector and a finger vein collector, which can significantly improve the data collection efficiency, greatly speed up the user's unlocking process, and thus improve the user's unlocking experience.

[0042] In a second aspect, the present invention provides a fingerprint and finger vein smart lock unlocking system, the system comprising:

[0043] A collection module, used for collecting a fingerprint image and a finger vein image of a target user in response to a finger pressing operation of the target user on the smart lock;

[0044] An identification module is used to identify the fingerprint image and the finger vein image respectively based on a preset feature library, and obtain fingerprint identification results and finger vein identification results accordingly, wherein the preset feature library stores at least one standard fingerprint feature and a standard finger vein feature correspondingly collected by a legitimate user of the smart lock when performing identity registration;

[0045] A determination module, used to determine the control instruction and information to be stored based on the fingerprint recognition result and the finger vein recognition result;

[0046] The control module is used to control the opening and closing of the smart lock based on the control instructions, and to update the preset feature library based on the information to be stored.

[0047] The fingerprint and finger vein smart lock unlocking system of the present invention can take into account the unlocking needs of changed fingerprints or finger veins of legitimate users, control the smart lock to perform unlocking operations according to the fingerprint recognition results and finger vein recognition results, and store the changed fingerprints or finger veins at the same time, which helps to enrich the feature information of legitimate users. It not only enhances the feature matching of legitimate users under different unlocking conditions and improves the unlocking efficiency of smart locks, but also greatly meets the use needs of smart locks and enhances the user's unlocking experience.

[0048] In a third aspect, the present invention provides a computer device comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing computer instructions, and the processor executing the computer instructions to execute a fingerprint and finger vein smart lock unlocking method according to the first aspect or any corresponding embodiment thereof.

[0049] In a fourth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute a fingerprint and finger vein smart lock unlocking method according to the first aspect or any corresponding embodiment thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0051] Figure 1 It is a flowchart of a method for unlocking a smart lock using fingerprints and finger veins according to an embodiment of the present invention;

[0052] Figure 2 is a flow chart of another fingerprint and finger vein smart lock unlocking method according to an embodiment of the present invention;

[0053] Figure 3 It is a structural schematic diagram of an integrated finger information collection device;

[0054] Figure 4 This is a schematic diagram of unlocking a smart lock;

[0055] Figure 5 is a structural block diagram of a fingerprint and finger vein smart lock unlocking system according to an embodiment of the present invention;

[0056] Figure 6 It is a schematic diagram of the structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0057] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0058] An embodiment of the present invention provides an embodiment of a method for unlocking a smart lock using fingerprints and finger veins. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0059] In this embodiment, a fingerprint and finger vein smart lock unlocking method is provided. Figure 1 FIG. 1 is a flow chart of a method for unlocking a smart lock using fingerprints and finger veins according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:

[0060] Step S101, in response to the target user's finger pressing operation on the smart lock, the fingerprint image and finger vein image of the target user are collected.

[0061] It should be noted that the specific acquisition method of the fingerprint image and the finger vein image in this embodiment is not limited here, and can be adaptively adjusted based on actual needs. For example, acquiring the fingerprint image through a press-type fingerprint sensor is only an exemplary description.

[0062] Step S102, the fingerprint image and the finger vein image are respectively identified based on the preset feature library, and corresponding fingerprint recognition results and finger vein recognition results are obtained, wherein the preset feature library stores at least one standard fingerprint feature and a standard finger vein feature correspondingly collected when the legitimate user of the smart lock registers his identity.

[0063] It should be noted that the standard fingerprint feature and the standard finger vein feature in this embodiment are used to characterize the feature information collected when the same legitimate user of the smart lock is registered. Specifically, during the identity registration process of the legitimate user, the fingerprint information and finger vein information of the user are collected at the same time, and the collected fingerprint information and finger vein information are converted into corresponding feature point information to obtain fingerprint feature point information and finger vein feature point information, which are then bound to a registration ID and saved in different areas of the smart lock storage unit to build a preset feature library of the smart lock.

[0064] Step S103, determining the control instruction and the information to be stored based on the fingerprint recognition result and the finger vein recognition result.

[0065] It should be noted that the control instructions of this embodiment are intended to control the unlocking or locking of the smart lock; the information to be stored is used to characterize the changed feature information, including fingerprint or finger vein features.

[0066] Step S104, controlling the opening and closing of the smart lock based on the control instruction, and updating the preset feature library based on the information to be stored.

[0067] The fingerprint and finger vein smart lock unlocking method of the embodiment of the present invention takes into account the unlocking needs of the changed fingerprints or finger veins of the legitimate user, and controls the normal unlocking of the smart lock according to the fingerprint recognition results and the finger vein recognition results, while also storing the changed fingerprints or finger veins, which helps to enrich the feature information of the legitimate user, and then enhance the feature matching of the legitimate user under different unlocking conditions, which can significantly improve the unlocking efficiency of the smart lock, greatly meet the use requirements of the smart lock, and enhance the user's unlocking experience.

[0068] In this embodiment, a fingerprint and finger vein smart lock unlocking method is provided. Figure 2FIG. 1 is a flow chart of another fingerprint and finger vein smart lock unlocking method according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:

[0069] Step S201, in response to the target user's finger pressing operation on the smart lock, the fingerprint image and finger vein image of the target user are collected.

[0070] In this embodiment, the fingerprint image and finger vein image of the target user are collected by a preset finger information collection device installed on the smart lock, wherein the preset finger information collection device integrates a fingerprint collector and a finger vein collector. It should be noted that the preset finger information collection device in this embodiment is an integrated fingerprint image and finger vein image collection device, that is, a finger fingerprint integrated collection device. Figure 3 It is a structural diagram of an integrated finger information collection device. Figure 3 It can be seen that the finger information collection device includes two collectors, the upper and lower parts, that is, the upper part has a finger fingerprint collector, such as Figure 3 Position 1 in the middle; the lower part has a finger vein collector, such as Figure 3 Position 2 in the figure. Specifically, when any fingerprint or finger vein recognition result passes, the target user's identity is assumed to be legitimate by design, and the other recognition result does not pass the corresponding finger vein feature or fingerprint feature, which helps to enrich the feature information of the legitimate user, takes into account the unlocking needs of the legitimate user's fingerprint or finger vein that changes, enhances the feature matching of the legitimate user under different unlocking conditions, and further improves the unlocking efficiency of the smart lock.

[0071] Step S202, the fingerprint image and the finger vein image are respectively identified based on the preset feature library, and corresponding fingerprint recognition results and finger vein recognition results are obtained, wherein the preset feature library stores at least one standard fingerprint feature and a standard finger vein feature correspondingly collected when the legitimate user of the smart lock registers his identity.

[0072] Specifically, in the above step S202, the fingerprint image and the finger vein image are respectively identified based on the preset feature library, and the fingerprint identification result and the finger vein identification result are obtained accordingly, including:

[0073] Step S2021, determining whether the fingerprint image matches each standard fingerprint feature, and obtaining the corresponding matching result between the fingerprint image and the standard fingerprint feature, and determining whether the finger vein image matches each standard finger vein feature, and obtaining the corresponding matching result between the finger vein image and the standard finger vein feature.

[0074] In this embodiment, the above step S2021 includes:

[0075] Step A1, extracting features from the fingerprint image and the finger vein image respectively, and obtaining fingerprint features to be matched and finger vein features to be matched accordingly.

[0076] In this embodiment, the specific method of feature extraction and the specific feature type extracted are not limited here, and are adaptively determined according to conventional feature extraction methods in the art.

[0077] Step A2: Calculate the similarity between the fingerprint feature to be matched and each standard fingerprint feature, and select a first similarity with the largest similarity value from multiple similarities.

[0078] In this embodiment, the specific calculation method of the similarity between different fingerprint features is not limited here, and can be adaptively adjusted according to actual needs. For example, the similarity of two fingerprint features is calculated using the correlation coefficient method or the angle cosine method, which is only used as an exemplary description.

[0079] Step A3, calculating the similarity between the finger vein feature to be matched and each standard finger vein feature, and selecting a second similarity with the largest similarity value from multiple similarities.

[0080] In this embodiment, the specific calculation method of the similarity between different finger vein features is referred to above and will not be repeated here.

[0081] Step A4, determining the matching result between the fingerprint image and the standard fingerprint feature based on the relationship between the first similarity and the first preset threshold; wherein, if the first similarity is greater than the first preset threshold, the fingerprint image matches the standard fingerprint feature; if the first similarity is not greater than the first preset threshold, the fingerprint image does not match the standard fingerprint feature.

[0082] Step A5, determining the matching result between the finger vein image and the standard finger vein feature based on the relationship between the second similarity and the second preset threshold; wherein, if the second similarity is greater than the second preset threshold, the finger vein image matches the standard finger vein feature; if the second similarity is not greater than the second preset threshold, the finger vein image does not match the standard finger vein feature.

[0083] In the embodiment of the present invention, the maximum similarity between the fingerprint feature to be matched and the standard fingerprint feature and the maximum similarity between the finger vein feature to be matched and the standard finger vein feature are calculated and screened respectively, and the corresponding matching results are determined respectively according to their size relationship with the corresponding preset threshold value, which can greatly ensure the accuracy of the matching result.

[0084] Step S2022: when the fingerprint image matches the standard fingerprint feature, the fingerprint recognition result is determined to be passed; when the fingerprint image does not match the standard fingerprint feature, the fingerprint recognition result is determined to be failed.

[0085] Step S2023, when the finger vein image matches the standard finger vein feature, it is determined that the finger vein recognition result passes; when the finger vein image does not match the standard finger vein feature, it is determined that the finger vein recognition result fails.

[0086] In the embodiment of the present invention, the fingerprint recognition result is determined by matching the fingerprint image with the standard fingerprint feature, and the finger vein recognition result is determined by matching the finger vein image with the standard finger vein feature, which can ensure the accuracy of the target user's identity authentication and help improve the unlocking efficiency of the smart lock.

[0087] Step S203, determining the control instruction and the information to be stored based on the fingerprint recognition result and the finger vein recognition result.

[0088] Specifically, the above step S203 includes:

[0089] Step S2031, if the fingerprint recognition result is passed and the finger vein recognition result is passed, an unlocking control instruction is generated, and the information to be stored is determined to be empty.

[0090] In this embodiment, when the identification results of fingerprint recognition and finger vein recognition are both passed, it means that the fingerprint features and finger vein features to be matched currently collected by the target user are the same as the verification data saved when the user performs legal identity registration, and there is no feature contamination in the current collected data, that is, the fingerprint or finger vein has not changed.

[0091] Step S2032: If the fingerprint recognition result passes and the finger vein recognition result fails, an unlock control instruction is generated, and the finger vein feature to be matched is determined as information to be stored.

[0092] In this embodiment, when the fingerprint recognition result passes but the finger vein recognition result fails, it indicates that the identity authentication of the target user passes, that is, the fingerprint feature to be matched currently collected by the target user is the same as the standard fingerprint feature saved when the user registers for a legal identity; however, the finger vein feature to be matched may be due to changes in the environment, usage techniques, or changes in the position of finger pressure, resulting in the collected finger vein information not matching the registered and saved standard finger vein information. Saving this information in the registered information can improve the unlocking success rate.

[0093] Step S2033: if the fingerprint recognition result fails and the finger vein recognition result passes, an unlock control instruction is generated, and the fingerprint feature to be matched is determined as information to be stored.

[0094] In this embodiment, the relevant content in step S2033 refers to the above step S2032 and will not be repeated here.

[0095] Step S2034: If the fingerprint recognition result fails and the finger vein recognition result fails, a locking control instruction is generated and the information to be stored is determined to be empty.

[0096] In this embodiment, when the recognition results of fingerprint recognition and finger vein recognition both fail, it means that the fingerprint features and finger vein features to be matched currently collected by the target user are different from the verification data saved when the user registers his legal identity, and the target user is an illegal user of the smart lock, that is, the target user does not have the authority to unlock the door.

[0097] In the embodiment of the present invention, when any fingerprint or finger vein recognition result passes, the identity of the target user is assumed to be legal, and the other recognition result that does not pass the corresponding finger vein feature or fingerprint feature is stored, which helps to enrich the feature information of the legal user, takes into account the unlocking needs of the legal user when the fingerprint or finger vein changes, enhances the feature matching of the legal user under different unlocking conditions, and further improves the unlocking efficiency of the smart lock.

[0098] Step S204, controlling the opening and closing of the smart lock based on the control instruction, and updating the preset feature library based on the information to be stored.

[0099] In this embodiment, the above step S204 controls the opening and closing of the smart lock based on the control instruction, including:

[0100] Step B1, if the control instruction is an unlocking control instruction, control the smart lock to perform an unlocking operation.

[0101] Step B2: If the control instruction is a locking control instruction, the smart lock is controlled to remain in a locked state.

[0102] In the embodiment of the present invention, by designing unlocking control instructions and locking control instructions, flexible and efficient opening and closing control of the smart lock can be achieved, which helps to meet the use requirements of the smart lock.

[0103] In this embodiment, in the above step S204, updating the preset feature library based on the information to be stored includes:

[0104] Step C1, detecting whether the information to be stored is empty.

[0105] In this embodiment, the specific method of detecting whether the information to be stored is empty can be adaptively adjusted according to actual needs.

[0106] Step C2: if the information to be stored is not empty, the information to be stored is saved in the standard fingerprint feature or standard finger vein feature of the target user in the preset feature library.

[0107] When the embodiment of the present invention detects that the information to be stored is not empty, the corresponding information to be stored is saved, which can take into account the unlocking scenarios in which the fingerprint or finger vein of the legitimate user changes in actual applications, help enrich the feature information of the legitimate user, and further enhance the feature matching of the legitimate user under different unlocking conditions.

[0108] In a specific embodiment, Figure 3 The integrated finger information collection device is integrated into the smart door lock to collect fingerprint and finger vein information at the same time, and then the smart lock is unlocked based on the collected fingerprint and finger vein information. Figure 4 This is a schematic diagram of unlocking a smart lock. Figure 4 It can be seen that the unlocking process includes:

[0109] When the finger information collection device detects a finger pressing, it collects fingerprint information and finger vein information of the unlocking user's finger at the same time, and converts the collected fingerprint information and finger vein information into feature information, obtains fingerprint feature information and finger vein feature information, and compares them with the fingerprint feature information and finger vein feature information in the saved ID one by one. The comparison process specifically includes the following situations:

[0110] In case ①, first compare the fingerprint feature information. If the fingerprint feature information is matched successfully, unlock the device first to ensure unlocking efficiency. Then compare the finger vein feature information. If the finger vein feature information is also matched successfully, there is no need to update the fingerprint feature information and finger vein feature information in the saved ID, and exit (i.e. end the unlocking process for the current user).

[0111] In case ②, first compare the fingerprint feature information. If the fingerprint feature information fails to match, then compare the finger vein feature information. If the finger vein feature information passes the match, unlock first to ensure unlocking efficiency, then save the fingerprint feature information that fails to match to the fingerprint feature information storage area of ​​the registered ID and exit.

[0112] In case ③, first compare the fingerprint feature information. If the fingerprint feature information comparison passes, unlock first to ensure unlocking efficiency; then compare the finger vein feature information. If the finger vein feature information comparison fails, save the finger vein feature information that fails the comparison to the finger vein feature information storage area of ​​the registered ID and exit.

[0113] Case ④: Both fingerprint and finger vein feature information comparison fail, and the system exits directly.

[0114] It should be noted that in this embodiment, there is no requirement for the comparison order of fingerprint feature information and finger vein feature information, and the comparison order of different feature information can be adaptively adjusted according to actual needs.

[0115] In summary, the embodiment of the present invention binds the fingerprint information and finger vein information collected by the legal user when registering the identity on the smart lock into an ID, and in the actual unlocking process of the smart lock, if the fingerprint information of the finger changes due to certain factors, as long as the finger vein information is successfully matched, the changed fingerprint information is added to the registered finger ID; similarly, if the finger vein information changes due to certain factors, as long as the fingerprint information is successfully matched, the changed finger vein information can be added to the registered finger ID. Specifically, after the fingerprint or finger vein feature information is successfully matched, the finger change information, that is, the changed finger vein feature information or fingerprint feature information is automatically added to the registered ID, which can significantly improve the unlocking efficiency of the smart lock while ensuring the security of unlocking, thereby improving the user experience.

[0116] In this embodiment, a fingerprint and finger vein smart lock unlocking system is also provided, which is used to implement the above embodiments and preferred embodiments, and will not be repeated here. As used below, the term "module" refers to a combination of software and / or hardware that can implement a predetermined function. Although the system described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0117] The present invention provides a fingerprint and finger vein intelligent lock unlocking system, such as Figure 5 As shown, the system includes:

[0118] The acquisition module 501 is used to acquire the fingerprint image and finger vein image of the target user in response to the target user's finger pressing operation on the smart lock.

[0119] The identification module 502 is used to identify the fingerprint image and the finger vein image respectively based on the preset feature library, and obtain the fingerprint identification result and the finger vein identification result accordingly, wherein the preset feature library stores at least one standard fingerprint feature and a standard finger vein feature correspondingly collected when the legitimate user of the smart lock registers his identity.

[0120] The determination module 503 is used to determine the control instruction and the information to be stored based on the fingerprint recognition result and the finger vein recognition result.

[0121] The control module 504 is used to control the opening and closing of the smart lock based on the control instructions, and to update the preset feature library based on the information to be stored.

[0122] In some optional embodiments, the collection module 501 includes: a collection submodule, which is used to collect the fingerprint image and finger vein map of the target user through a preset finger information collection device installed on the smart lock, wherein the preset finger information collection device integrates a fingerprint collector and a finger vein collector.

[0123] In some optional embodiments, the identification module 502 includes: a first identification submodule, a second identification submodule and a third identification submodule; wherein the first identification submodule is used to determine whether the fingerprint image matches each standard fingerprint feature, and obtain the corresponding matching result between the fingerprint image and the standard fingerprint feature, and to determine whether the finger vein image matches each standard finger vein feature, and obtain the corresponding matching result between the finger vein image and the standard finger vein feature; the second identification submodule is used to determine that the fingerprint identification result passes when the fingerprint image matches the standard fingerprint feature; and determine that the fingerprint identification result fails when the fingerprint image does not match the standard fingerprint feature; the third identification submodule is used to determine that the finger vein identification result passes when the finger vein image matches the standard finger vein feature; and determine that the finger vein identification result fails when the finger vein image does not match the standard finger vein feature.

[0124] In some optional embodiments, the first recognition submodule includes: a first recognition unit, a second recognition unit, a third recognition unit, a fourth recognition unit and a fifth recognition unit; wherein the first recognition unit is used to extract features of the fingerprint image and the finger vein image respectively, and obtain the fingerprint feature to be matched and the finger vein feature to be matched correspondingly; the second recognition unit is used to calculate the similarity between the fingerprint feature to be matched and each standard fingerprint feature, and select the first similarity with the largest similarity value from multiple similarities; the third recognition unit is used to calculate the similarity between the finger vein feature to be matched and each standard finger vein feature, and select the second similarity with the largest similarity value from multiple similarities; the fourth recognition unit is used to calculate the similarity between the finger vein feature to be matched and each standard finger vein feature, and select the second similarity with the largest similarity value from multiple similarities; A distinguishing unit is used to determine the matching result between the fingerprint image and the standard fingerprint feature based on the size relationship between the first similarity and the first preset threshold; wherein, if the first similarity is greater than the first preset threshold, the fingerprint image matches the standard fingerprint feature; if the first similarity is not greater than the first preset threshold, the fingerprint image does not match the standard fingerprint feature; a fifth identifying unit is used to determine the matching result between the finger vein image and the standard finger vein feature based on the size relationship between the second similarity and the second preset threshold; wherein, if the second similarity is greater than the second preset threshold, the finger vein image matches the standard finger vein feature; if the second similarity is not greater than the second preset threshold, the finger vein image does not match the standard finger vein feature.

[0125] In some optional embodiments, the determination module 503 includes: a first determination submodule, a second determination submodule, a third determination submodule and a fourth determination submodule; wherein the first determination submodule is used to generate an unlock control instruction if the fingerprint recognition result passes and the finger vein recognition result passes, and determine the information to be stored as empty; the second determination submodule is used to generate an unlock control instruction if the fingerprint recognition result passes and the finger vein recognition result fails, and determine the finger vein feature to be matched as the information to be stored; the third determination submodule is used to generate an unlock control instruction if the fingerprint recognition result fails and the finger vein recognition result passes, and determine the fingerprint feature to be matched as the information to be stored; the fourth determination submodule is used to generate a locking control instruction if the fingerprint recognition result fails and the finger vein recognition result fails, and determine the information to be stored as empty.

[0126] In some optional embodiments, the control module 504 includes: a first control submodule, a second control submodule, a third control submodule and a fourth control submodule; wherein the first control submodule is used to control the smart lock to perform an unlocking operation if the control instruction is an unlocking control instruction; the second control submodule is used to control the smart lock to remain in a locked state if the control instruction is a locking control instruction; the third control submodule is used to detect whether the information to be stored is empty; the fourth control submodule is used to save the information to be stored in the standard fingerprint feature or standard finger vein feature of the target user in the preset feature library if the information to be stored is not empty.

[0127] The further functional description of each of the above modules is the same as that of the above corresponding embodiments and will not be repeated here.

[0128] The fingerprint and finger vein smart lock unlocking system in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0129] The fingerprint and finger vein smart lock unlocking system of the embodiment of the present invention takes into account the unlocking scenario where the fingerprint or finger vein of the legitimate user changes, and realizes the opening and closing control of the smart lock through the fingerprint recognition result and finger vein recognition result of the target user. When any recognition result is passed, the changed fingerprint or finger vein is stored, which helps to enrich the feature information of the legitimate user, and can enhance the feature matching of the legitimate user under different unlocking conditions, improve the unlocking efficiency of the smart lock, greatly meet the use requirements of the smart lock, and enhance the user's unlocking experience. A computer device is also provided in the embodiment of the present invention, please refer to Figure 6 , Figure 6is a schematic diagram of the structure of the above-mentioned computer device provided in an optional embodiment of the present invention, such as Figure 6 As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 6 A processor 10 is taken as an example.

[0130] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0131] The memory 20 stores instructions executable by at least one processor 10, so that at least one processor 10 executes the method shown in the above embodiment.

[0132] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0133] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0134] The computer device also includes a communication interface 30, which is used for the main control chip to communicate with other devices or a communication network.

[0135] A computer-readable storage medium is also provided in an embodiment of the present invention. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium and downloaded through a network, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor main control chip or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor or hardware, the method shown in the above embodiment is implemented.

[0136] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A fingerprint and finger vein smart lock unlocking method, characterized in that: The method comprises: In response to a target user's finger pressing operation on the smart lock, collecting a fingerprint image and a finger vein image of the target user; The fingerprint image and the finger vein image are respectively identified based on a preset feature library, and a fingerprint recognition result and a finger vein recognition result are obtained correspondingly, wherein the preset feature library stores at least one standard fingerprint feature and a standard finger vein feature correspondingly collected by a legitimate user of the smart lock when performing identity registration; Determining control instructions and information to be stored based on the fingerprint recognition result and the finger vein recognition result; The smart lock is opened and closed controlled based on the control instruction, and the preset feature library is updated based on the information to be stored.

2. The fingerprint and finger vein smart lock unlocking method according to claim 1 is characterized in that: The fingerprint image and the finger vein image are respectively identified based on a preset feature library, and a fingerprint identification result and a finger vein identification result are obtained accordingly, including: Determining whether the fingerprint image matches each standard fingerprint feature, and correspondingly obtaining a matching result between the fingerprint image and the standard fingerprint feature, and determining whether the finger vein image matches each standard finger vein feature, and correspondingly obtaining a matching result between the finger vein image and the standard finger vein feature; When the fingerprint image matches the standard fingerprint feature, it is determined that the fingerprint recognition result passes; when the fingerprint image does not match the standard fingerprint feature, it is determined that the fingerprint recognition result fails; When the finger vein image matches the standard finger vein feature, it is determined that the finger vein recognition result passes; when the finger vein image does not match the standard finger vein feature, it is determined that the finger vein recognition result fails.

3. The fingerprint and finger vein smart lock unlocking method according to claim 2 is characterized in that: The determining whether the fingerprint image matches each standard fingerprint feature, and correspondingly obtaining a matching result between the fingerprint image and the standard fingerprint feature, and determining whether the finger vein image matches each standard finger vein feature, and correspondingly obtaining a matching result between the finger vein image and the standard finger vein feature, include: Extracting features from the fingerprint image and the finger vein image respectively, and obtaining fingerprint features to be matched and finger vein features to be matched accordingly; Calculating the similarity between the fingerprint feature to be matched and each standard fingerprint feature, and selecting a first similarity with the largest similarity value from multiple similarities; Calculating the similarity between the finger vein feature to be matched and each standard finger vein feature, and selecting a second similarity with the largest similarity value from the multiple similarities; Determining a matching result between the fingerprint image and the standard fingerprint feature based on a magnitude relationship between the first similarity and a first preset threshold; wherein, if the first similarity is greater than the first preset threshold, the fingerprint image matches the standard fingerprint feature; if the first similarity is not greater than the first preset threshold, the fingerprint image does not match the standard fingerprint feature; The matching result between the finger vein image and the standard finger vein feature is determined based on the size relationship between the second similarity and the second preset threshold; wherein, if the second similarity is greater than the second preset threshold, the finger vein image matches the standard finger vein feature; if the second similarity is not greater than the second preset threshold, the finger vein image does not match the standard finger vein feature.

4. The fingerprint and finger vein smart lock unlocking method according to claim 3 is characterized in that: The determining of the control instruction and the information to be stored based on the fingerprint recognition result and the finger vein recognition result includes: If the fingerprint recognition result is passed and the finger vein recognition result is passed, an unlock control instruction is generated and the information to be stored is determined to be empty; If the fingerprint recognition result passes and the finger vein recognition result fails, an unlock control instruction is generated, and the finger vein feature to be matched is determined as information to be stored; If the fingerprint recognition result fails and the finger vein recognition result passes, an unlock control instruction is generated, and the fingerprint feature to be matched is determined as information to be stored; If the fingerprint recognition result fails and the finger vein recognition result fails, a locking control instruction is generated and the information to be stored is determined to be empty.

5. The fingerprint and finger vein smart lock unlocking method according to claim 4 is characterized in that: The controlling the opening and closing of the smart lock based on the control instruction includes: If the control instruction is an unlocking control instruction, controlling the smart lock to perform an unlocking operation; If the control instruction is a locking control instruction, the smart lock is controlled to remain in a locked state.

6. The fingerprint and finger vein smart lock unlocking method according to claim 4 is characterized in that: The updating of the preset feature library based on the information to be stored includes: Detecting whether the information to be stored is empty; If the information to be stored is not empty, the information to be stored is saved in the standard fingerprint feature or standard finger vein feature of the target user in the preset feature library.

7. The fingerprint and finger vein smart lock unlocking method according to any one of claims 1 to 6, characterized in that: The collecting of the fingerprint image and the finger vein image of the target user includes: The fingerprint image and finger vein map of the target user are collected by a preset finger information collection device installed on the smart lock, wherein the preset finger information collection device integrates a fingerprint collector and a finger vein collector.

8. A fingerprint and finger vein smart lock unlocking system, characterized in that: The system comprises: A collection module, used for collecting a fingerprint image and a finger vein image of the target user in response to a finger pressing operation of the target user on the smart lock; An identification module, used to identify the fingerprint image and the finger vein image respectively based on a preset feature library, and obtain fingerprint identification results and finger vein identification results accordingly, wherein the preset feature library stores at least one standard fingerprint feature and a standard finger vein feature correspondingly collected by a legitimate user of the smart lock when performing identity registration; A determination module, used to determine the control instruction and the information to be stored based on the fingerprint recognition result and the finger vein recognition result; A control module is used to control the opening and closing of the smart lock based on the control instruction, and to update the preset feature library based on the information to be stored.

9. A computer device, characterized in that: The device includes: a memory and a processor, the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the fingerprint and finger vein smart lock unlocking method described in any one of claims 1 to 7 by executing the computer instructions.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the fingerprint and finger vein smart lock unlocking method described in any one of claims 1 to 7.

Images